Pantograph/experiments/minif2f/README.md

480 B

MiniF2F

This is an experiment on running a LLM prover on miniF2F data. Build the project MiniF2F with lake build. Check the environment and data with

python3 experiments/minif2f/main.py check
python3 experiments/minif2f/main.py list

and run experiments with

python3 experiments/minif2f/main.py eval [--use-llm] [--use-hammer]

Read the help message carefully.

Developing

Run unit tests with

python3 -m model.{llm_agent,gen_tactic}