Pantograph/experiments/minif2f/README.md

27 lines
480 B
Markdown
Raw Permalink Normal View History

# MiniF2F
2024-10-03 15:45:14 -07:00
This is an experiment on running a LLM prover on miniF2F data. Build the project
2024-10-09 18:23:21 -07:00
`MiniF2F` with `lake build`. Check the environment and data with
``` sh
python3 experiments/minif2f/main.py check
python3 experiments/minif2f/main.py list
```
and run experiments with
```sh
2024-10-09 18:23:21 -07:00
python3 experiments/minif2f/main.py eval [--use-llm] [--use-hammer]
```
2024-10-03 15:45:14 -07:00
Read the help message carefully.
## Developing
Run unit tests with
``` sh
python3 -m model.{llm_agent,gen_tactic}
```