Skip to content

neuroquant/spot_evals

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 

Repository files navigation

SPOT Evaluation Pipeline Using Inspect

Quick Start


### 1. Set Up the Python Environment

#### Using venv (recommended):

```sh
python3 -m venv spot_env
source spot_env/bin/activate
pip install -r requirements.txt

### 2. Run the Pipeline

- Open `spot_evaluation_pipeline.ipynb` in Jupyter or VS Code and follow the cells.
- Or run the relevant Python scripts as needed.

### 3. Results

- Log files are generated in a temporary directory.
- Scored results are saved as `_scored.json` files.
- Use the provided code to extract summary results to `spot_results.json`.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published