AutoResearch: Autonomous ML Research Framework
Published:
π¬ AutoResearch Overview
AutoResearch is an agents and device-agnostic autonomous machine learning research framework that enables AI agents to independently conduct end-to-end experiments. Unlike traditional AutoML tools, AutoResearch provides a complete research loop where agents can modify code, run experiments, evaluate results, and learn from a persistent semantic memory.
π Key Features
- π€ Advanced Agent Integration: Built-in protocols for advanced agentic systems like Claude Code, OpenCode, and OpenClaw.
- π§ Semantic Research Memory: Long-term RAG-based memory using ChromaDB allows agents to learn from every past experiment.
- π Industrial Observability: Native integration with Weights & Biases (W&B) for real-time metric tracking and artifact management.
- β‘ High-Performance Backends: Native support for Apple MLX, JAX, and PyTorch (CUDA/MPS/CPU).
- π Distributed Scaling: Parallelize research across clusters using Ray.
- π‘οΈ Robust Orchestration: SQL-backed metadata management and automatic Git-based experiment versioning.
ποΈ Architecture
AutoResearch acts as the Research Platform (The Orchestrator) while the AI system acts as the Brain (The Agent).
π Quick Start
Clone and navigate to the directory then:
1. Install
pip install .
2. Initialize a Project
autoresearch init my_research --name "Optimizing-Transformer"
cd my_research
3. Run with an External Agent (e.g., Claude Code) Configure your autoresearch.yaml:
agent:
type: "external"
command: "claude-code"
Then start the autonomous loop:
autoresearch run
Or run a single step as a tool:
autoresearch step --description "Trying Muon optimizer instead of AdamW"
π°οΈ Autopilot Mode (Pro)
For high-throughput research, AutoResearch supports a fully autonomous βAutopilotβ mode. This allows the framework to automatically drive interactive CLI agents like OpenCode or Claude Code by feeding them prompts and auto-exiting sessions once the code is optimized.
- Install Driver:
pip install pexpect - Configure: Set
autopilot: truein yourautoresearch.yaml. - Deploy: Run
autoresearch runand the framework will handle $N$ experiments completely unattended.
π Comparison: AutoResearch vs. Traditional AutoML
| Feature | Traditional AutoML | AutoResearch |
|---|---|---|
| Scope | Hyperparameter tuning only | Full code & architecture modification |
| Agent Control | Fixed search space | AI decides what to change |
| Learning | Grid/Bayesian search | Semantic memory (RAG) of past results |
| Device Support | Varies by tool | Native MLX, JAX, CUDA, MPS |
| Integration | Limited to configs | Direct integration with Claude Code/GPT |
π₯ Team Roster for ajeetkbhardwaj/automlresearch
Run the GitHub Action to auto-populate your team members here!
π Weekly Plan & Updates
Write your weekly plan, problems tackled, and achievements here. The automated script will never overwrite this text!
π Team Leader Update
- Solved: [What did you solve?]
π¨βπ» Team Member Updates
- Solved: [What did the team solve?]
