W&B provides beautiful experiment tracking with native SuperOptiX integration for agent-specific metrics
Stunning charts and dashboards
Compare runs with ease
Share experiments with team
Automated parameter tuning
Track model improvements
Optimization iterations logged
uv pip install wandb wandb login
# Track agent execution super agent run my_agent --goal "Analyze data" --observe wandb # Track optimization runs super agent optimize my_agent --auto medium --observe wandb # Track evaluation super agent evaluate my_agent --observe wandb
# Open https://wandb.ai/your-username/superoptix| Metric | Example |
|---|---|
| execution/latency | 1.2s |
| execution/success_rate | 95% |
| execution/token_usage | 1,250 |
| execution/cost | $0.002 |
| Metric | Example |
|---|---|
| gepa/generation | 5 |
| gepa/fitness_score | 0.85 |
| gepa/improvement | +0.12 |
| gepa/population_size | 20 |
| Metric | Example |
|---|---|
| comparison/dspy | 0.80 |
| comparison/openai | 0.95 |
| comparison/crewai | 0.88 |
| comparison/pydantic-ai | 0.92 |
# Track GEPA parameter tuning super agent optimize my_agent \ --auto intensive \ --observe wandb \ --wandb-sweep \ --sweep-config sweep_config.yaml
Automatically find the best GEPA parameters for your agent!
# sweep_config.yaml program: "super agent optimize" method: bayes metric: name: "gepa/fitness_score" goal: maximize parameters: reflection_lm: values: ["qwen3:8b", "llama3:8b", "gemma2:9b"] reflection_minibatch_size: distribution: int_uniform min: 2 max: 8 auto: values: ["light", "medium", "intensive"]
# Share experiments with team super agent run my_agent \ --goal "Customer support" \ --observe wandb \ --entity "my-company" \ --project "customer-agents" \ --tags ["team-shared", "customer-support"]
# Compare frameworks super agent run sentiment_analyzer --observe wandb --tags ["dspy", "comparison"] super agent run assistant_openai --observe wandb --tags ["openai", "comparison"] super agent run researcher_crew --observe wandb --tags ["crewai", "comparison"]
📁 W&B Projects Structure:
Use consistent tags:
Use hierarchical naming:
For model registry, deployment tracking, artifact management
For LLM-specific features, real-time cost tracking, A/B testing
For local development, no setup required, works offline