ML Experiment Tracker
intermediatedataMin 64K context
Sets up and manages machine learning experiment tracking, hyperparameter optimization, and model registry workflows. Integrates with MLflow, Weights & Biases, and Optuna for systematic experimentation. Handles metric logging, artifact storage, model versioning, reproducibility, and automated hyperparameter search with early stopping.
Use Cases
- Setting up MLflow tracking for team ML projects
- Automated hyperparameter search with Optuna
- Comparing model performance across experiments
- Building reproducible training pipelines with config management
- Model versioning and promotion workflows (staging → production)
- Generating experiment reports with metrics and visualizations
Example Prompt
Set up a complete ML experiment tracking workflow for a text classification project. Requirements: 1. MLflow tracking server configuration (local or remote) 2. Experiment structure with proper naming and tagging 3. Optuna hyperparameter optimization with: - Learning rate, batch size, model architecture search - Pruning of unpromising trials (MedianPruner) - 50 trials with TPE sampler 4. Automatic logging of: - Training/validation metrics per epoch - Confusion matrix and classification report - Model artifacts and config files - Git commit hash and environment info 5. Model registry with stage transitions 6. Comparison dashboard code Generate complete Python code using MLflow + Optuna + PyTorch Lightning.
Recommended Models
Compatible Tools
claude-codecursorkiroany
Modalities
Input: text, code
→Output: text, code
Related Skills
Author
OpenModels Community