mlflow
25,505Open-source platform for the machine learning lifecycle — experiments, tracking, models, and LLM evaluation.
Maturity tier details
Computed tier: 2A(raw score 5.26). Effective tier: 2A.
Facets:documented_in=0evaluated_on=0integration_surfaces=1.5paper_citations=0recent_commit=2stars=1.76
Source of truth:pipeline/maturity/score.py
Description
MLflow is the open-source ML lifecycle platform stewarded by Databricks. Recent LLM-focused additions (MLflow 2.x) bring LLM tracing (OpenTelemetry), LLM evaluation, and a deployments registry — making it usable as an observability + eval backbone for LLM applications alongside classic ML.
Why it's included
Represents the 'classical-MLOps-extended-to-LLMs' point: teams with MLflow infrastructure can adopt LLM evaluation without a greenfield tool. Differentiated from langfuse/phoenix by its ML lifecycle lineage and Databricks ecosystem integration.
Addresses failure modes
- Fabrication — Generating reference to non-existent APIs, packages, or symbols.
- Logic error — Correct API use, incorrect logic.
- Scope creep — Actions outside declared task boundary.