Skip to main content
SAICA-KG

Tools

mlflow

25,505

Open-source platform for the machine learning lifecycle — experiments, tracking, models, and LLM evaluation.

DetectionPost-generationFull HITLStableTier 2AEnvironment
Maturity tier details

Computed tier: 2A(raw score 5.26). Effective tier: 2A.

Facets:documented_in=0evaluated_on=0integration_surfaces=1.5paper_citations=0recent_commit=2stars=1.76

Source of truth:pipeline/maturity/score.py

Description

MLflow is the open-source ML lifecycle platform stewarded by Databricks. Recent LLM-focused additions (MLflow 2.x) bring LLM tracing (OpenTelemetry), LLM evaluation, and a deployments registry — making it usable as an observability + eval backbone for LLM applications alongside classic ML.

Why it's included

Represents the 'classical-MLOps-extended-to-LLMs' point: teams with MLflow infrastructure can adopt LLM evaluation without a greenfield tool. Differentiated from langfuse/phoenix by its ML lifecycle lineage and Databricks ecosystem integration.

Addresses failure modes

  • Fabrication — Generating reference to non-existent APIs, packages, or symbols.
  • Logic error — Correct API use, incorrect logic.
  • Scope creep — Actions outside declared task boundary.

Techniques

llm-tracingexperimentsmodel-registryllm-evaluation

View raw YAML on GitHub →