5-Lens Empirical Quadrants, Pareto Frontier & 17-Facet AI Catalog
Replaces subjective analyst pay-to-play quadrants with reproducible telemetry across LLMs, CPU/Edge SLMs, 3D/Multimodal, Time-Series Foundation Models (Chronos-Bolt, TimesFM 2.0, Moirai-MoE, TimeGPT, PatchTST, Toto), Agent SDKs/Orchestrators, 7-Stage RAG, DSPy, Embeddings, MCP + A2A, Security, Tracing vs Evaluation, Memory Policies vs Vector/SQL Substrates, and Durable Execution.
All 17 Facets (7) agent_development_orchestration ai_security_and_guardrails automation_ipaas_dag_durable embeddings_and_rerankers evaluation_and_regression_testing llm_frontier_cloud llm_open_weights_cloud memory_behavior_policies multimodal_vision_audio_3d observability_tracing_monitoring programmatic_prompt_workflow_optimization protocols_mcp_and_a2a rag_context_pipeline slm_cpu_edge_quantized teleon_team_simulation_provenance timeseries_foundation_models vector_and_transactional_storage
5 Orthogonal Ranking Lenses
- Lens 1 (Empirical 2x2 Quadrant): X = Verified Execution Reliability vs Y = Architectural Composability and Governance Fit.
- Lens 2 (Constraint-Weighted Wave): Custom workload weights plus Tversky hard vetoes (
spdx_license, blast class, CPU-only). - Lens 3 (Exact Pareto Frontier): Non-dominated set across Quality, Latency, Cost, Cliff Retention, and Lock-in Freedom (orange nodes).
- Lens 4 (Jagged-Frontier Cliff Index): Perturbed neighbor retention ratio.
- Lens 5 (Team Marginal Value / WAR): Paired holdout lift net of coordination token tax.
| Component & Publisher | Primary Facet | Quadrant & Frontier | Lens Scores | Cliff & WAR | License |
|---|---|---|---|---|---|
| Traceloop OpenLLMetry Traceloop ( tracing_gateway) |
observability_tracing_monitoring |
EMPIRICAL_LEADER PARETO | Exec: 97, Fit: 95, Wave: 95.08 | Cliff: 95%, WAR: +0.28 | Apache-2.0 |
| Langfuse Langfuse ( tracing_gateway) |
observability_tracing_monitoring |
EMPIRICAL_LEADER PARETO | Exec: 96, Fit: 94, Wave: 94.8 | Cliff: 93%, WAR: +0.27 | MIT |
| Helicone Helicone ( tracing_gateway) |
observability_tracing_monitoring |
EMPIRICAL_LEADER | Exec: 95, Fit: 94, Wave: 92.96 | Cliff: 93%, WAR: +0.23 | Apache-2.0 |
| Weights & Biases Weave Weights & Biases ( tracing_gateway) |
observability_tracing_monitoring |
EMPIRICAL_LEADER | Exec: 92, Fit: 93, Wave: 92.52 | Cliff: 91%, WAR: +0.22 | Apache-2.0 |
| LiteLLM Proxy & Spend Ledger BerriAI ( tracing_gateway) |
observability_tracing_monitoring |
EMPIRICAL_LEADER | Exec: 91, Fit: 92, Wave: 92.24 | Cliff: 89%, WAR: +0.25 | MIT |
| Arize Phoenix Arize AI ( tracing_gateway) |
observability_tracing_monitoring |
EMPIRICAL_LEADER | Exec: 94, Fit: 94, Wave: 91.4 | Cliff: 93%, WAR: +0.25 | ELv2 |
| LangSmith LangChain ( tracing_gateway) |
observability_tracing_monitoring |
EMPIRICAL_LEADER | Exec: 94, Fit: 93, Wave: 88 | Cliff: 91%, WAR: +0.24 | Proprietary |