5-Lens Empirical Quadrants, Pareto Frontier & 17-Facet AI Catalog
Replaces subjective analyst pay-to-play quadrants with reproducible telemetry across LLMs, CPU/Edge SLMs, 3D/Multimodal, Time-Series Foundation Models (Chronos-Bolt, TimesFM 2.0, Moirai-MoE, TimeGPT, PatchTST, Toto), Agent SDKs/Orchestrators, 7-Stage RAG, DSPy, Embeddings, MCP + A2A, Security, Tracing vs Evaluation, Memory Policies vs Vector/SQL Substrates, and Durable Execution.
All 17 Facets (3) agent_development_orchestration ai_security_and_guardrails automation_ipaas_dag_durable embeddings_and_rerankers evaluation_and_regression_testing llm_frontier_cloud llm_open_weights_cloud memory_behavior_policies multimodal_vision_audio_3d observability_tracing_monitoring programmatic_prompt_workflow_optimization protocols_mcp_and_a2a rag_context_pipeline slm_cpu_edge_quantized teleon_team_simulation_provenance timeseries_foundation_models vector_and_transactional_storage
5 Orthogonal Ranking Lenses
- Lens 1 (Empirical 2x2 Quadrant): X = Verified Execution Reliability vs Y = Architectural Composability and Governance Fit.
- Lens 2 (Constraint-Weighted Wave): Custom workload weights plus Tversky hard vetoes (
spdx_license, blast class, CPU-only). - Lens 3 (Exact Pareto Frontier): Non-dominated set across Quality, Latency, Cost, Cliff Retention, and Lock-in Freedom (orange nodes).
- Lens 4 (Jagged-Frontier Cliff Index): Perturbed neighbor retention ratio.
- Lens 5 (Team Marginal Value / WAR): Paired holdout lift net of coordination token tax.
| Component & Publisher | Primary Facet | Quadrant & Frontier | Lens Scores | Cliff & WAR | License |
|---|---|---|---|---|---|
| DSPy Stanford NLP ( programmatic_optimizer) |
programmatic_prompt_workflow_optimization |
EMPIRICAL_LEADER PARETO | Exec: 94, Fit: 93, Wave: 93.92 | Cliff: 89%, WAR: +0.32 | MIT |
| Comet Opik Agent Optimizer Comet ( programmatic_optimizer) |
programmatic_prompt_workflow_optimization |
EMPIRICAL_LEADER | Exec: 89, Fit: 91, Wave: 89.94 | Cliff: 86%, WAR: +0.21 | Apache-2.0 |
| TextGrad zou-group ( programmatic_optimizer) |
programmatic_prompt_workflow_optimization |
OPERATIONAL_WORKHORSE | Exec: 83, Fit: 80, Wave: 86.42 | Cliff: 80%, WAR: +0.17 | MIT |