5-Lens Empirical Quadrants, Pareto Frontier & 17-Facet AI Catalog
Replaces subjective analyst pay-to-play quadrants with reproducible telemetry across LLMs, CPU/Edge SLMs, 3D/Multimodal, Time-Series Foundation Models (Chronos-Bolt, TimesFM 2.0, Moirai-MoE, TimeGPT, PatchTST, Toto), Agent SDKs/Orchestrators, 7-Stage RAG, DSPy, Embeddings, MCP + A2A, Security, Tracing vs Evaluation, Memory Policies vs Vector/SQL Substrates, and Durable Execution.
All 17 Facets (10) agent_development_orchestration ai_security_and_guardrails automation_ipaas_dag_durable embeddings_and_rerankers evaluation_and_regression_testing llm_frontier_cloud llm_open_weights_cloud memory_behavior_policies multimodal_vision_audio_3d observability_tracing_monitoring programmatic_prompt_workflow_optimization protocols_mcp_and_a2a rag_context_pipeline slm_cpu_edge_quantized teleon_team_simulation_provenance timeseries_foundation_models vector_and_transactional_storage
5 Orthogonal Ranking Lenses
- Lens 1 (Empirical 2x2 Quadrant): X = Verified Execution Reliability vs Y = Architectural Composability and Governance Fit.
- Lens 2 (Constraint-Weighted Wave): Custom workload weights plus Tversky hard vetoes (
spdx_license, blast class, CPU-only). - Lens 3 (Exact Pareto Frontier): Non-dominated set across Quality, Latency, Cost, Cliff Retention, and Lock-in Freedom (orange nodes).
- Lens 4 (Jagged-Frontier Cliff Index): Perturbed neighbor retention ratio.
- Lens 5 (Team Marginal Value / WAR): Paired holdout lift net of coordination token tax.
| Component & Publisher | Primary Facet | Quadrant & Frontier | Lens Scores | Cliff & WAR | License |
|---|---|---|---|---|---|
| Microsoft Presidio Microsoft ( security_guardrail) |
ai_security_and_guardrails |
EMPIRICAL_LEADER PARETO | Exec: 96, Fit: 94, Wave: 93.8 | Cliff: 91%, WAR: +0.26 | MIT |
| Protect AI (LLM Guard & ModelScan) Protect AI ( security_guardrail) |
ai_security_and_guardrails |
EMPIRICAL_LEADER | Exec: 94, Fit: 93, Wave: 93 | Cliff: 91%, WAR: +0.24 | MIT |
| NVIDIA NeMo Guardrails NVIDIA ( security_guardrail) |
ai_security_and_guardrails |
EMPIRICAL_LEADER | Exec: 91, Fit: 92, Wave: 91.56 | Cliff: 87%, WAR: +0.23 | Apache-2.0 |
| Giskard LLM & RAG Scanner Giskard ( evaluation_harness) |
ai_security_and_guardrails |
EMPIRICAL_LEADER | Exec: 90, Fit: 92, Wave: 91.04 | Cliff: 89%, WAR: +0.22 | Apache-2.0 |
| Guardrails AI Guardrails AI ( security_guardrail) |
ai_security_and_guardrails |
EMPIRICAL_LEADER | Exec: 90, Fit: 91, Wave: 90.36 | Cliff: 87%, WAR: +0.2 | Apache-2.0 |
| Meta Llama Guard 3 (8B / 1B) Meta ( security_guardrail) |
ai_security_and_guardrails |
EMPIRICAL_LEADER | Exec: 92, Fit: 92, Wave: 88.88 | Cliff: 87%, WAR: +0.21 | Llama-3.2 |
| AWS Bedrock Guardrails AWS ( security_guardrail) |
ai_security_and_guardrails |
EMPIRICAL_LEADER PARETO | Exec: 95, Fit: 94, Wave: 88.24 | Cliff: 91%, WAR: +0.25 | Proprietary |
| Lakera Guard Lakera ( security_guardrail) |
ai_security_and_guardrails |
EMPIRICAL_LEADER | Exec: 94, Fit: 93, Wave: 87.32 | Cliff: 89%, WAR: +0.24 | Proprietary |
| Azure AI Content Safety Microsoft Azure ( security_guardrail) |
ai_security_and_guardrails |
EMPIRICAL_LEADER | Exec: 94, Fit: 93, Wave: 87 | Cliff: 89%, WAR: +0.22 | Proprietary |
| Prompt Security Prompt Security ( security_guardrail) |
ai_security_and_guardrails |
EMPIRICAL_LEADER | Exec: 90, Fit: 92, Wave: 84.76 | Cliff: 89%, WAR: +0.19 | Proprietary |