v0.3.0: Gap-to-Draft pipeline, Living Standards Observatory, blog series
Gap-to-Draft Pipeline (ietf pipeline): - Context builder assembles ideas, RFC foundations, similar drafts, ecosystem vision - Generator produces outlines + sections using rich context with Claude - Quality gates: novelty (embedding similarity), references, format, self-rating - Family coordinator generates 5-draft ecosystem (AEM/ATD/HITL/AEPB/APAE) - I-D formatter with proper headers, references, 72-char wrapping Living Standards Observatory (ietf observatory): - Source abstraction with IETF + W3C fetchers - 7-step update pipeline: snapshot, fetch, analyze, embed, ideas, gaps, record - Static GitHub Pages dashboard (explorer, gap tracker, timeline) - Weekly CI/CD automation via GitHub Actions Also includes: - 361 drafts (expanded from 260 with 6 new keywords), 403 authors, 1,262 ideas, 12 gaps - Blog series (8 posts planned), reports, arXiv paper figures - Agent team infrastructure (CLAUDE.md, scripts, dev journal) - 5 new DB tables, schema migration, ~15 new query methods Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
9558
docs/data/drafts.json
Normal file
9558
docs/data/drafts.json
Normal file
File diff suppressed because it is too large
Load Diff
101
docs/data/gaps.json
Normal file
101
docs/data/gaps.json
Normal file
@@ -0,0 +1,101 @@
|
||||
{
|
||||
"current": [
|
||||
{
|
||||
"id": 25,
|
||||
"topic": "Agent Behavior Verification",
|
||||
"description": "While many drafts address agent identity and authentication, few tackle how to verify that an agent is actually behaving according to its declared capabilities and policies. There's a critical gap in runtime behavioral attestation and compliance monitoring mechanisms.",
|
||||
"category": "AI safety/alignment",
|
||||
"evidence": "High overlap in identity/auth (108 drafts) but only 44 drafts on safety/alignment, with no specific focus on behavioral verification",
|
||||
"severity": "critical"
|
||||
},
|
||||
{
|
||||
"id": 26,
|
||||
"topic": "Cross-Domain Agent Liability",
|
||||
"description": "When autonomous agents operate across organizational boundaries and cause harm or make decisions with legal implications, there's no standardized framework for liability attribution. The policy/governance drafts don't address cross-jurisdictional legal accountability.",
|
||||
"category": "Policy/governance",
|
||||
"evidence": "91 policy/governance drafts but legal liability for cross-domain autonomous actions remains unaddressed",
|
||||
"severity": "critical"
|
||||
},
|
||||
{
|
||||
"id": 27,
|
||||
"topic": "Agent Resource Exhaustion Protection",
|
||||
"description": "Missing standardized mechanisms to prevent malicious or poorly designed agents from consuming excessive network, compute, or storage resources. Current drafts focus on traffic management but not on agent-specific resource quotas and enforcement.",
|
||||
"category": "Autonomous netops",
|
||||
"evidence": "93 autonomous netops drafts and 73 ML traffic management drafts lack agent-specific resource protection mechanisms",
|
||||
"severity": "high"
|
||||
},
|
||||
{
|
||||
"id": 28,
|
||||
"topic": "Human Override Protocols",
|
||||
"description": "Critical gap in standardized protocols for humans to safely interrupt, override, or take control of autonomous agents in emergency situations. Only 30 drafts address human-agent interaction, with no focus on emergency takeover procedures.",
|
||||
"category": "Human-agent interaction",
|
||||
"evidence": "Only 30 human-agent interaction drafts compared to 213+ autonomous operation drafts, with no emergency override standards",
|
||||
"severity": "critical"
|
||||
},
|
||||
{
|
||||
"id": 29,
|
||||
"topic": "Agent-Generated Data Provenance",
|
||||
"description": "While 145 drafts address data formats for AI interop, there's insufficient attention to tracking the provenance and lineage of data generated by agents. This creates trust and auditability issues in agent-to-agent data exchanges.",
|
||||
"category": "Data formats/interop",
|
||||
"evidence": "145 data format drafts with high overlap but no clear standards for agent-generated data provenance tracking",
|
||||
"severity": "high"
|
||||
},
|
||||
{
|
||||
"id": 30,
|
||||
"topic": "Agent Capability Degradation Handling",
|
||||
"description": "No standardized approaches for detecting and handling when an agent's capabilities degrade due to model drift, data corruption, or hardware issues. Systems need graceful degradation protocols rather than silent failures.",
|
||||
"category": "AI safety/alignment",
|
||||
"evidence": "Only 44 safety/alignment drafts don't address capability degradation, while 213+ drafts assume stable agent performance",
|
||||
"severity": "high"
|
||||
},
|
||||
{
|
||||
"id": 31,
|
||||
"topic": "Multi-Agent Coordination Deadlocks",
|
||||
"description": "With 120+ A2A protocol drafts, there's insufficient attention to preventing deadlock situations where multiple agents create circular dependencies or resource conflicts. Missing are standardized deadlock detection and resolution mechanisms.",
|
||||
"category": "A2A protocols",
|
||||
"evidence": "120 A2A protocol drafts with high internal overlap but no systematic deadlock prevention frameworks",
|
||||
"severity": "high"
|
||||
},
|
||||
{
|
||||
"id": 32,
|
||||
"topic": "Agent Privacy Preservation",
|
||||
"description": "Agents often process sensitive data but current drafts don't adequately address privacy-preserving computation, differential privacy, or secure multi-party computation for agent interactions. This is critical for deployment in regulated industries.",
|
||||
"category": "Agent identity/auth",
|
||||
"evidence": "108 identity/auth drafts focus on authentication but lack privacy preservation mechanisms for agent data processing",
|
||||
"severity": "high"
|
||||
},
|
||||
{
|
||||
"id": 33,
|
||||
"topic": "Real-time Agent Debugging",
|
||||
"description": "Missing standardized protocols for debugging autonomous agents in production environments. When agents make unexpected decisions, there are no standard interfaces for real-time introspection without disrupting operations.",
|
||||
"category": "Other AI/agent",
|
||||
"evidence": "26 other AI/agent drafts suggest various approaches but no standardized debugging protocols for production agents",
|
||||
"severity": "medium"
|
||||
},
|
||||
{
|
||||
"id": 34,
|
||||
"topic": "Agent Firmware/Model Update Security",
|
||||
"description": "While model serving is addressed in 42 drafts, there's insufficient focus on secure update mechanisms for agent models and firmware. Missing are standards for cryptographically verified, rollback-capable agent updates.",
|
||||
"category": "Model serving/inference",
|
||||
"evidence": "42 model serving drafts but no comprehensive security standards for agent software/model updates",
|
||||
"severity": "high"
|
||||
},
|
||||
{
|
||||
"id": 35,
|
||||
"topic": "Cross-Protocol Agent Migration",
|
||||
"description": "No standardized mechanisms for migrating agent state and context when moving between different A2A protocols or infrastructure providers. This creates vendor lock-in and limits agent mobility.",
|
||||
"category": "A2A protocols",
|
||||
"evidence": "120 A2A protocol drafts with high overlap suggest competing approaches but no migration standards between them",
|
||||
"severity": "medium"
|
||||
},
|
||||
{
|
||||
"id": 36,
|
||||
"topic": "Agent Energy Consumption Optimization",
|
||||
"description": "Missing standards for energy-aware agent deployment and operation. As AI workloads are energy-intensive, there's no framework for agents to optimize their energy consumption or for infrastructure to enforce energy budgets.",
|
||||
"category": "ML traffic mgmt",
|
||||
"evidence": "73 ML traffic management drafts focus on performance but lack energy consumption considerations for sustainable AI deployment",
|
||||
"severity": "medium"
|
||||
}
|
||||
],
|
||||
"history": []
|
||||
}
|
||||
5
docs/data/meta.json
Normal file
5
docs/data/meta.json
Normal file
@@ -0,0 +1,5 @@
|
||||
{
|
||||
"generated_at": "2026-03-03T23:32:29.056739+00:00",
|
||||
"version": "0.3.0",
|
||||
"project": "IETF Living Standards Observatory"
|
||||
}
|
||||
9
docs/data/observatory.json
Normal file
9
docs/data/observatory.json
Normal file
@@ -0,0 +1,9 @@
|
||||
{
|
||||
"total_docs": 361,
|
||||
"sources": {},
|
||||
"gaps_count": 12,
|
||||
"unrated": 0,
|
||||
"ideas": 1780,
|
||||
"authors": 557,
|
||||
"last_update": null
|
||||
}
|
||||
264
docs/data/timeline.json
Normal file
264
docs/data/timeline.json
Normal file
@@ -0,0 +1,264 @@
|
||||
{
|
||||
"months": [
|
||||
"2024-01",
|
||||
"2024-02",
|
||||
"2024-04",
|
||||
"2024-09",
|
||||
"2024-10",
|
||||
"2024-12",
|
||||
"2025-01",
|
||||
"2025-04",
|
||||
"2025-05",
|
||||
"2025-06",
|
||||
"2025-07",
|
||||
"2025-08",
|
||||
"2025-09",
|
||||
"2025-10",
|
||||
"2025-11",
|
||||
"2025-12",
|
||||
"2026-01",
|
||||
"2026-02",
|
||||
"2026-03"
|
||||
],
|
||||
"by_category": {
|
||||
"2024-01": {
|
||||
"Agent identity/auth": 1,
|
||||
"Policy/governance": 1,
|
||||
"Other AI/agent": 1,
|
||||
"Data formats/interop": 1,
|
||||
"AI safety/alignment": 1
|
||||
},
|
||||
"2024-02": {
|
||||
"Autonomous netops": 1,
|
||||
"ML traffic mgmt": 1
|
||||
},
|
||||
"2024-04": {
|
||||
"A2A protocols": 1,
|
||||
"Autonomous netops": 1,
|
||||
"Data formats/interop": 1
|
||||
},
|
||||
"2024-09": {
|
||||
"Autonomous netops": 1,
|
||||
"Policy/governance": 1,
|
||||
"ML traffic mgmt": 1
|
||||
},
|
||||
"2024-10": {
|
||||
"ML traffic mgmt": 1,
|
||||
"Model serving/inference": 1
|
||||
},
|
||||
"2024-12": {
|
||||
"Other AI/agent": 1
|
||||
},
|
||||
"2025-01": {
|
||||
"Data formats/interop": 2,
|
||||
"ML traffic mgmt": 4,
|
||||
"Model serving/inference": 2
|
||||
},
|
||||
"2025-04": {
|
||||
"Policy/governance": 3,
|
||||
"Agent identity/auth": 1,
|
||||
"Data formats/interop": 2,
|
||||
"AI safety/alignment": 1,
|
||||
"Autonomous netops": 1,
|
||||
"Model serving/inference": 1,
|
||||
"ML traffic mgmt": 1
|
||||
},
|
||||
"2025-05": {
|
||||
"Policy/governance": 2,
|
||||
"Agent discovery/reg": 1,
|
||||
"Data formats/interop": 1,
|
||||
"Human-agent interaction": 1
|
||||
},
|
||||
"2025-06": {
|
||||
"Agent identity/auth": 2,
|
||||
"A2A protocols": 1,
|
||||
"Policy/governance": 1,
|
||||
"Autonomous netops": 3,
|
||||
"ML traffic mgmt": 3,
|
||||
"Model serving/inference": 1,
|
||||
"Data formats/interop": 1
|
||||
},
|
||||
"2025-07": {
|
||||
"Agent identity/auth": 2,
|
||||
"A2A protocols": 2,
|
||||
"Agent discovery/reg": 1,
|
||||
"Data formats/interop": 2,
|
||||
"AI safety/alignment": 2,
|
||||
"Human-agent interaction": 1,
|
||||
"Policy/governance": 1
|
||||
},
|
||||
"2025-08": {
|
||||
"Autonomous netops": 2,
|
||||
"Data formats/interop": 6,
|
||||
"Agent identity/auth": 2,
|
||||
"Policy/governance": 3,
|
||||
"Other AI/agent": 2,
|
||||
"Human-agent interaction": 1
|
||||
},
|
||||
"2025-09": {
|
||||
"Policy/governance": 6,
|
||||
"Autonomous netops": 6,
|
||||
"Data formats/interop": 11,
|
||||
"ML traffic mgmt": 4,
|
||||
"AI safety/alignment": 4,
|
||||
"Agent discovery/reg": 3,
|
||||
"A2A protocols": 4,
|
||||
"Human-agent interaction": 1,
|
||||
"Agent identity/auth": 3,
|
||||
"Model serving/inference": 1
|
||||
},
|
||||
"2025-10": {
|
||||
"Policy/governance": 10,
|
||||
"Data formats/interop": 36,
|
||||
"Model serving/inference": 9,
|
||||
"ML traffic mgmt": 13,
|
||||
"Autonomous netops": 19,
|
||||
"Agent discovery/reg": 15,
|
||||
"Agent identity/auth": 24,
|
||||
"Human-agent interaction": 7,
|
||||
"A2A protocols": 28,
|
||||
"AI safety/alignment": 5,
|
||||
"Other AI/agent": 5
|
||||
},
|
||||
"2025-11": {
|
||||
"A2A protocols": 29,
|
||||
"Autonomous netops": 18,
|
||||
"Data formats/interop": 25,
|
||||
"ML traffic mgmt": 9,
|
||||
"Agent discovery/reg": 18,
|
||||
"Agent identity/auth": 23,
|
||||
"AI safety/alignment": 7,
|
||||
"Policy/governance": 15,
|
||||
"Human-agent interaction": 9,
|
||||
"Model serving/inference": 4,
|
||||
"Other AI/agent": 2
|
||||
},
|
||||
"2025-12": {
|
||||
"Policy/governance": 6,
|
||||
"Data formats/interop": 6,
|
||||
"Human-agent interaction": 1,
|
||||
"Agent identity/auth": 8,
|
||||
"Autonomous netops": 4,
|
||||
"Other AI/agent": 2,
|
||||
"A2A protocols": 2,
|
||||
"ML traffic mgmt": 3,
|
||||
"AI safety/alignment": 3,
|
||||
"Agent discovery/reg": 4,
|
||||
"Model serving/inference": 1
|
||||
},
|
||||
"2026-01": {
|
||||
"Agent identity/auth": 18,
|
||||
"AI safety/alignment": 8,
|
||||
"Policy/governance": 14,
|
||||
"A2A protocols": 22,
|
||||
"Agent discovery/reg": 15,
|
||||
"ML traffic mgmt": 8,
|
||||
"Data formats/interop": 17,
|
||||
"Autonomous netops": 16,
|
||||
"Model serving/inference": 5,
|
||||
"Other AI/agent": 4,
|
||||
"Human-agent interaction": 2
|
||||
},
|
||||
"2026-02": {
|
||||
"A2A protocols": 38,
|
||||
"Human-agent interaction": 6,
|
||||
"Data formats/interop": 32,
|
||||
"Agent identity/auth": 34,
|
||||
"Policy/governance": 24,
|
||||
"Autonomous netops": 18,
|
||||
"ML traffic mgmt": 15,
|
||||
"Agent discovery/reg": 19,
|
||||
"Other AI/agent": 8,
|
||||
"AI safety/alignment": 13,
|
||||
"Model serving/inference": 8
|
||||
},
|
||||
"2026-03": {
|
||||
"ML traffic mgmt": 11,
|
||||
"A2A protocols": 9,
|
||||
"Model serving/inference": 9,
|
||||
"Agent identity/auth": 3,
|
||||
"Data formats/interop": 5,
|
||||
"Autonomous netops": 8,
|
||||
"Policy/governance": 6,
|
||||
"Agent discovery/reg": 3,
|
||||
"Human-agent interaction": 1,
|
||||
"Other AI/agent": 1,
|
||||
"AI safety/alignment": 1
|
||||
}
|
||||
},
|
||||
"by_source": {
|
||||
"2024-01": {
|
||||
"ietf": 3
|
||||
},
|
||||
"2024-02": {
|
||||
"ietf": 1
|
||||
},
|
||||
"2024-04": {
|
||||
"ietf": 1
|
||||
},
|
||||
"2024-09": {
|
||||
"ietf": 2
|
||||
},
|
||||
"2024-10": {
|
||||
"ietf": 1
|
||||
},
|
||||
"2024-12": {
|
||||
"ietf": 1
|
||||
},
|
||||
"2025-01": {
|
||||
"ietf": 4
|
||||
},
|
||||
"2025-04": {
|
||||
"ietf": 5
|
||||
},
|
||||
"2025-05": {
|
||||
"ietf": 2
|
||||
},
|
||||
"2025-06": {
|
||||
"ietf": 5
|
||||
},
|
||||
"2025-07": {
|
||||
"ietf": 5
|
||||
},
|
||||
"2025-08": {
|
||||
"ietf": 8
|
||||
},
|
||||
"2025-09": {
|
||||
"ietf": 17
|
||||
},
|
||||
"2025-10": {
|
||||
"ietf": 67
|
||||
},
|
||||
"2025-11": {
|
||||
"ietf": 61
|
||||
},
|
||||
"2025-12": {
|
||||
"ietf": 16
|
||||
},
|
||||
"2026-01": {
|
||||
"ietf": 54
|
||||
},
|
||||
"2026-02": {
|
||||
"ietf": 86
|
||||
},
|
||||
"2026-03": {
|
||||
"ietf": 22
|
||||
}
|
||||
},
|
||||
"categories": [
|
||||
"A2A protocols",
|
||||
"AI safety/alignment",
|
||||
"Agent discovery/reg",
|
||||
"Agent identity/auth",
|
||||
"Autonomous netops",
|
||||
"Data formats/interop",
|
||||
"Human-agent interaction",
|
||||
"ML traffic mgmt",
|
||||
"Model serving/inference",
|
||||
"Other AI/agent",
|
||||
"Policy/governance"
|
||||
],
|
||||
"sources": [
|
||||
"ietf"
|
||||
]
|
||||
}
|
||||
Reference in New Issue
Block a user