Christian Nennemann
6e3a387778
- Tighten idea extraction prompts (1-4 ideas, no sub-features) reducing 1,907 ideas to 468 across 434 drafts (78% reduction) - Add embedding-based dedup (ietf dedup-ideas) for same-draft similarity - Add novelty scoring (ietf ideas score) and filtering (ietf ideas filter) using Claude to rate ideas 1-5, removing 49 generic building blocks - Final count: 419 high-quality ideas (avg 1.1/draft) - Web UI: gap explorer with live draft generation and pre-generated demos - Web UI: D3.js author collaboration network (498 nodes, 1142 edges, 68 clusters, org filtering, interactive zoom/pan) - Academic paper: 15-page LaTeX workshop paper analyzing the 434-draft AI agent standards landscape - Save improvement ideas backlog to data/reports/improvement-ideas.md Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
32 lines
1.7 KiB
Markdown
32 lines
1.7 KiB
Markdown
# IETF Draft Analyzer — Improvement Ideas
|
|
|
|
*Saved 2026-03-06 for future implementation*
|
|
|
|
## Quick Wins
|
|
|
|
### 1. Finish the Web Dashboard
|
|
`src/webui/` has a solid plan (PLAN.md) but is partially built. A live, interactive explorer makes the data far more accessible than markdown reports. Priority: ship it.
|
|
|
|
### 2. Publish the Blog Series
|
|
8 posts drafted in `data/reports/blog-series/`. Publish on GitHub Pages, dev.to, or a static site. The "4:1 capability-to-safety ratio" finding is shareable and provocative.
|
|
|
|
### 3. Trend Alerts (`ietf watch`)
|
|
Add a CLI command that re-fetches weekly and flags new drafts, revised drafts, and drafts moving toward WG adoption. Makes this a living tool, not a one-shot analysis.
|
|
|
|
## Medium Effort
|
|
|
|
### 4. Interactive Embedding Map
|
|
Export Ollama embeddings as a 2D UMAP/t-SNE scatter plot (Plotly or Observable). Color by category, size by score. Most visually compelling artifact possible.
|
|
|
|
### 5. Draft Recommendation Engine
|
|
With 1,907 ideas and embeddings, build "if you're interested in X, these drafts are most relevant." Useful for IETF participants finding related work before submitting.
|
|
|
|
### 8. IETF Meeting Companion
|
|
Time around IETF 123 (July 2026). "Here are the AI/agent drafts being discussed, clustered by theme, with quality ratings." Extremely useful for attendees.
|
|
|
|
### 9. Expand Beyond AI/Agent
|
|
The pipeline (fetch > analyze > rate > embed > gap-find) is generic. Apply to other IETF topics: post-quantum crypto, MASQUE/proxying, IoT security. Each becomes a new landscape report.
|
|
|
|
### 11. Living Dashboard with RSS/Email Digest
|
|
Combine web UI with trend alerts. Weekly email: "3 new AI agent drafts this week, 1 gap partially filled, here's what changed." Newsletter-ify the analysis.
|