Changes for page POC Specification
Last modified by Robert Schaub on 2025/12/24 10:00
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -4,24 +4,66 @@ 4 4 5 5 **Core Philosophy:** Prove the AKEL automation works before building production features. Each POC phase validates critical technical capabilities. 6 6 7 +{{warning}} 8 +**Critical Innovation in POC1 - Context-Aware Analysis:** 7 7 10 +POC1 tests whether AI can understand that an article's overall credibility is not simply the average of its individual claim verdicts. An article with mostly accurate facts can still be misleading if it draws unsupported conclusions. 11 + 12 +See [[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]] for full discussion. 13 +{{/warning}} 14 + 15 + 8 8 == POC Phase Navigation == 9 9 10 -* **[[POC1 Requirements>>Test.FactHarbor.POC.POC1.WebHome]]** - Core Workflow with Quality Gates 11 -* **[[POC2 Requirements>>Test.FactHarbor.POC.POC2.WebHome]]** - Robust Quality & Evidence Deduplication 12 -* **[[Beta 0 Requirements>>Test.FactHarbor.POC.Beta0.WebHome]]** - User Testing & Production Readiness 13 -* **[[V1.0 Requirements>>Test.FactHarbor.POC.V10.WebHome]]** - Public Launch Requirements 18 +* **[[POC Requirements>>Test.FactHarbor.Specification.POC.Requirements]]** - Complete POC1 & POC2 specification (v4.0) 19 +* **[[POC Summary>>Test.FactHarbor.Specification.POC.Summary]]** - Executive overview 20 +* **[[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]]** - Why context-aware analysis matters 14 14 15 15 16 -== SpecificationDocuments==23 +== Roadmap Navigation == 17 17 18 -* [[POC R equirements>>FactHarbor.Specification.POC.Requirements]]19 -* [[POC Summary>>FactHarbor.Specification.POC.Summary]]20 -* [[ POC1 Specification(Detailed)>>FactHarbor.Specification.POC.Specification]]25 +* **[[POC1 Roadmap>>Test.FactHarbor.Roadmap.POC1.WebHome]]** - Core Workflow with Quality Gates 26 +* **[[POC2 Roadmap>>Test.FactHarbor.Roadmap.POC2.WebHome]]** - Robust Quality & Reliability 27 +* **[[Requirements Roadmap Matrix>>Test.FactHarbor.Roadmap.Requirements-Roadmap-Matrix.WebHome]]** - Phase assignments 21 21 22 22 23 -== Related==30 +== Key Specifications == 24 24 25 -* [[Roadmap>>FactHarbor.Roadmap.WebHome]] - Implementation roadmap and timeline 26 -* [[Requirements>>FactHarbor.Specification.Requirements.WebHome]] - System requirements 32 +**POC1 Goal:** Prove AI can extract claims and evaluate them with context-aware analysis 27 27 34 +**POC1 Output:** 5 components 35 +1. Analysis Summary (context-aware, 4-6 sentences) 36 +2. Claims Identification (3-5 claims) 37 +3. Claims Verdicts (verdict + confidence + reasoning) 38 +4. Article Summary (optional) 39 +5. Usage Statistics (cost tracking) 40 + 41 +**POC1 Philosophy:** 42 +* Context-aware analysis (article ≠ sum of claims) 43 +* Cost efficiency tracking (viable at scale) 44 +* Fail-fast learning (test critical capabilities) 45 + 46 +**POC1 Success Criteria:** 47 +* AI quality ≥70% (including context-aware assessment) 48 +* Cost per analysis <$0.05 (target) 49 +* Minimal manual editing (<30%) 50 + 51 +**POC1 → POC2 Decision Gate:** GO / NO-GO / ITERATE 52 + 53 +See [[POC Requirements>>Test.FactHarbor.Specification.POC.Requirements]] for complete specification. 54 + 55 + 56 +== POC vs. Full System == 57 + 58 +|= Feature |= POC1 |= POC2 |= Full System 59 +| Scenarios | ❌ Deferred | ✅ Multiple | ✅ + Persistence 60 +| Evidence Display | ❌ None | ✅ With sources | ✅ + Quality scoring 61 +| Quality Gates | 🟡 4 simplified | ✅ 6 comprehensive | ✅ + ML validation 62 +| Database | ❌ Stateless | ✅ PostgreSQL | ✅ + Redis + S3 63 +| User Contributions | ❌ Read-only | ✅ Enabled | ✅ + Reputation 64 + 65 +**Development Time:** 66 +* POC1: 2-4 weeks 67 +* POC2: 6-8 weeks (additional) 68 +* Beta: 4-6 months (additional) 69 +