Wiki source code of POC Specification
Version 3.2 by Robert Schaub on 2025/12/24 09:59
Show last authors
| author | version | line-number | content |
|---|---|---|---|
| 1 | = POC Specification = | ||
| 2 | |||
| 3 | **This section contains detailed specifications for FactHarbor POC phases.** | ||
| 4 | |||
| 5 | **Core Philosophy:** Prove the AKEL automation works before building production features. Each POC phase validates critical technical capabilities. | ||
| 6 | |||
| 7 | {{warning}} | ||
| 8 | **Critical Innovation in POC1 Context-Aware Analysis:** | ||
| 9 | |||
| 10 | POC1 tests whether AI can understand that an article's overall credibility is not simply the average of its individual claim verdicts. An article with mostly accurate facts can still be misleading if it draws unsupported conclusions. | ||
| 11 | |||
| 12 | See [[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]] for full discussion. | ||
| 13 | {{/warning}} | ||
| 14 | |||
| 15 | |||
| 16 | == POC Phase Navigation == | ||
| 17 | |||
| 18 | * **[[POC Requirements>>Test.FactHarbor.Specification.POC.Requirements]]** Complete POC1 & POC2 specification (v4.0) | ||
| 19 | * **[[POC Summary>>Test.FactHarbor.Specification.POC.Summary]]** Executive overview | ||
| 20 | * **[[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]]** Why context-aware analysis matters | ||
| 21 | |||
| 22 | == Roadmap Navigation == | ||
| 23 | |||
| 24 | * **[[POC1 Roadmap>>Test.FactHarbor V0\.9\.100 incremental.Roadmap.POC1.WebHome]]** Core Workflow with Quality Gates | ||
| 25 | * **[[POC2 Roadmap>>Test.FactHarbor.Roadmap.POC2.WebHome]]** Robust Quality & Reliability | ||
| 26 | * **[[Requirements Roadmap Matrix>>Test.FactHarbor.Roadmap.Requirements-Roadmap-Matrix.WebHome]]** Phase assignments | ||
| 27 | |||
| 28 | == Key Specifications == | ||
| 29 | |||
| 30 | **POC1 Goal:** Prove AI can extract claims and evaluate them with context-aware analysis | ||
| 31 | |||
| 32 | **POC1 Output:** 5 components | ||
| 33 | |||
| 34 | 1. Analysis Summary (context-aware, 4-6 sentences) | ||
| 35 | 2. Claims Identification (3-5 claims) | ||
| 36 | 3. Claims Verdicts (verdict + confidence + reasoning) | ||
| 37 | 4. Article Summary (optional) | ||
| 38 | 5. Usage Statistics (cost tracking) | ||
| 39 | |||
| 40 | **POC1 Philosophy:** | ||
| 41 | |||
| 42 | * Context-aware analysis (article ≠ sum of claims) | ||
| 43 | * Cost efficiency tracking (viable at scale) | ||
| 44 | * Fail-fast learning (test critical capabilities) | ||
| 45 | |||
| 46 | **POC1 Success Criteria:** | ||
| 47 | |||
| 48 | * AI quality ≥70% (including context-aware assessment) | ||
| 49 | * Cost per analysis <$0.05 (target) | ||
| 50 | * Minimal manual editing (<30%) | ||
| 51 | |||
| 52 | **POC1 → POC2 Decision Gate:** GO / NO-GO / ITERATE | ||
| 53 | |||
| 54 | See [[POC Requirements>>Test.FactHarbor.Specification.POC.Requirements]] for complete specification. | ||
| 55 | |||
| 56 | |||
| 57 | == POC vs. Full System == | ||
| 58 | |||
| 59 | |= Feature |= POC1 |= POC2 |= Full System | ||
| 60 | | Scenarios | ❌ Deferred | ✅ Multiple | ✅ + Persistence | ||
| 61 | | Evidence Display | ❌ None | ✅ With sources | ✅ + Quality scoring | ||
| 62 | | Quality Gates | 🟡 4 simplified | ✅ 6 comprehensive | ✅ + ML validation | ||
| 63 | | Database | ❌ Stateless | ✅ PostgreSQL | ✅ + Redis + S3 | ||
| 64 | | User Contributions | ❌ Read-only | ✅ Enabled | ✅ + Reputation | ||
| 65 | |||
| 66 | **Development Time:** | ||
| 67 | |||
| 68 | * POC1: 2-4 weeks | ||
| 69 | * POC2: 6-8 weeks (additional) | ||
| 70 | * Beta: 4-6 months (additional) |