Wiki source code of POC (Proof of Concept)
Version 1.1 by Robert Schaub on 2025/12/19 16:13
Hide last authors
| author | version | line-number | content |
|---|---|---|---|
 |
1.1 | 1 | = POC (Proof of Concept) = |
| 2 | |||
| 3 | **Status:** ✅ Planning Complete - Ready for Development | ||
| 4 | **Version:** 1.0 | ||
| 5 | **Goal:** Prove that AI can extract claims and determine verdicts automatically without human intervention | ||
| 6 | |||
| 7 | --- | ||
| 8 | |||
| 9 | == Overview == | ||
| 10 | |||
| 11 | POC1 tests the core FactHarbor capability: Can AI automatically extract factual claims from articles and evaluate them with reasonable verdicts? | ||
| 12 | |||
| 13 | **What POC Tests:** | ||
| 14 | * AI claim extraction from article text | ||
| 15 | * AI verdict generation with confidence scores | ||
| 16 | * Fully automated approach viability (no human editing) | ||
| 17 | * Output comprehensibility to users | ||
| 18 | |||
| 19 | **What POC Excludes (Intentional Simplifications):** | ||
| 20 | * Scenarios (deferred to POC2 - architectural questions remain) | ||
| 21 | * Evidence display (deferred) | ||
| 22 | * Production infrastructure (simplified single-call architecture) | ||
| 23 | * Full data model (stateless POC) | ||
| 24 | |||
| 25 | **Key Decision:** Test AI capability first, add architectural complexity in POC2 based on learnings. | ||
| 26 | |||
| 27 | --- | ||
| 28 | |||
| 29 | == POC Documentation == | ||
| 30 | |||
| 31 | **POC-Specific Pages:** | ||
| 32 | * [[Requirements>>FactHarbor.Specification.POC.Requirements]] - Complete POC specification (17 sections, 1,197 lines) | ||
| 33 | * [[Summary>>FactHarbor.Specification.POC.Summary]] - Executive overview and consolidated analysis | ||
| 34 | |||
| 35 | --- | ||
| 36 | |||
| 37 | == Related Specification Pages == | ||
| 38 | |||
| 39 | **Core Specification:** | ||
| 40 | * [[Requirements (Full System)>>FactHarbor.Specification.Requirements.WebHome]] - FR1-FR13, NFR1-NFR5 | ||
| 41 | * [[User Needs>>FactHarbor.Specification.Requirements.User Needs]] - UN-1 through UN-17 | ||
| 42 | * [[Gap Analysis>>FactHarbor.Specification.Requirements.GapAnalysis]] - Feature gaps, proposes FR14-FR43 | ||
| 43 | |||
| 44 | **Architecture & Design:** | ||
| 45 | * [[Architecture>>FactHarbor.Specification.Architecture.WebHome]] - System architecture and design | ||
| 46 | * [[AKEL>>FactHarbor.Specification.AI Knowledge Extraction Layer (AKEL).WebHome]] - AI subsystem | ||
| 47 | * [[Data Model>>FactHarbor.Specification.Data Model.WebHome]] - Database schema | ||
| 48 | * [[Workflows>>FactHarbor.Specification.Workflows.WebHome]] - Process workflows | ||
| 49 | |||
| 50 | --- | ||
| 51 | |||
| 52 | == Key POC Specifications == | ||
| 53 | |||
| 54 | **Output Components (4):** | ||
| 55 | 1. Analysis Summary (3-5 sentences) | ||
| 56 | 2. Claims Identification (3-5 claims) | ||
| 57 | 3. Claims Verdicts (verdict + confidence + risk tier + reasoning per claim) | ||
| 58 | 4. Article Summary (optional, 3-5 sentences) | ||
| 59 | |||
| 60 | **Publication Mode:** Mode 2 (AI-Generated, No Prior Human Review) | ||
| 61 | |||
| 62 | **Quality Gates:** 4 simplified gates (Source Quality, Contradiction Search, Uncertainty, Structural Integrity) | ||
| 63 | |||
| 64 | **Success Criteria:** ≥70% AI quality without manual editing | ||
| 65 | |||
| 66 | --- | ||
| 67 | |||
| 68 | == POC vs. Full System == | ||
| 69 | |||
| 70 | |=Aspect|=POC1|=Full System | ||
| 71 | |Scenarios|None (deferred to POC2)|Core component (Claims → Scenarios → Verdicts) | ||
| 72 | |Workflow|3 steps|6 phases with quality gates | ||
| 73 | |AKEL|Single API call|Multi-component orchestrated pipeline | ||
| 74 | |Data|Stateless (no DB)|PostgreSQL + Redis + S3 | ||
| 75 | |Architecture|Simplified proof-of-concept|Production architecture | ||
| 76 | |Requirements|FR-POC-1 to FR-POC-7|FR1-FR43 (full system) | ||
| 77 | |||
| 78 | **Gap Between POC and Beta:** Significant architectural expansion needed (scenarios, components, data model). | ||
| 79 | |||
| 80 | --- | ||
| 81 | |||
| 82 | == Decision Gate == | ||
| 83 | |||
| 84 | After POC testing complete, team makes one of three decisions: | ||
| 85 | |||
| 86 | **GO (Proceed to POC2):** AI quality ≥70%, approach validated | ||
| 87 | **NO-GO (Pivot or Stop):** AI quality < 60%, fundamental flaws identified | ||
| 88 | **ITERATE (Improve POC):** AI quality 60-70%, specific improvements needed | ||
| 89 | |||
| 90 | --- | ||
| 91 | |||
| 92 | **Next Steps:** | ||
| 93 | 1. Review [[Requirements>>FactHarbor.Specification.POC.Requirements]] for detailed specifications | ||
| 94 | 2. Review [[Gap Analysis>>FactHarbor.Specification.Requirements.GapAnalysis]] for feature priorities | ||
| 95 | 3. Begin POC development | ||
| 96 | 4. Test with diverse articles | ||
| 97 | 5. Make GO/NO-GO decision | ||
| 98 | |||
| 99 | **Document Version:** 2.0 (Updated after Specification Cross-Check) | ||
| 100 |