Skip to Content
Last modified by Robert Schaub on 2025/12/24 18:26
From version 1.1
edited by Robert Schaub
on 2025/12/24 11:54
Change comment: Imported from XAR
To version 3.2
edited by Robert Schaub
on 2025/12/24 18:26
Change comment: Update document after refactoring.

Summary

Details

Page properties
Parent
... ... @@ -1,1 +1,1 @@
1 -Test.FactHarbor.Roadmap.WebHome
1 +Test.FactHarbor V0\.9\.103.Roadmap.WebHome
Content
... ... @@ -4,7 +4,6 @@
4 4  
5 5  **Success Metric:** <10% hallucination rate, quality gates prevent low-confidence publications
6 6  
7 -
8 8  == 1. Overview ==
9 9  
10 10  POC1 validates that the core AKEL workflow (Article → Claims → Verdicts) can produce trustworthy fact-checking analyses automatically. This phase implements **2 critical quality gates** to prevent low-quality outputs from being published.
... ... @@ -41,7 +41,6 @@
41 41  * A/B testing
42 42  * Gates 2 & 3 (Evidence relevance, Scenario coherence)
43 43  
44 -
45 45  === Experimental Features (POC1) ===
46 46  
47 47  **Context-Aware Analysis** (Approach 1: Single-Pass Holistic)
... ... @@ -59,7 +59,7 @@
59 59  * Success criteria: ≥70% accuracy on misleading articles
60 60  * Marked as experimental - doesn't block POC1 success
61 61  
62 -**See:** [[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]] for complete analysis
60 +**See:** [[Article Verdict Problem>>FactHarbor.Specification.POC.Article-Verdict-Problem]] for complete analysis
63 63  
64 64  **Decision:**
65 65  * If ≥70% accuracy → ship in POC2
... ... @@ -70,7 +70,7 @@
70 70  
71 71  === 3.1 NFR11: Quality Assurance Framework (POC1 Lite Version) ===
72 72  
73 -**Importance:** CRITICAL - Core POC1 Requirement
71 +**Importance:** CRITICAL - Core POC1 Requirement
74 74  **Fulfills:** AI safety, credibility, prevents embarrassing failures
75 75  
76 76  **Specification:**
... ... @@ -102,7 +102,6 @@
102 102  
103 103  **Target:** 0% opinion statements processed as facts
104 104  
105 -
106 106  ==== Gate 4: Verdict Confidence Assessment ====
107 107  
108 108  **Purpose:** Only publish verdicts with sufficient evidence and confidence
... ... @@ -116,20 +116,20 @@
116 116  
117 117  **Confidence Tiers:**
118 118  {{code}}HIGH (80-100%):
119 - - ≥3 sources
120 - - ≥0.7 average quality
121 - - ≥80% agreement
122 -
116 + - ≥3 sources
117 + - ≥0.7 average quality
118 + - ≥80% agreement
119 +
123 123  MEDIUM (50-79%):
124 - - ≥2 sources
125 - - ≥0.6 average quality
126 - - ≥60% agreement
127 -
121 + - ≥2 sources
122 + - ≥0.6 average quality
123 + - ≥60% agreement
124 +
128 128  LOW (0-49%):
129 - - ≥2 sources BUT low quality/agreement
130 -
126 + - ≥2 sources BUT low quality/agreement
127 +
131 131  INSUFFICIENT:
132 - - <2 sources → DO NOT PUBLISH{{/code}}
129 + - <2 sources → DO NOT PUBLISH{{/code}}
133 133  
134 134  **POC1 Publication Rule:**
135 135  
... ... @@ -138,7 +138,6 @@
138 138  
139 139  **Target:** 0% verdicts published with <2 sources
140 140  
141 -
142 142  === 3.2 Modified FR7: Automated Verdicts (Enhanced) ===
143 143  
144 144  **Enhancement for POC1:**
... ... @@ -149,13 +149,13 @@
149 149  AKEL Workflow (POC1):
150 150  
151 151  1. Extract claims from article
152 - ↓
148 + ↓
153 153  2. [GATE 1] Validate each claim is fact-checkable
154 - ↓ (pass claims only)
150 + ↓ (pass claims only)
155 155  3. Generate verdicts for each claim
156 - ↓
152 + ↓
157 157  4. [GATE 4] Validate verdict has sufficient evidence
158 - ↓ (pass verdicts only)
154 + ↓ (pass verdicts only)
159 159  5. Display to user
160 160  
161 161  Failed claims/verdicts:
... ... @@ -180,23 +180,22 @@
180 180  
181 181  {{code}}
182 182  Analysis Summary:
183 - Total Claims Found: 5
184 - Verifiable Claims: 3
185 - Non-verifiable (Opinion): 1
186 - Non-verifiable (Prediction): 1
187 -
188 - Verdicts Generated: 3
189 - High Confidence: 1
190 - Medium Confidence: 2
191 - Insufficient Evidence: 0
192 -
193 - Evidence Sources: 12 total
194 - Average Source Quality: 0.73
195 -
196 - Quality Score: 8.5/10
179 + Total Claims Found: 5
180 + Verifiable Claims: 3
181 + Non-verifiable (Opinion): 1
182 + Non-verifiable (Prediction): 1
183 +
184 + Verdicts Generated: 3
185 + High Confidence: 1
186 + Medium Confidence: 2
187 + Insufficient Evidence: 0
188 +
189 + Evidence Sources: 12 total
190 + Average Source Quality: 0.73
191 +
192 + Quality Score: 8.5/10
197 197  {{/code}}
198 198  
199 -
200 200  == 4. Success Criteria ==
201 201  
202 202  POC1 is considered **SUCCESSFUL** if:
... ... @@ -239,7 +239,6 @@
239 239  
240 240  **Only proceed to POC2 if all success criteria met**
241 241  
242 -
243 243  == 6. Architecture Notes ==
244 244  
245 245  **POC1 Simplified Architecture:**
... ... @@ -246,8 +246,8 @@
246 246  
247 247  {{code}}
248 248  User Input → AKEL Processing → Quality Gates → Display
249 - (claim extraction (Gates 1 & 4)
250 - + verdicts)
243 + (claim extraction (Gates 1 & 4)
244 + + verdicts)
251 251  {{/code}}
252 252  
253 253  **vs. Full System (Future):**
... ... @@ -265,16 +265,15 @@
265 265  * 2 gates instead of 4
266 266  * No review queue
267 267  
268 -**See:** [[Architecture>>Test.FactHarbor pre10 V0\.9\.70.Specification.Architecture.WebHome]] for details
262 +**See:** [[Architecture>>FactHarbor pre10 V0\.9\.70.Specification.Architecture.WebHome]] for details
269 269  
270 -
271 271  == Related Pages ==
272 272  
273 -* [[Roadmap Overview>>Test.FactHarbor pre10 V0\.9\.70.Roadmap.WebHome]] - All phases
274 -* [[POC2 Requirements>>Test.FactHarbor pre10 V0\.9\.70.Roadmap.POC2.WebHome]] - Next phase
275 -* [[Requirements>>Test.FactHarbor pre10 V0\.9\.70.Specification.Requirements.WebHome]] - Full system requirements
276 -* [[Architecture>>Test.FactHarbor pre10 V0\.9\.70.Specification.Architecture.WebHome]] - System architecture
277 -* [[NFR11 Full Specification>>Test.FactHarbor.Specification.Requirements.WebHome#NFR11]] - Complete quality framework
266 +* [[Roadmap Overview>>FactHarbor pre10 V0\.9\.70.Roadmap.WebHome]] - All phases
267 +* [[POC2 Requirements>>FactHarbor pre10 V0\.9\.70.Roadmap.POC2.WebHome]] - Next phase
268 +* [[Requirements>>FactHarbor pre10 V0\.9\.70.Specification.Requirements.WebHome]] - Full system requirements
269 +* [[Architecture>>FactHarbor pre10 V0\.9\.70.Specification.Architecture.WebHome]] - System architecture
270 +* [[NFR11 Full Specification>>FactHarbor.Specification.Requirements.WebHome#NFR11]] - Complete quality framework
278 278  
279 -**Document Status:** ✅ POC1 Specification Complete - Ready for Implementation
272 +**Document Status:** ✅ POC1 Specification Complete - Ready for Implementation
280 280  **Version:** V0.9.70