Skip to Content
Last modified by Robert Schaub on 2025/12/24 10:00
From version 4.2
edited by Robert Schaub
on 2025/12/24 09:59
Change comment: Update document after refactoring.
To version 1.1
edited by Robert Schaub
on 2025/12/23 18:19
Change comment: Imported from XAR

Summary

Details

Page properties
Parent
... ... @@ -1,1 +1,0 @@
1 -Test.FactHarbor V0\.9\.100 incremental.Roadmap.WebHome
Content
... ... @@ -1,7 +1,7 @@
1 1  = Requirements Roadmap Matrix =
2 2  
3 3  **Last Updated:** 2025-12-23
4 -**Version:** 4.0 (COMPLETE)
4 +**Version:** 2.0
5 5  **Status:** Authoritative Source
6 6  
7 7  {{info}}
... ... @@ -14,170 +14,154 @@
14 14  All other documents reference this matrix rather than duplicating information.
15 15  {{/info}}
16 16  
17 +---
18 +
17 17  == Phase Definitions ==
18 18  
19 -|= Phase |= Goal |= Key Focus
20 -| **POC1** | Prove AI can analyze claims automatically | Core workflow + quality gates + context-aware analysis (experimental)
21 -| **POC2** | Improve reliability and robustness | Quality improvements, deduplication
22 -| **Beta 0** | User testing with limited audience | Production readiness, user features, security
23 -| **V1.0** | Public production launch | IFCN compliance, search visibility
24 -| **V1.1** | First major feature expansion | Advanced capabilities
25 -| **V1.5** | Media verification expansion | Image/video/audio verification, archive integration
26 -| **V2.0** | Advanced capabilities | Comprehensive toolset
21 +|= Phase |= Goal |= Timeline |= Key Focus
22 +| **POC1** | Prove AI can analyze claims automatically | Initial development | Core workflow + quality gates
23 +| **POC2** | Improve reliability and robustness | After POC1 validation | Quality improvements, deduplication
24 +| **Beta 0** | User testing with limited audience | Before public launch | Production readiness, user features
25 +| **V1.0** | Public production launch | Initial release | IFCN compliance, search visibility
26 +| **V1.1** | First major feature expansion | Post-launch | Advanced media verification
27 +| **V1.5** | Second feature expansion | Later phase | Education and collaboration
28 +| **V2.0** | Advanced capabilities | Future | Comprehensive toolset
27 27  
28 28  **Phase Philosophy:** Each phase builds on proven capabilities from previous phases. We validate AI quality before adding production features.
29 29  
32 +
33 +
30 30  == Requirement Categories ==
31 31  
32 -**This matrix covers ALL requirements from the baseline:**
36 +**This matrix covers two types of requirements:**
33 33  
34 -**1. Functional Requirements (24 total)**
35 -* **FR1-FR13**: Core workflow and POC requirements
36 -* **FR44-FR54**: Advanced features and future enhancements
37 -* **FR14-FR43**: Numbers reserved (not used)
38 +**1. Formal System Requirements (16 requirements)**
38 38  
39 -**2. Non-Functional Requirements (8 total)**
40 -* **NFR1-NFR5**: Basic quality attributes (Performance, Scalability, Transparency, Security & Privacy, Maintainability)
41 -* **NFR11-NFR13**: Formal quality, security, and metrics requirements
40 +These are the primary requirements with full specifications in the [[Requirements>>Test.FactHarbor.Specification.Requirements.WebHome]] page:
41 +* **FR4, FR7** - Core claim analysis capabilities
42 +* **FR44-FR54** - Advanced features and future enhancements
43 +* **NFR11-NFR13** - Quality, security, and metrics
42 42  
43 -**3. User Needs (20 total)**
44 -* **UN-1 to UN-28**: User requirements (with some gaps in numbering)
45 +**2. POC-Specific Requirements (referenced for completeness)**
45 45  
46 -{{warning}}
47 -**Future Requirement Numbering:** To avoid conflicts with existing requirements, new requirements will use:
48 -* **FR55-FR84** for future functional requirements
49 -* **NFR14-NFR18** for future non-functional requirements
50 -* **UN-29 to UN-36** for future user needs
47 +These are detailed in [[POC Requirements>>Test.FactHarbor.Specification.POC.Requirements]] for POC1 implementation but do not have separate formal specification sections:
48 +* **FR1-FR2, FR5-FR6, FR11, FR13** - POC workflow requirements that map to formal requirements (e.g., FR1-FR2, FR5-FR6 → FR7, FR11 → NFR11)
49 +* **NFR1-NFR3** - Basic quality attributes partially addressed in POC1
51 51  
52 -See [[Gap Analysis>>Test.FactHarbor.Specification.Requirements.GapAnalysis]] for features not yet assigned formal requirement numbers.
53 -{{/warning}}
51 +**Mapping:** POC-specific requirements are implementation-level details of formal requirements. For example:
52 +* FR1 (Claim Extraction), FR2 (Context), FR3 (Scenarios), FR5 (Evidence Collection), FR6 (Source Quality) → All part of **FR7 (Automated Verdicts)**
53 +* FR11 (Audit Trail) → Part of **NFR11 (Quality Assurance)**
54 +* NFR1-NFR3 (Explainability, Performance, Transparency) → Addressed in **NFR11 and NFR13**
54 54  
56 +{{info}}
57 +**For phase planning:** Use the formal requirements (FR4, FR7, FR44-FR54, NFR11-NFR13) as the primary planning units. POC-specific requirements are implementation details within those formal requirements.
58 +{{/info}}
59 +
60 +---
61 +
55 55  == Requirements by Phase ==
56 56  
57 -**Note:** Requirements organized by phase, with Formal requirements listed first, followed by POC-specific implementation details.
64 +**Note:** Requirements are organized by release and sorted by Urgency (HIGH → MEDIUM → LOW), then Importance (CRITICAL → HIGH → MEDIUM → LOW).
58 58  
66 +{{info}}
67 +**Formal vs POC-Specific:** 16 requirements have formal Importance/Urgency prioritization (FR4, FR7, FR44-FR54, NFR11-NFR13). POC-specific requirements (FR1-FR2, FR5-FR6, FR11, FR13, NFR1-NFR3) are implementation details within formal requirements and marked as "(POC-specific)".
68 +{{/info}}
69 +
70 +---
71 +
59 59  === POC1 ===
60 60  
61 61  **Goal:** Prove that AI can extract claims and determine verdicts automatically
62 62  
63 -**Experimental Feature:** Context-aware analysis (tests if article credibility differs from claim average)
76 +**Requirements:** 1 formal + 7 POC-specific
64 64  
65 -**Requirements:** 2 formal + 9 POC-specific
66 -
67 -==== Formal Requirements ====
68 -
69 69  |= ID |= Title |= Importance |= Urgency |= Notes
70 70  | **FR7** | Automated Verdicts (Enhanced with Quality Gates) | CRITICAL | HIGH | Core AKEL capability - system cannot function without automated verdict generation
71 -| **FR4** | Analysis Summary (Enhanced with Context-Aware Analysis) | HIGH | HIGH | Enhanced in POC1 to test context-aware analysis (experimental feature). If successful (≥70% accuracy), ships in POC2. See [[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]]
80 +| **FR1** | Claim Extraction | (POC-specific) | (POC-specific) |
81 +| **FR2** | Claim Context | (POC-specific) | (POC-specific) |
82 +| **FR5** | Evidence Collection | (POC-specific) | (POC-specific) |
83 +| **FR6** | Source Quality Assessment | (POC-specific) | (POC-specific) |
84 +| **NFR1** | Explainability | (POC-specific) | (POC-specific) |
85 +| **NFR2** | Performance | (POC-specific) | (POC-specific) |
86 +| **NFR3** | Transparency | (POC-specific) | (POC-specific) |
72 72  
73 -==== POC-Specific Requirements ====
74 74  
75 -|= ID |= Title |= Notes
76 -| **FR1** | Claim Intake | Part of FR7 implementation
77 -| **FR2** | Claim Normalization | Part of FR7 implementation
78 -| **FR3** | Claim Classification | Part of FR7 implementation
79 -| **FR5** | Evidence Linking | Part of FR7 implementation
80 -| **FR6** | Scenario Comparison | Part of FR7 implementation
81 -| **FR12** | Two-Panel Summary View (Article Summary with FactHarbor Analysis Summary) | Part of FR4 implementation
82 -| **NFR1** | Performance | Basic implementation
83 -| **NFR2** | Scalability | Basic implementation
84 -| **NFR3** | Transparency | Basic implementation
85 -
86 -**Context-Aware Analysis Details:**
87 -* **Approach:** Single-Pass Holistic Analysis (Approach 1)
88 -* **Implementation:** Enhanced AI prompt to evaluate logical structure
89 -* **Testing:** 30-article test set (10 straightforward, 10 misleading, 10 complex)
90 -* **Success Criteria:** ≥70% accuracy detecting misleading articles
91 -* **Decision Path:** If ≥70% → ship in POC2; if 50-70% → try weighted aggregation; if <50% → defer
92 -* **Cost:** Zero increase (no additional API calls, no architecture changes)
93 -* **Documentation:** [[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]]
94 -
95 95  === POC2 ===
96 96  
97 97  **Goal:** Improve system reliability and add essential quality features
98 98  
99 -**Requirements:** 2 formal
93 +**Requirements:** 3 formal
100 100  
101 101  |= ID |= Title |= Importance |= Urgency |= Notes
102 -| **NFR11** | AKEL Quality Assurance Framework | CRITICAL | HIGH | Without quality gates, automated analysis cannot be trusted. POC1 implements 2 gates (Gates 1 & 4), POC2 implements all gates
96 +| **NFR11** | AKEL Quality Assurance Framework | CRITICAL | HIGH | Without quality gates, automated analysis cannot be trusted
97 +| **FR4** | Analysis Summary (Enhanced with Quality Metadata) | HIGH | HIGH | Essential for users to understand and trust verdicts
103 103  | **FR54** | Evidence Deduplication | CRITICAL | LOW | Essential for data integrity and preventing duplicate processing
104 104  
100 +
105 105  === Beta 0 ===
106 106  
107 107  **Goal:** Prepare for public launch with essential user-facing features and security
108 108  
109 -**Requirements:** 2 formal + 6 POC-specific
105 +**Requirements:** 2 formal + 2 POC-specific
110 110  
111 -==== Formal Requirements ====
112 -
113 113  |= ID |= Title |= Importance |= Urgency |= Notes
114 -| **NFR12** | Security Controls | CRITICAL | MEDIUM | Essential for production deployment (moved from V1.0 to Beta 0 for earlier security hardening)
115 115  | **NFR13** | Quality Metrics Transparency | HIGH | MEDIUM | Users need to understand quality levels
109 +| **FR47** | Archive.org Integration | MEDIUM | MEDIUM |
110 +| **FR11** | Audit Trail | (POC-specific) | (POC-specific) |
111 +| **FR13** | In-Article Claim Highlighting | (POC-specific) | (POC-specific) |
116 116  
117 -==== POC-Specific Requirements ====
118 118  
119 -|= ID |= Title |= Notes
120 -| **FR9** | Publication Workflow | Production-ready publishing system
121 -| **FR10** | Moderation | Moderation tools and processes
122 -| **FR11** | Audit Trail | Production-ready audit logging
123 -| **FR13** | In-Article Claim Highlighting | User-facing feature for article analysis
124 -| **NFR4** | Security & Privacy | Basic security and privacy controls
125 -| **NFR5** | Maintainability | Code quality and maintainability standards
126 -
127 127  === V1.0 ===
128 128  
129 129  **Goal:** Full production launch with IFCN compliance and search engine visibility
130 130  
131 -**Requirements:** 4 formal
118 +**Requirements:** 6 formal
132 132  
133 133  |= ID |= Title |= Importance |= Urgency |= Notes
134 -| **FR44** | ClaimReview Schema Implementation | HIGH | MEDIUM | Required for search engine discoverability (Google/Bing fact-check visibility)
135 -| **FR45** | User Corrections Notification System | HIGH | MEDIUM | Critical for user trust and transparency, IFCN compliance
121 +| **NFR12** | Security Controls | CRITICAL | MEDIUM | Essential for production deployment
122 +| **FR44** | ClaimReview Schema Implementation | HIGH | MEDIUM | Required for search engine discoverability
123 +| **FR45** | User Corrections Notification System | HIGH | MEDIUM | Critical for user trust and transparency
136 136  | **FR48** | Contributor Safety Framework | HIGH | MEDIUM | Protects contributors from harassment
137 -| **FR49** | A/B Testing Framework | MEDIUM | MEDIUM | Enables continuous system improvement through experimentation
125 +| **FR46** | Image Verification System | MEDIUM | MEDIUM |
126 +| **FR49** | A/B Testing Framework | MEDIUM | MEDIUM |
138 138  
128 +
139 139  === V1.1 ===
140 140  
141 -**Goal:** Add advanced capabilities
131 +**Goal:** Add advanced media verification capabilities
142 142  
143 143  **Requirements:** 2 formal
144 144  
145 145  |= ID |= Title |= Importance |= Urgency |= Notes
146 -| **FR50** | OSINT Toolkit Integration | HIGH | LOW | Valuable capability (geolocation, chronolocation, social media analysis)
147 -| **FR52** | Interactive Detection Training | MEDIUM | LOW | Education and media literacy features
136 +| **FR50** | OSINT Toolkit Integration | HIGH | LOW | Valuable capability for future phases (geolocation, chronolocation, social media analysis)
137 +| **FR51** | Video Verification System | HIGH | LOW | Valuable capability for future phases (deepfake detection, frame analysis)
148 148  
139 +
149 149  === V1.5 ===
150 150  
151 -**Goal:** Media verification expansion (image, video, audio)
142 +**Goal:** Education and cross-organizational collaboration
152 152  
153 -**Requirements:** 4 formal
144 +**Requirements:** 2 formal
154 154  
155 155  |= ID |= Title |= Importance |= Urgency |= Notes
156 -| **FR46** | Image Verification System | HIGH | MEDIUM | Moved from V1.0 to V1.5 to focus V1.0 on core text-based fact-checking. Includes reverse image search, manipulation detection, EXIF analysis
157 -| **FR51** | Video Verification System | HIGH | LOW | Moved from V1.1 to V1.5. Includes keyframe extraction, deepfake detection, metadata analysis
158 -| **FR47** | Archive.org Integration | MEDIUM | MEDIUM | Moved from Beta 0 to V1.5. Ensures evidence persistence even if original sources deleted
159 -| **FR53** | Cross-Organizational Sharing | MEDIUM | LOW | Collaboration with other fact-checkers (IFCN/EFCSN members)
147 +| **FR52** | Interactive Detection Training | MEDIUM | LOW |
148 +| **FR53** | Cross-Organizational Sharing | MEDIUM | LOW |
160 160  
161 -=== Deferred (Not in V1.5) ===
162 162  
163 -**Requirements deferred beyond V1.5:**
164 -
165 -|= ID |= Title |= Notes
166 -| **FR8** | Time Evolution | Version history for claims and verdicts. Deferred - basic edit history only in V1.0
167 -
168 168  == Requirements Summary by Phase ==
169 169  
170 -|= Phase |= Formal Requirements |= POC-Specific |= Total |= Cumulative
171 -| **POC1** | 2 (FR4, FR7) | 9 | 11 | 11
172 -| **POC2** | 2 (FR54, NFR11) | 0 | 2 | 13
173 -| **Beta 0** | 2 (NFR12, NFR13) | 6 | 8 | 21
174 -| **V1.0** | 4 (FR44, FR45, FR48, FR49) | 0 | 4 | 25
175 -| **V1.1** | 2 (FR50, FR52) | 0 | 2 | 27
176 -| **V1.5** | 4 (FR46, FR47, FR51, FR53) | 0 | 4 | 31
177 -| **Deferred** | 0 | 1 (FR8) | 1 | 32
153 +|= Phase |= New Requirements |= Enhancements |= Total Implemented |= Cumulative Total
154 +| **POC1** | 11 (8 full + 3 partial) | 0 | 11 | 11
155 +| **POC2** | 4 | 1 (FR4) | 5 | 16
156 +| **Beta 0** | 6 | 1 (NFR13) | 7 | 23
157 +| **V1.0** | 3 | 3 (FR45, FR46, NFR12) | 6 | 29
158 +| **V1.1** | 2 | 0 | 2 | 31
159 +| **V1.5** | 2 | 0 | 2 | 33
178 178  
179 -**Total Requirements:** 32 (24 FR + 8 NFR)
161 +**Total Unique Requirements:** 17 (FR1-FR8, FR11, FR13, FR44-FR54, NFR1-NFR3, NFR11-NFR13)
180 180  
163 +---
164 +
181 181  == User Needs by Phase ==
182 182  
183 183  **Summary of when each User Need is fulfilled:**
... ... @@ -185,7 +185,7 @@
185 185  |= User Need |= Title |= Fulfilled in Phase |= Via Requirements
186 186  | **UN-1** | Trust Assessment at a Glance | POC1 | FR7, NFR13
187 187  | **UN-2** | Claim Extraction and Verification | POC1 | FR7
188 -| **UN-3** | Article Summary with FactHarbor Analysis Summary | POC1 | FR4 (enhanced with context-aware analysis), FR12
172 +| **UN-3** | Article Summary with FactHarbor Analysis Summary | POC1 | FR4
189 189  | **UN-4** | Social Media Fact-Checking | POC1 | FR7
190 190  | **UN-5** | Source Provenance and Track Records | POC1 | FR4, FR6
191 191  | **UN-6** | Publisher Reliability History | POC1 | FR4, FR6
... ... @@ -194,77 +194,29 @@
194 194  | **UN-9** | Methodology Transparency | POC1 | NFR13
195 195  | **UN-10** | Manipulation Tactics Detection | V1.5 | FR52
196 196  | **UN-11** | Filtered Research | POC2 | FR54
197 -| **UN-12** | Submit Unchecked Claims | POC1 | FR7, FR1
181 +| **UN-12** | Submit Unchecked Claims | POC1 | FR7
198 198  | **UN-13** | Cite FactHarbor Verdicts | Beta 0 | FR13, FR44
199 199  | **UN-14** | API Access for Integration | V1.0 | Production API infrastructure
200 -| **UN-15** | Verdict Evolution Timeline | Deferred (Not in V1.0) | FR8 - Edit history only
184 +| **UN-15** | Verdict Evolution Timeline | Deferred (Not in V1.0) | Edit history only
201 201  | **UN-16** | AI vs. Human Review Status | POC1 | NFR13
202 202  | **UN-17** | In-Article Claim Highlighting | Beta 0 | FR13
203 203  | **UN-26** | Search Engine Visibility | V1.0 | FR44
204 -| **UN-27** | Visual Claim Verification | V1.5 (images), V1.5 (video) | FR46, FR51
188 +| **UN-27** | Visual Claim Verification | Beta 0 (basic), V1.0 (extended), V1.1 (video) | FR46, FR51
205 205  | **UN-28** | Safe Contribution Environment | V1.0 | FR48
206 206  
207 -**Total User Needs:** 20 (UN-1 to UN-28, with gaps)
191 +**Total User Needs:** 20
208 208  
209 -**Note:** UN-29 to UN-36 reserved for future user needs from Gap Analysis
193 +---
194 +== Requirements Without Phase Assignments ==
210 210  
211 -== All Requirements List ==
196 +{{warning}}
197 +If any requirements appear here, they need phase assignment.
198 +{{/warning}}
212 212  
213 -**For reference, complete list of all requirements:**
200 +**Current Status:** All 17 requirements have phase assignments ✅
214 214  
215 -**Functional Requirements (24):**
216 -* POC1: FR1, FR2, FR3, FR4, FR5, FR6, FR7, FR12
217 -* POC2: FR54
218 -* Beta 0: FR9, FR10, FR11, FR13
219 -* V1.0: FR44, FR45, FR48, FR49
220 -* V1.1: FR50, FR52
221 -* V1.5: FR46, FR47, FR51, FR53
222 -* Deferred: FR8
202 +---
223 223  
224 -**Non-Functional Requirements (8):**
225 -* POC1: NFR1, NFR2, NFR3
226 -* POC2: NFR11
227 -* Beta 0: NFR4, NFR5, NFR12, NFR13
228 -
229 -**User Needs (20):**
230 -UN-1, UN-2, UN-3, UN-4, UN-5, UN-6, UN-7, UN-8, UN-9, UN-10, UN-11, UN-12, UN-13, UN-14, UN-15, UN-16, UN-17, UN-26, UN-27, UN-28
231 -
232 -== Key Changes in V4.0 (COMPLETE) ==
233 -
234 -**This version is COMPLETE and includes ALL requirements from baseline:**
235 -
236 -1. **All 32 Requirements Now Included**
237 - - **Added:** FR3, FR8, FR9, FR10, FR12, NFR4, NFR5 (were missing in V3.0)
238 - - **Total:** 24 FR + 8 NFR = 32 requirements
239 -
240 -2. **Context-Aware Analysis in POC1**
241 - - FR4 enhanced to test context-aware analysis (experimental)
242 - - See [[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]]
243 -
244 -3. **Media Verification in V1.5**
245 - - FR46 (Image), FR51 (Video), FR47 (Archive.org)
246 - - Consolidated in V1.5 release
247 -
248 -4. **Security Earlier (Beta 0)**
249 - - NFR12 moved from V1.0 to Beta 0
250 - - NFR4 (Security & Privacy) also in Beta 0
251 -
252 -5. **Future Numbering Reserved**
253 - - FR55-FR84, NFR14-NFR18, UN-29 to UN-36
254 -
255 -== Gap Analysis Features (Not Yet Formal Requirements) ==
256 -
257 -The following features from [[Gap Analysis>>Test.FactHarbor.Specification.Requirements.GapAnalysis]] are not yet assigned formal requirement numbers but would use FR55+, NFR14+, UN-29+ when formalized:
258 -
259 -**15 gap features across 7 categories:**
260 -* Accessibility (2): WCAG compliance, Multilingual support
261 -* Platform Integration (2): Browser extensions, Embeddable widgets
262 -* Media Verification (3): Image/Video (FR46/FR51), Audio (not yet formalized)
263 -* Mobile & Offline (2): Mobile apps/PWA, Offline access
264 -* Education (2): Educational resources, Media literacy
265 -* Collaboration (2): Professional tools, Community discussion
266 -* Advanced Features (2): User analytics, Personalization
267 -
268 268  == References ==
269 269  
270 270  **This matrix is referenced by:**
... ... @@ -271,15 +271,16 @@
271 271  * [[Requirements>>Test.FactHarbor.Specification.Requirements.WebHome]] - Main requirements specification
272 272  * [[POC Requirements>>Test.FactHarbor.Specification.POC.Requirements]] - POC1 & POC2 detailed specifications
273 273  * [[Implementation Roadmap>>Test.FactHarbor.Roadmap.WebHome]] - High-level phase descriptions
274 -* [[Gap Analysis>>Test.FactHarbor.Specification.Requirements.GapAnalysis]] - Features not yet in V1.5
275 -* [[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]] - Context-aware analysis solution
276 276  
277 277  **Maintenance:**
278 278  * Update this matrix when adding new requirements
279 279  * Update this matrix when changing phase assignments or importance/urgency
280 280  * Verify other documents still reference correctly after updates
281 -* Use FR55+, NFR14+, UN-29+ for new requirements
282 282  
283 -**Last Review:** 2025-12-23 (V4.0 - COMPLETE)
216 +**Note:** This matrix consolidates information previously in separate "Requirements importance Matrix" page. All importance and urgency prioritization is now maintained here.
217 +
218 +---
219 +
220 +**Last Review:** 2025-12-23
284 284  **Next Review:** After POC1 completion or when adding new requirements
285 285