Skip to Content
Last modified by Robert Schaub on 2025/12/24 10:00
From version 1.1
edited by Robert Schaub
on 2025/12/23 18:19
Change comment: Imported from XAR
To version 2.1
edited by Robert Schaub
on 2025/12/23 22:41
Change comment: Imported from XAR

Summary

Details

Page properties
Content
... ... @@ -1,7 +1,7 @@
1 1  = Requirements Roadmap Matrix =
2 2  
3 3  **Last Updated:** 2025-12-23
4 -**Version:** 2.0
4 +**Version:** 3.0
5 5  **Status:** Authoritative Source
6 6  
7 7  {{info}}
... ... @@ -14,39 +14,30 @@
14 14  All other documents reference this matrix rather than duplicating information.
15 15  {{/info}}
16 16  
17 ----
18 -
19 19  == Phase Definitions ==
20 20  
21 -|= Phase |= Goal |= Timeline |= Key Focus
22 -| **POC1** | Prove AI can analyze claims automatically | Initial development | Core workflow + quality gates
23 -| **POC2** | Improve reliability and robustness | After POC1 validation | Quality improvements, deduplication
24 -| **Beta 0** | User testing with limited audience | Before public launch | Production readiness, user features
25 -| **V1.0** | Public production launch | Initial release | IFCN compliance, search visibility
26 -| **V1.1** | First major feature expansion | Post-launch | Advanced media verification
27 -| **V1.5** | Second feature expansion | Later phase | Education and collaboration
28 -| **V2.0** | Advanced capabilities | Future | Comprehensive toolset
19 +|= Phase |= Goal |= Key Focus
20 +| **POC1** | Prove AI can analyze claims automatically | Core workflow + quality gates + context-aware analysis (experimental)
21 +| **POC2** | Improve reliability and robustness | Quality improvements, deduplication
22 +| **Beta 0** | User testing with limited audience | Production readiness, user features
23 +| **V1.0** | Public production launch | IFCN compliance, search visibility
24 +| **V1.1** | First major feature expansion | Advanced capabilities
25 +| **V1.5** | Media verification expansion | Image/video/audio verification, archive integration
26 +| **V2.0** | Advanced capabilities | Comprehensive toolset
29 29  
30 30  **Phase Philosophy:** Each phase builds on proven capabilities from previous phases. We validate AI quality before adding production features.
31 31  
32 -
33 -
34 34  == Requirement Categories ==
35 35  
36 36  **This matrix covers two types of requirements:**
37 37  
38 -**1. Formal System Requirements (16 requirements)**
34 +**1. Formal System Requirements (16 requirements: FR4, FR7, FR44-FR54, NFR11-NFR13)**
39 39  
40 -These are the primary requirements with full specifications in the [[Requirements>>Test.FactHarbor.Specification.Requirements.WebHome]] page:
41 -* **FR4, FR7** - Core claim analysis capabilities
42 -* **FR44-FR54** - Advanced features and future enhancements
43 -* **NFR11-NFR13** - Quality, security, and metrics
36 +These are the primary requirements with full specifications in the [[Requirements>>Test.FactHarbor.Specification.Requirements.WebHome]] page.
44 44  
45 -**2. POC-Specific Requirements (referenced for completeness)**
38 +**2. POC-Specific Requirements (FR1-FR2, FR5-FR6, FR11, FR13, NFR1-NFR3)**
46 46  
47 -These are detailed in [[POC Requirements>>Test.FactHarbor.Specification.POC.Requirements]] for POC1 implementation but do not have separate formal specification sections:
48 -* **FR1-FR2, FR5-FR6, FR11, FR13** - POC workflow requirements that map to formal requirements (e.g., FR1-FR2, FR5-FR6 → FR7, FR11 → NFR11)
49 -* **NFR1-NFR3** - Basic quality attributes partially addressed in POC1
40 +These are detailed in [[POC Requirements>>Test.FactHarbor.Specification.POC.Requirements]] for POC1 implementation but do not have separate formal specification sections.
50 50  
51 51  **Mapping:** POC-specific requirements are implementation-level details of formal requirements. For example:
52 52  * FR1 (Claim Extraction), FR2 (Context), FR3 (Scenarios), FR5 (Evidence Collection), FR6 (Source Quality) → All part of **FR7 (Automated Verdicts)**
... ... @@ -57,8 +57,15 @@
57 57  **For phase planning:** Use the formal requirements (FR4, FR7, FR44-FR54, NFR11-NFR13) as the primary planning units. POC-specific requirements are implementation details within those formal requirements.
58 58  {{/info}}
59 59  
60 ----
51 +{{warning}}
52 +**Future Requirement Numbering:** To avoid conflicts with existing requirements (FR1-FR54, NFR1-NFR13, UN-1 to UN-28), new requirements will use:
53 +* **FR55-FR84** for future functional requirements
54 +* **NFR14-NFR18** for future non-functional requirements
55 +* **UN-29 to UN-36** for future user needs
61 61  
57 +See [[Gap Analysis>>Test.FactHarbor.Specification.Requirements.GapAnalysis]] for features not yet assigned formal requirement numbers.
58 +{{/warning}}
59 +
62 62  == Requirements by Phase ==
63 63  
64 64  **Note:** Requirements are organized by release and sorted by Urgency (HIGH → MEDIUM → LOW), then Importance (CRITICAL → HIGH → MEDIUM → LOW).
... ... @@ -67,24 +67,33 @@
67 67  **Formal vs POC-Specific:** 16 requirements have formal Importance/Urgency prioritization (FR4, FR7, FR44-FR54, NFR11-NFR13). POC-specific requirements (FR1-FR2, FR5-FR6, FR11, FR13, NFR1-NFR3) are implementation details within formal requirements and marked as "(POC-specific)".
68 68  {{/info}}
69 69  
70 ----
71 -
72 72  === POC1 ===
73 73  
74 74  **Goal:** Prove that AI can extract claims and determine verdicts automatically
75 75  
76 -**Requirements:** 1 formal + 7 POC-specific
72 +**Experimental Feature:** Context-aware analysis (tests if article credibility differs from claim average)
77 77  
74 +**Requirements:** 2 formal + 7 POC-specific
75 +
78 78  |= ID |= Title |= Importance |= Urgency |= Notes
79 79  | **FR7** | Automated Verdicts (Enhanced with Quality Gates) | CRITICAL | HIGH | Core AKEL capability - system cannot function without automated verdict generation
80 -| **FR1** | Claim Extraction | (POC-specific) | (POC-specific) |
81 -| **FR2** | Claim Context | (POC-specific) | (POC-specific) |
82 -| **FR5** | Evidence Collection | (POC-specific) | (POC-specific) |
83 -| **FR6** | Source Quality Assessment | (POC-specific) | (POC-specific) |
84 -| **NFR1** | Explainability | (POC-specific) | (POC-specific) |
85 -| **NFR2** | Performance | (POC-specific) | (POC-specific) |
86 -| **NFR3** | Transparency | (POC-specific) | (POC-specific) |
78 +| **FR4** | Analysis Summary (Enhanced with Context-Aware Analysis) | HIGH | HIGH | Enhanced in POC1 to test context-aware analysis (experimental feature). If successful (≥70% accuracy), ships in POC2. See [[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]]
79 +| **FR1** | Claim Extraction | (POC-specific) | (POC-specific) | Part of FR7 implementation
80 +| **FR2** | Claim Context | (POC-specific) | (POC-specific) | Part of FR7 implementation
81 +| **FR5** | Evidence Collection | (POC-specific) | (POC-specific) | Part of FR7 implementation
82 +| **FR6** | Source Quality Assessment | (POC-specific) | (POC-specific) | Part of FR7 implementation
83 +| **NFR1** | Explainability | (POC-specific) | (POC-specific) | Basic implementation
84 +| **NFR2** | Performance | (POC-specific) | (POC-specific) | Basic implementation
85 +| **NFR3** | Transparency | (POC-specific) | (POC-specific) | Basic implementation
87 87  
87 +**Context-Aware Analysis Details:**
88 +* **Approach:** Single-Pass Holistic Analysis (Approach 1)
89 +* **Implementation:** Enhanced AI prompt to evaluate logical structure
90 +* **Testing:** 30-article test set (10 straightforward, 10 misleading, 10 complex)
91 +* **Success Criteria:** ≥70% accuracy detecting misleading articles
92 +* **Decision Path:** If ≥70% → ship in POC2; if 50-70% → try weighted aggregation; if <50% → defer
93 +* **Cost:** Zero increase (no additional API calls, no architecture changes)
94 +* **Documentation:** [[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]]
88 88  
89 89  === POC2 ===
90 90  
... ... @@ -93,11 +93,10 @@
93 93  **Requirements:** 3 formal
94 94  
95 95  |= ID |= Title |= Importance |= Urgency |= Notes
96 -| **NFR11** | AKEL Quality Assurance Framework | CRITICAL | HIGH | Without quality gates, automated analysis cannot be trusted
97 -| **FR4** | Analysis Summary (Enhanced with Quality Metadata) | HIGH | HIGH | Essential for users to understand and trust verdicts
103 +| **NFR11** | AKEL Quality Assurance Framework | CRITICAL | HIGH | Without quality gates, automated analysis cannot be trusted. POC1 implements 2 gates (Gates 1 & 4), POC2 implements all gates
104 +| **FR4** | Analysis Summary (Enhanced with Quality Metadata) | HIGH | HIGH | Essential for users to understand and trust verdicts. Enhanced from POC1 with quality metadata display
98 98  | **FR54** | Evidence Deduplication | CRITICAL | LOW | Essential for data integrity and preventing duplicate processing
99 99  
100 -
101 101  === Beta 0 ===
102 102  
103 103  **Goal:** Prepare for public launch with essential user-facing features and security
... ... @@ -106,62 +106,56 @@
106 106  
107 107  |= ID |= Title |= Importance |= Urgency |= Notes
108 108  | **NFR13** | Quality Metrics Transparency | HIGH | MEDIUM | Users need to understand quality levels
109 -| **FR47** | Archive.org Integration | MEDIUM | MEDIUM |
110 -| **FR11** | Audit Trail | (POC-specific) | (POC-specific) |
111 -| **FR13** | In-Article Claim Highlighting | (POC-specific) | (POC-specific) |
115 +| **NFR12** | Security Controls | CRITICAL | MEDIUM | Essential for production deployment - moved from V1.0 to Beta 0 for earlier security hardening
116 +| **FR11** | Audit Trail | (POC-specific) | (POC-specific) | Production-ready audit logging
117 +| **FR13** | In-Article Claim Highlighting | (POC-specific) | (POC-specific) | User-facing feature for article analysis
112 112  
113 -
114 114  === V1.0 ===
115 115  
116 116  **Goal:** Full production launch with IFCN compliance and search engine visibility
117 117  
118 -**Requirements:** 6 formal
123 +**Requirements:** 4 formal
119 119  
120 120  |= ID |= Title |= Importance |= Urgency |= Notes
121 -| **NFR12** | Security Controls | CRITICAL | MEDIUM | Essential for production deployment
122 -| **FR44** | ClaimReview Schema Implementation | HIGH | MEDIUM | Required for search engine discoverability
123 -| **FR45** | User Corrections Notification System | HIGH | MEDIUM | Critical for user trust and transparency
126 +| **FR44** | ClaimReview Schema Implementation | HIGH | MEDIUM | Required for search engine discoverability (Google/Bing fact-check visibility)
127 +| **FR45** | User Corrections Notification System | HIGH | MEDIUM | Critical for user trust and transparency, IFCN compliance
124 124  | **FR48** | Contributor Safety Framework | HIGH | MEDIUM | Protects contributors from harassment
125 -| **FR46** | Image Verification System | MEDIUM | MEDIUM |
126 -| **FR49** | A/B Testing Framework | MEDIUM | MEDIUM |
129 +| **FR49** | A/B Testing Framework | MEDIUM | MEDIUM | Enables continuous system improvement through experimentation
127 127  
128 -
129 129  === V1.1 ===
130 130  
131 -**Goal:** Add advanced media verification capabilities
133 +**Goal:** Add advanced capabilities
132 132  
133 133  **Requirements:** 2 formal
134 134  
135 135  |= ID |= Title |= Importance |= Urgency |= Notes
136 -| **FR50** | OSINT Toolkit Integration | HIGH | LOW | Valuable capability for future phases (geolocation, chronolocation, social media analysis)
137 -| **FR51** | Video Verification System | HIGH | LOW | Valuable capability for future phases (deepfake detection, frame analysis)
138 +| **FR50** | OSINT Toolkit Integration | HIGH | LOW | Valuable capability (geolocation, chronolocation, social media analysis)
139 +| **FR52** | Interactive Detection Training | MEDIUM | LOW | Education and media literacy features
138 138  
139 -
140 140  === V1.5 ===
141 141  
142 -**Goal:** Education and cross-organizational collaboration
143 +**Goal:** Media verification expansion (image, video, audio)
143 143  
144 -**Requirements:** 2 formal
145 +**Requirements:** 4 formal
145 145  
146 146  |= ID |= Title |= Importance |= Urgency |= Notes
147 -| **FR52** | Interactive Detection Training | MEDIUM | LOW |
148 -| **FR53** | Cross-Organizational Sharing | MEDIUM | LOW |
148 +| **FR46** | Image Verification System | HIGH | MEDIUM | Moved from V1.0 to V1.5 to focus V1.0 on core text-based fact-checking. Includes reverse image search, manipulation detection, EXIF analysis
149 +| **FR51** | Video Verification System | HIGH | LOW | Moved from V1.1 to V1.5. Includes keyframe extraction, deepfake detection, metadata analysis
150 +| **FR47** | Archive.org Integration | MEDIUM | MEDIUM | Moved from Beta 0 to V1.5. Ensures evidence persistence even if original sources deleted
151 +| **FR53** | Cross-Organizational Sharing | MEDIUM | LOW | Collaboration with other fact-checkers (IFCN/EFCSN members)
149 149  
150 -
151 151  == Requirements Summary by Phase ==
152 152  
153 -|= Phase |= New Requirements |= Enhancements |= Total Implemented |= Cumulative Total
154 -| **POC1** | 11 (8 full + 3 partial) | 0 | 11 | 11
155 -| **POC2** | 4 | 1 (FR4) | 5 | 16
156 -| **Beta 0** | 6 | 1 (NFR13) | 7 | 23
157 -| **V1.0** | 3 | 3 (FR45, FR46, NFR12) | 6 | 29
158 -| **V1.1** | 2 | 0 | 2 | 31
159 -| **V1.5** | 2 | 0 | 2 | 33
155 +|= Phase |= Formal Requirements |= POC-Specific |= Total |= Cumulative
156 +| **POC1** | 2 (FR4, FR7) | 7 | 9 | 9
157 +| **POC2** | 3 (FR4 enhanced, FR54, NFR11) | 0 | 3 | 12
158 +| **Beta 0** | 2 (NFR12, NFR13) | 2 (FR11, FR13) | 4 | 16
159 +| **V1.0** | 4 (FR44, FR45, FR48, FR49) | 0 | 4 | 20
160 +| **V1.1** | 2 (FR50, FR52) | 0 | 2 | 22
161 +| **V1.5** | 4 (FR46, FR47, FR51, FR53) | 0 | 4 | 26
160 160  
161 -**Total Unique Requirements:** 17 (FR1-FR8, FR11, FR13, FR44-FR54, NFR1-NFR3, NFR11-NFR13)
163 +**Total Unique Requirements:** 17 formal + 9 POC-specific = 26 total
162 162  
163 ----
164 -
165 165  == User Needs by Phase ==
166 166  
167 167  **Summary of when each User Need is fulfilled:**
... ... @@ -169,7 +169,7 @@
169 169  |= User Need |= Title |= Fulfilled in Phase |= Via Requirements
170 170  | **UN-1** | Trust Assessment at a Glance | POC1 | FR7, NFR13
171 171  | **UN-2** | Claim Extraction and Verification | POC1 | FR7
172 -| **UN-3** | Article Summary with FactHarbor Analysis Summary | POC1 | FR4
172 +| **UN-3** | Article Summary with FactHarbor Analysis Summary | POC1 | FR4 (enhanced with context-aware analysis)
173 173  | **UN-4** | Social Media Fact-Checking | POC1 | FR7
174 174  | **UN-5** | Source Provenance and Track Records | POC1 | FR4, FR6
175 175  | **UN-6** | Publisher Reliability History | POC1 | FR4, FR6
... ... @@ -185,12 +185,40 @@
185 185  | **UN-16** | AI vs. Human Review Status | POC1 | NFR13
186 186  | **UN-17** | In-Article Claim Highlighting | Beta 0 | FR13
187 187  | **UN-26** | Search Engine Visibility | V1.0 | FR44
188 -| **UN-27** | Visual Claim Verification | Beta 0 (basic), V1.0 (extended), V1.1 (video) | FR46, FR51
188 +| **UN-27** | Visual Claim Verification | V1.5 (images), V1.5 (video) | FR46, FR51
189 189  | **UN-28** | Safe Contribution Environment | V1.0 | FR48
190 190  
191 -**Total User Needs:** 20
191 +**Total User Needs:** 20 (UN-1 to UN-28, with gaps)
192 192  
193 ----
193 +**Note:** UN-29 to UN-36 reserved for future user needs from Gap Analysis
194 +
195 +== Key Changes in V3.0 ==
196 +
197 +**This version includes important updates:**
198 +
199 +1. **Context-Aware Analysis Added to POC1**
200 + - FR4 enhanced to test context-aware analysis (experimental)
201 + - Tests if article credibility differs from simple claim average
202 + - Approach 1: Single-Pass Holistic Analysis
203 + - Success: ≥70% accuracy → ships in POC2
204 + - See [[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]]
205 +
206 +2. **Media Verification Moved to V1.5**
207 + - **FR46** (Image Verification): V1.0 → **V1.5**
208 + - **FR51** (Video Verification): V1.1 → **V1.5**
209 + - **FR47** (Archive.org Integration): Beta 0 → **V1.5**
210 + - **Rationale:** Focus V1.0 on core text-based fact-checking
211 +
212 +3. **Security Hardening Earlier**
213 + - **NFR12** (Security Controls): V1.0 → **Beta 0**
214 + - Ensures production security before public launch
215 +
216 +4. **Future Requirement Numbering Established**
217 + - FR55-FR84 reserved for future functional requirements
218 + - NFR14-NFR18 reserved for future non-functional requirements
219 + - UN-29 to UN-36 reserved for future user needs
220 + - Prevents conflicts with existing baseline (FR1-FR54, NFR1-NFR13, UN-1 to UN-28)
221 +
194 194  == Requirements Without Phase Assignments ==
195 195  
196 196  {{warning}}
... ... @@ -197,10 +197,43 @@
197 197  If any requirements appear here, they need phase assignment.
198 198  {{/warning}}
199 199  
200 -**Current Status:** All 17 requirements have phase assignments ✅
228 +**Current Status:** All 17 formal requirements have phase assignments ✅
201 201  
202 ----
230 +**Gap Analysis Features (Not Yet Formal Requirements):**
203 203  
232 +The following features from [[Gap Analysis>>Test.FactHarbor.Specification.Requirements.GapAnalysis]] are not yet assigned formal requirement numbers but would use FR55+, NFR14+, UN-29+ when formalized:
233 +
234 +**Category 1: Accessibility** (2 gaps)
235 +* WCAG 2.1 Compliance
236 +* Multilingual Support
237 +
238 +**Category 2: Platform Integration** (2 gaps)
239 +* Browser Extensions
240 +* Embeddable Widgets
241 +
242 +**Category 3: Media Verification** (3 gaps)
243 +* Image Verification (informal → FR46 in V1.5)
244 +* Video Verification (informal → FR51 in V1.5)
245 +* Audio Verification (not yet formalized)
246 +
247 +**Category 4: Mobile & Offline** (2 gaps)
248 +* Mobile Apps / PWA
249 +* Offline Access
250 +
251 +**Category 5: Education** (2 gaps)
252 +* Educational Resources
253 +* Media Literacy Integration
254 +
255 +**Category 6: Collaboration** (2 gaps)
256 +* Professional Collaboration Tools
257 +* Community Discussion
258 +
259 +**Category 7: Advanced Features** (2 gaps)
260 +* User Analytics
261 +* Personalization
262 +
263 +**Total:** 15 gap features not yet formalized as requirements
264 +
204 204  == References ==
205 205  
206 206  **This matrix is referenced by:**
... ... @@ -207,16 +207,15 @@
207 207  * [[Requirements>>Test.FactHarbor.Specification.Requirements.WebHome]] - Main requirements specification
208 208  * [[POC Requirements>>Test.FactHarbor.Specification.POC.Requirements]] - POC1 & POC2 detailed specifications
209 209  * [[Implementation Roadmap>>Test.FactHarbor.Roadmap.WebHome]] - High-level phase descriptions
271 +* [[Gap Analysis>>Test.FactHarbor.Specification.Requirements.GapAnalysis]] - Features not yet in V1.0
272 +* [[Article Verdict Problem>>Test.FactHarbor.Specification.POC.Article-Verdict-Problem]] - Context-aware analysis solution
210 210  
211 211  **Maintenance:**
212 212  * Update this matrix when adding new requirements
213 213  * Update this matrix when changing phase assignments or importance/urgency
214 214  * Verify other documents still reference correctly after updates
278 +* Use FR55+, NFR14+, UN-29+ for new requirements
215 215  
216 -**Note:** This matrix consolidates information previously in separate "Requirements importance Matrix" page. All importance and urgency prioritization is now maintained here.
217 -
218 ----
219 -
220 -**Last Review:** 2025-12-23
280 +**Last Review:** 2025-12-23 (V3.0)
221 221  **Next Review:** After POC1 completion or when adding new requirements
222 222