Changes for page Requirements

Last modified by Robert Schaub on 2025/12/23 11:03

From version 1.1
edited by Robert Schaub
on 2025/12/22 19:12
Change comment: Imported from XAR
To version 4.1
edited by Robert Schaub
on 2025/12/22 20:32
Change comment: Imported from XAR

Summary

Details

Page properties
Content
... ... @@ -306,7 +306,7 @@
306 306  4. How common is this pattern?
307 307  5. Store in ErrorPattern table (improvement queue)
308 308  
309 -=== 6.2 Weekly Improvement Cycle ===
309 +=== 6.2 Continuous Improvement Cycle ===
310 310  
311 311  1. **Review**: Analyze top error patterns
312 312  2. **Develop**: Create fix (prompt, model, validation)
... ... @@ -326,7 +326,7 @@
326 326  * Re-work rate
327 327  * Claims processed per hour
328 328  
329 -**Goal**: 10% monthly improvement in error rate
329 +**Goal**: continuous improvement in error rate
330 330  
331 331  == 7. Automated Quality Monitoring ==
332 332  
... ... @@ -826,162 +826,8 @@
826 826  
827 827  **Milestone:** POC2 (internal), Beta 0 (public), V1.0 (real-time)
828 828  
829 -== 10. Requirements Priority Matrix ==
830 830  
831 -This table shows all functional and non-functional requirements ordered by urgency and priority.
832 832  
833 -**Note:** Implementation phases (POC1, POC2, Beta 0, V1.0) are defined in [[POC Requirements>>FactHarbor.Specification.POC.Requirements]] and [[Implementation Roadmap>>FactHarbor.Implementation-Roadmap.WebHome]], not in this priority matrix.
834 -
835 -**Priority Levels:**
836 -* **CRITICAL** - System doesn't work without it, or major safety/legal risk
837 -* **HIGH** - Core functionality, essential for success
838 -* **MEDIUM** - Important but not blocking
839 -* **LOW** - Nice to have, can be deferred
840 -
841 -**Urgency Levels:**
842 -* **HIGH** - Immediate need (critical for proof of concept)
843 -* **MEDIUM** - Important but not immediate
844 -* **LOW** - Future enhancement
845 -
846 -|= ID |= Title |= Priority |= Urgency
847 -| **HIGH URGENCY** |||
848 -| **FR1** | Claim Intake | CRITICAL | HIGH
849 -| **FR5** | Evidence Collection | CRITICAL | HIGH
850 -| **FR7** | Verdict Computation | CRITICAL | HIGH
851 -| **NFR11** | Quality Assurance Framework | CRITICAL | HIGH
852 -| **FR2** | Claim Normalization | HIGH | HIGH
853 -| **FR3** | Claim Classification | HIGH | HIGH
854 -| **FR4** | Scenario Generation | HIGH | HIGH
855 -| **FR6** | Evidence Evaluation | HIGH | HIGH
856 -| **MEDIUM URGENCY** |||
857 -| **NFR12** | Security Controls | CRITICAL | MEDIUM
858 -| **FR9** | Corrections | HIGH | MEDIUM
859 -| **FR44** | ClaimReview Schema | HIGH | MEDIUM
860 -| **FR45** | Corrections Notification | HIGH | MEDIUM
861 -| **FR48** | Safety Framework | HIGH | MEDIUM
862 -| **NFR3** | Transparency | HIGH | MEDIUM
863 -| **NFR13** | Quality Metrics | HIGH | MEDIUM
864 -| **FR8** | User Contribution | MEDIUM | MEDIUM
865 -| **FR10** | Publishing | MEDIUM | MEDIUM
866 -| **FR13** | API | MEDIUM | MEDIUM
867 -| **FR46** | Image Verification | MEDIUM | MEDIUM
868 -| **FR47** | Archive.org Integration | MEDIUM | MEDIUM
869 -| **NFR1** | Performance | MEDIUM | MEDIUM
870 -| **NFR2** | Scalability | MEDIUM | MEDIUM
871 -| **NFR4** | Security & Privacy | MEDIUM | MEDIUM
872 -| **NFR5** | Maintainability | MEDIUM | MEDIUM
873 -| **LOW URGENCY** |||
874 -| **FR11** | Social Sharing | LOW | LOW
875 -| **FR12** | Notifications | LOW | LOW
876 -| **FR49** | A/B Testing | LOW | LOW
877 -| **FR50** | OSINT Toolkit Integration | LOW | LOW
878 -| **FR51** | Video Verification System | LOW | LOW
879 -| **FR52** | Interactive Detection Training | LOW | LOW
880 -| **FR53** | Cross-Organizational Sharing | LOW | LOW
881 -
882 -**Total:** 31 requirements (23 Functional, 8 Non-Functional)
883 -
884 -**See also:**
885 -* [[POC Requirements>>FactHarbor.Specification.POC.Requirements]] - POC1 scope and simplifications
886 -* [[Implementation Roadmap>>FactHarbor.Implementation-Roadmap.WebHome]] - Phase-by-phase implementation plan
887 -* [[User Needs>>FactHarbor.Specification.Requirements.User Needs.WebHome]] - Foundation that drives these requirements
888 -
889 -=== 10.1 User Needs Priority ===
890 -
891 -User Needs (UN) are the foundation that drives functional and non-functional requirements. They are not independently prioritized; instead, their priority is inherited from the FR/NFR requirements they drive.
892 -
893 -|= ID |= Title |= Drives Requirements
894 -| **UN-1** | Trust Assessment at a Glance | Multiple FR/NFR
895 -| **UN-2** | Claim Extraction and Verification | FR1-7
896 -| **UN-3** | Article Summary with FactHarbor Analysis Summary | FR4
897 -| **UN-4** | Social Media Fact-Checking | FR1, FR4
898 -| **UN-5** | Source Provenance and Track Records | FR6
899 -| **UN-6** | Publisher Reliability History | FR6
900 -| **UN-7** | Evidence Transparency | NFR3
901 -| **UN-8** | Understanding Disagreement and Consensus | FR4
902 -| **UN-9** | Methodology Transparency | NFR3, NFR11
903 -| **UN-10** | Manipulation Tactics Detection | FR48
904 -| **UN-11** | Filtered Research | FR3
905 -| **UN-12** | Submit Unchecked Claims | FR8
906 -| **UN-13** | Cite FactHarbor Verdicts | FR10
907 -| **UN-14** | API Access for Integration | FR13
908 -| **UN-15** | Verdict Evolution Timeline | FR7
909 -| **UN-16** | AI vs. Human Review Status | FR9
910 -| **UN-17** | In-Article Claim Highlighting | FR1
911 -| **UN-26** | Search Engine Visibility | FR44
912 -| **UN-27** | Visual Claim Verification | FR46
913 -| **UN-28** | Safe Contribution Environment | FR48
914 -
915 -**Total:** 20 User Needs
916 -
917 -**Note:** Each User Need inherits priority from the requirements it drives. For example, UN-2 (Claim Extraction and Verification) drives FR1-7, which are CRITICAL/HIGH priority, therefore UN-2 is also critical to the project.
918 -
919 -== 11. MVP Scope ==
920 -
921 -**Phase 1 (Months 1-3): Read-Only MVP**
922 -
923 -Build:
924 -* Automated claim analysis
925 -* Confidence scoring
926 -* Source evaluation
927 -* Browse/search interface
928 -* User flagging system
929 -
930 -**Goal**: Prove AI quality before adding user editing
931 -
932 -**User Needs fulfilled in Phase 1**: UN-1, UN-2, UN-3, UN-4, UN-5, UN-6, UN-7, UN-8, UN-9, UN-12
933 -
934 -**Phase 2 (Months 4-6): User Contributions**
935 -
936 -Add only if needed:
937 -* Simple editing (Wikipedia-style)
938 -* Reputation system
939 -* Basic moderation
940 -* In-article claim highlighting (FR13)
941 -
942 -**Additional User Needs fulfilled**: UN-13, UN-17
943 -
944 -**Phase 3 (Months 7-12): Refinement**
945 -
946 -* Continuous quality improvement
947 -* Feature additions based on real usage
948 -* Scale infrastructure
949 -
950 -**Additional User Needs fulfilled**: UN-14 (API access), UN-15 (Full evolution tracking)
951 -
952 -**Deferred**:
953 -* Federation (until multiple successful instances exist)
954 -* Complex contribution workflows (focus on automation)
955 -* Extensive role hierarchy (keep simple)
956 -
957 -== 12. Success Metrics ==
958 -
959 -**System Quality** (track weekly):
960 -* Error rate by category (target: -10%/month)
961 -* Average confidence score (target: increase)
962 -* Source quality distribution (target: more high-quality)
963 -* Contradiction detection rate (target: increase)
964 -
965 -**Efficiency** (track monthly):
966 -* Claims processed per hour (target: increase)
967 -* Human hours per claim (target: decrease)
968 -* Automation coverage (target: >90%)
969 -* Re-work rate (target: <5%)
970 -
971 -**User Satisfaction** (track quarterly):
972 -* User flag rate (issues found)
973 -* Correction acceptance rate (flags valid)
974 -* Return user rate
975 -* Trust indicators (surveys)
976 -
977 -**User Needs Metrics** (track quarterly):
978 -* UN-1: % users who understand trust scores
979 -* UN-4: Time to verify social media claim (target: <30s)
980 -* UN-7: % users who access evidence details
981 -* UN-8: % users who view multiple scenarios
982 -* UN-15: % users who check evolution timeline
983 -* UN-17: % users who enable in-article highlighting; avg. time spent on highlighted vs. non-highlighted articles
984 -
985 985  == 13. Requirements Traceability ==
986 986  
987 987  For full traceability matrix showing which requirements fulfill which user needs, see:
... ... @@ -1065,19 +1065,150 @@
1065 1065  
1066 1066  **Milestone:** V1.0
1067 1067  
1068 -=== FR50-FR53: Future Enhancements (V2.0+) ===
914 +=== FR50: OSINT Toolkit Integration ===
1069 1069  
1070 -* **FR50:** OSINT Toolkit Integration
1071 -* **FR51:** Video Verification System
1072 -* **FR52:** Interactive Detection Training
1073 -* **FR53:** Cross-Organizational Sharing
1074 1074  
1075 -**Milestone:** V2.0+ (12-18 months post-launch)
1076 1076  
1077 -== Enhanced Existing Requirements ==
918 +**Priority:** HIGH (V1.1)
919 +**Fulfills:** Advanced media verification
920 +**Phase:** V1.1
1078 1078  
1079 -=== FR7: Automated Verdicts (Enhanced with Quality Gates) ===
922 +**Purpose:** Integrate open-source intelligence tools for advanced verification.
1080 1080  
924 +**Tools to Integrate:**
925 +* InVID/WeVerify (video verification)
926 +* Bellingcat toolkit
927 +* Additional TBD based on V1.0 learnings
928 +
929 +=== FR51: Video Verification System ===
930 +
931 +
932 +
933 +**Priority:** HIGH (V1.1)
934 +**Fulfills:** UN-27 (Visual claims), advanced media verification
935 +**Phase:** V1.1
936 +
937 +**Purpose:** Verify video-based claims.
938 +
939 +**Specification:**
940 +* Keyframe extraction
941 +* Reverse video search
942 +* Deepfake detection (AI-powered)
943 +* Metadata analysis
944 +* Acoustic signature analysis
945 +
946 +=== FR52: Interactive Detection Training ===
947 +
948 +
949 +
950 +**Priority:** MEDIUM (V1.5)
951 +**Fulfills:** Media literacy education
952 +**Phase:** V1.5
953 +
954 +**Purpose:** Teach users to identify misinformation.
955 +
956 +**Specification:**
957 +* Interactive tutorials
958 +* Practice exercises
959 +* Detection quizzes
960 +* Gamification elements
961 +
962 +=== FR53: Cross-Organizational Sharing ===
963 +
964 +
965 +
966 +**Priority:** MEDIUM (V1.5)
967 +**Fulfills:** Collaboration with other fact-checkers
968 +**Phase:** V1.5
969 +
970 +**Purpose:** Share findings with IFCN/EFCSN members.
971 +
972 +**Specification:**
973 +* API for fact-checking organizations
974 +* Structured data exchange
975 +* Privacy controls
976 +* Attribution requirements
977 +
978 +
979 +== Summary ==
980 +
981 +**V1.0 Critical Requirements (Must Have):**
982 +
983 +* FR44: ClaimReview Schema ✅
984 +* FR45: Corrections Notification ✅
985 +* FR46: Image Verification ✅
986 +* FR47: Archive.org Integration ✅
987 +* FR48: Contributor Safety ✅
988 +* FR49: A/B Testing ✅
989 +* FR54: Evidence Deduplication ✅
990 +* NFR11: Quality Assurance Framework ✅
991 +* NFR12: Security Controls ✅
992 +* NFR13: Quality Metrics Dashboard ✅
993 +
994 +**V1.1+ (Future):**
995 +
996 +* FR50: OSINT Integration
997 +* FR51: Video Verification
998 +* FR52: Detection Training
999 +* FR53: Cross-Org Sharing
1000 +
1001 +
1002 +**Total:** 11 critical requirements for V1.0
1003 +
1004 +=== FR54: Evidence Deduplication ===
1005 +
1006 +
1007 +
1008 +**Priority:** CRITICAL (POC2/Beta)
1009 +**Fulfills:** Accurate evidence counting, quality metrics
1010 +**Phase:** POC2, Beta 0, V1.0
1011 +
1012 +**Purpose:** Avoid counting the same source multiple times when it appears in different forms.
1013 +
1014 +**Specification:**
1015 +
1016 +**Deduplication Logic:**
1017 +
1018 +1. **URL Normalization:**
1019 + * Remove tracking parameters (?utm_source=...)
1020 + * Normalize http/https
1021 + * Normalize www/non-www
1022 + * Handle redirects
1023 +
1024 +2. **Content Similarity:**
1025 + * If two sources have >90% text similarity → Same source
1026 + * If one is subset of other → Same source
1027 + * Use fuzzy matching for minor differences
1028 +
1029 +3. **Cross-Domain Syndication:**
1030 + * Detect wire service content (AP, Reuters)
1031 + * Mark as single source if syndicated
1032 + * Count original publication only
1033 +
1034 +**Display:**
1035 +
1036 +{{code}}
1037 +Evidence Sources (3 unique, 5 total):
1038 +
1039 +1. Original Article (NYTimes)
1040 + - Also appeared in: WashPost, Guardian (syndicated)
1041 +
1042 +2. Research Paper (Nature)
1043 +
1044 +3. Official Statement (WHO)
1045 +{{/code}}
1046 +
1047 +**Acceptance Criteria:**
1048 +
1049 +* ✅ URL normalization works
1050 +* ✅ Content similarity detected
1051 +* ✅ Syndicated content identified
1052 +* ✅ Unique vs. total counts accurate
1053 +* ✅ Improves evidence quality metrics
1054 +
1055 +
1056 +== Additional Requirements (Lower Priority) ===== FR7: Automated Verdicts (Enhanced with Quality Gates) ===
1057 +
1081 1081  **POC1+ Enhancement:**
1082 1082  
1083 1083  After AKEL generates verdict, it passes through quality gates: