Changes for page Requirements
Last modified by Robert Schaub on 2025/12/23 11:03
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -306,7 +306,7 @@ 306 306 4. How common is this pattern? 307 307 5. Store in ErrorPattern table (improvement queue) 308 308 309 -=== 6.2 WeeklyImprovement Cycle ===309 +=== 6.2 Continuous Improvement Cycle === 310 310 311 311 1. **Review**: Analyze top error patterns 312 312 2. **Develop**: Create fix (prompt, model, validation) ... ... @@ -326,7 +326,7 @@ 326 326 * Re-work rate 327 327 * Claims processed per hour 328 328 329 -**Goal**: 10% monthlyimprovement in error rate329 +**Goal**: continuous improvement in error rate 330 330 331 331 == 7. Automated Quality Monitoring == 332 332 ... ... @@ -826,162 +826,8 @@ 826 826 827 827 **Milestone:** POC2 (internal), Beta 0 (public), V1.0 (real-time) 828 828 829 -== 10. Requirements Priority Matrix == 830 830 831 -This table shows all functional and non-functional requirements ordered by urgency and priority. 832 832 833 -**Note:** Implementation phases (POC1, POC2, Beta 0, V1.0) are defined in [[POC Requirements>>FactHarbor.Specification.POC.Requirements]] and [[Implementation Roadmap>>FactHarbor.Implementation-Roadmap.WebHome]], not in this priority matrix. 834 - 835 -**Priority Levels:** 836 -* **CRITICAL** - System doesn't work without it, or major safety/legal risk 837 -* **HIGH** - Core functionality, essential for success 838 -* **MEDIUM** - Important but not blocking 839 -* **LOW** - Nice to have, can be deferred 840 - 841 -**Urgency Levels:** 842 -* **HIGH** - Immediate need (critical for proof of concept) 843 -* **MEDIUM** - Important but not immediate 844 -* **LOW** - Future enhancement 845 - 846 -|= ID |= Title |= Priority |= Urgency 847 -| **HIGH URGENCY** ||| 848 -| **FR1** | Claim Intake | CRITICAL | HIGH 849 -| **FR5** | Evidence Collection | CRITICAL | HIGH 850 -| **FR7** | Verdict Computation | CRITICAL | HIGH 851 -| **NFR11** | Quality Assurance Framework | CRITICAL | HIGH 852 -| **FR2** | Claim Normalization | HIGH | HIGH 853 -| **FR3** | Claim Classification | HIGH | HIGH 854 -| **FR4** | Scenario Generation | HIGH | HIGH 855 -| **FR6** | Evidence Evaluation | HIGH | HIGH 856 -| **MEDIUM URGENCY** ||| 857 -| **NFR12** | Security Controls | CRITICAL | MEDIUM 858 -| **FR9** | Corrections | HIGH | MEDIUM 859 -| **FR44** | ClaimReview Schema | HIGH | MEDIUM 860 -| **FR45** | Corrections Notification | HIGH | MEDIUM 861 -| **FR48** | Safety Framework | HIGH | MEDIUM 862 -| **NFR3** | Transparency | HIGH | MEDIUM 863 -| **NFR13** | Quality Metrics | HIGH | MEDIUM 864 -| **FR8** | User Contribution | MEDIUM | MEDIUM 865 -| **FR10** | Publishing | MEDIUM | MEDIUM 866 -| **FR13** | API | MEDIUM | MEDIUM 867 -| **FR46** | Image Verification | MEDIUM | MEDIUM 868 -| **FR47** | Archive.org Integration | MEDIUM | MEDIUM 869 -| **NFR1** | Performance | MEDIUM | MEDIUM 870 -| **NFR2** | Scalability | MEDIUM | MEDIUM 871 -| **NFR4** | Security & Privacy | MEDIUM | MEDIUM 872 -| **NFR5** | Maintainability | MEDIUM | MEDIUM 873 -| **LOW URGENCY** ||| 874 -| **FR11** | Social Sharing | LOW | LOW 875 -| **FR12** | Notifications | LOW | LOW 876 -| **FR49** | A/B Testing | LOW | LOW 877 -| **FR50** | OSINT Toolkit Integration | LOW | LOW 878 -| **FR51** | Video Verification System | LOW | LOW 879 -| **FR52** | Interactive Detection Training | LOW | LOW 880 -| **FR53** | Cross-Organizational Sharing | LOW | LOW 881 - 882 -**Total:** 31 requirements (23 Functional, 8 Non-Functional) 883 - 884 -**See also:** 885 -* [[POC Requirements>>FactHarbor.Specification.POC.Requirements]] - POC1 scope and simplifications 886 -* [[Implementation Roadmap>>FactHarbor.Implementation-Roadmap.WebHome]] - Phase-by-phase implementation plan 887 -* [[User Needs>>FactHarbor.Specification.Requirements.User Needs.WebHome]] - Foundation that drives these requirements 888 - 889 -=== 10.1 User Needs Priority === 890 - 891 -User Needs (UN) are the foundation that drives functional and non-functional requirements. They are not independently prioritized; instead, their priority is inherited from the FR/NFR requirements they drive. 892 - 893 -|= ID |= Title |= Drives Requirements 894 -| **UN-1** | Trust Assessment at a Glance | Multiple FR/NFR 895 -| **UN-2** | Claim Extraction and Verification | FR1-7 896 -| **UN-3** | Article Summary with FactHarbor Analysis Summary | FR4 897 -| **UN-4** | Social Media Fact-Checking | FR1, FR4 898 -| **UN-5** | Source Provenance and Track Records | FR6 899 -| **UN-6** | Publisher Reliability History | FR6 900 -| **UN-7** | Evidence Transparency | NFR3 901 -| **UN-8** | Understanding Disagreement and Consensus | FR4 902 -| **UN-9** | Methodology Transparency | NFR3, NFR11 903 -| **UN-10** | Manipulation Tactics Detection | FR48 904 -| **UN-11** | Filtered Research | FR3 905 -| **UN-12** | Submit Unchecked Claims | FR8 906 -| **UN-13** | Cite FactHarbor Verdicts | FR10 907 -| **UN-14** | API Access for Integration | FR13 908 -| **UN-15** | Verdict Evolution Timeline | FR7 909 -| **UN-16** | AI vs. Human Review Status | FR9 910 -| **UN-17** | In-Article Claim Highlighting | FR1 911 -| **UN-26** | Search Engine Visibility | FR44 912 -| **UN-27** | Visual Claim Verification | FR46 913 -| **UN-28** | Safe Contribution Environment | FR48 914 - 915 -**Total:** 20 User Needs 916 - 917 -**Note:** Each User Need inherits priority from the requirements it drives. For example, UN-2 (Claim Extraction and Verification) drives FR1-7, which are CRITICAL/HIGH priority, therefore UN-2 is also critical to the project. 918 - 919 -== 11. MVP Scope == 920 - 921 -**Phase 1 (Months 1-3): Read-Only MVP** 922 - 923 -Build: 924 -* Automated claim analysis 925 -* Confidence scoring 926 -* Source evaluation 927 -* Browse/search interface 928 -* User flagging system 929 - 930 -**Goal**: Prove AI quality before adding user editing 931 - 932 -**User Needs fulfilled in Phase 1**: UN-1, UN-2, UN-3, UN-4, UN-5, UN-6, UN-7, UN-8, UN-9, UN-12 933 - 934 -**Phase 2 (Months 4-6): User Contributions** 935 - 936 -Add only if needed: 937 -* Simple editing (Wikipedia-style) 938 -* Reputation system 939 -* Basic moderation 940 -* In-article claim highlighting (FR13) 941 - 942 -**Additional User Needs fulfilled**: UN-13, UN-17 943 - 944 -**Phase 3 (Months 7-12): Refinement** 945 - 946 -* Continuous quality improvement 947 -* Feature additions based on real usage 948 -* Scale infrastructure 949 - 950 -**Additional User Needs fulfilled**: UN-14 (API access), UN-15 (Full evolution tracking) 951 - 952 -**Deferred**: 953 -* Federation (until multiple successful instances exist) 954 -* Complex contribution workflows (focus on automation) 955 -* Extensive role hierarchy (keep simple) 956 - 957 -== 12. Success Metrics == 958 - 959 -**System Quality** (track weekly): 960 -* Error rate by category (target: -10%/month) 961 -* Average confidence score (target: increase) 962 -* Source quality distribution (target: more high-quality) 963 -* Contradiction detection rate (target: increase) 964 - 965 -**Efficiency** (track monthly): 966 -* Claims processed per hour (target: increase) 967 -* Human hours per claim (target: decrease) 968 -* Automation coverage (target: >90%) 969 -* Re-work rate (target: <5%) 970 - 971 -**User Satisfaction** (track quarterly): 972 -* User flag rate (issues found) 973 -* Correction acceptance rate (flags valid) 974 -* Return user rate 975 -* Trust indicators (surveys) 976 - 977 -**User Needs Metrics** (track quarterly): 978 -* UN-1: % users who understand trust scores 979 -* UN-4: Time to verify social media claim (target: <30s) 980 -* UN-7: % users who access evidence details 981 -* UN-8: % users who view multiple scenarios 982 -* UN-15: % users who check evolution timeline 983 -* UN-17: % users who enable in-article highlighting; avg. time spent on highlighted vs. non-highlighted articles 984 - 985 985 == 13. Requirements Traceability == 986 986 987 987 For full traceability matrix showing which requirements fulfill which user needs, see: ... ... @@ -1065,19 +1065,150 @@ 1065 1065 1066 1066 **Milestone:** V1.0 1067 1067 1068 -=== FR50 -FR53:FutureEnhancements(V2.0+)===914 +=== FR50: OSINT Toolkit Integration === 1069 1069 1070 -* **FR50:** OSINT Toolkit Integration 1071 -* **FR51:** Video Verification System 1072 -* **FR52:** Interactive Detection Training 1073 -* **FR53:** Cross-Organizational Sharing 1074 1074 1075 -**Milestone:** V2.0+ (12-18 months post-launch) 1076 1076 1077 -== Enhanced Existing Requirements == 918 +**Priority:** HIGH (V1.1) 919 +**Fulfills:** Advanced media verification 920 +**Phase:** V1.1 1078 1078 1079 - === FR7:AutomatedVerdicts(Enhancedwith Quality Gates) ===922 +**Purpose:** Integrate open-source intelligence tools for advanced verification. 1080 1080 924 +**Tools to Integrate:** 925 +* InVID/WeVerify (video verification) 926 +* Bellingcat toolkit 927 +* Additional TBD based on V1.0 learnings 928 + 929 +=== FR51: Video Verification System === 930 + 931 + 932 + 933 +**Priority:** HIGH (V1.1) 934 +**Fulfills:** UN-27 (Visual claims), advanced media verification 935 +**Phase:** V1.1 936 + 937 +**Purpose:** Verify video-based claims. 938 + 939 +**Specification:** 940 +* Keyframe extraction 941 +* Reverse video search 942 +* Deepfake detection (AI-powered) 943 +* Metadata analysis 944 +* Acoustic signature analysis 945 + 946 +=== FR52: Interactive Detection Training === 947 + 948 + 949 + 950 +**Priority:** MEDIUM (V1.5) 951 +**Fulfills:** Media literacy education 952 +**Phase:** V1.5 953 + 954 +**Purpose:** Teach users to identify misinformation. 955 + 956 +**Specification:** 957 +* Interactive tutorials 958 +* Practice exercises 959 +* Detection quizzes 960 +* Gamification elements 961 + 962 +=== FR53: Cross-Organizational Sharing === 963 + 964 + 965 + 966 +**Priority:** MEDIUM (V1.5) 967 +**Fulfills:** Collaboration with other fact-checkers 968 +**Phase:** V1.5 969 + 970 +**Purpose:** Share findings with IFCN/EFCSN members. 971 + 972 +**Specification:** 973 +* API for fact-checking organizations 974 +* Structured data exchange 975 +* Privacy controls 976 +* Attribution requirements 977 + 978 + 979 +== Summary == 980 + 981 +**V1.0 Critical Requirements (Must Have):** 982 + 983 +* FR44: ClaimReview Schema ✅ 984 +* FR45: Corrections Notification ✅ 985 +* FR46: Image Verification ✅ 986 +* FR47: Archive.org Integration ✅ 987 +* FR48: Contributor Safety ✅ 988 +* FR49: A/B Testing ✅ 989 +* FR54: Evidence Deduplication ✅ 990 +* NFR11: Quality Assurance Framework ✅ 991 +* NFR12: Security Controls ✅ 992 +* NFR13: Quality Metrics Dashboard ✅ 993 + 994 +**V1.1+ (Future):** 995 + 996 +* FR50: OSINT Integration 997 +* FR51: Video Verification 998 +* FR52: Detection Training 999 +* FR53: Cross-Org Sharing 1000 + 1001 + 1002 +**Total:** 11 critical requirements for V1.0 1003 + 1004 +=== FR54: Evidence Deduplication === 1005 + 1006 + 1007 + 1008 +**Priority:** CRITICAL (POC2/Beta) 1009 +**Fulfills:** Accurate evidence counting, quality metrics 1010 +**Phase:** POC2, Beta 0, V1.0 1011 + 1012 +**Purpose:** Avoid counting the same source multiple times when it appears in different forms. 1013 + 1014 +**Specification:** 1015 + 1016 +**Deduplication Logic:** 1017 + 1018 +1. **URL Normalization:** 1019 + * Remove tracking parameters (?utm_source=...) 1020 + * Normalize http/https 1021 + * Normalize www/non-www 1022 + * Handle redirects 1023 + 1024 +2. **Content Similarity:** 1025 + * If two sources have >90% text similarity → Same source 1026 + * If one is subset of other → Same source 1027 + * Use fuzzy matching for minor differences 1028 + 1029 +3. **Cross-Domain Syndication:** 1030 + * Detect wire service content (AP, Reuters) 1031 + * Mark as single source if syndicated 1032 + * Count original publication only 1033 + 1034 +**Display:** 1035 + 1036 +{{code}} 1037 +Evidence Sources (3 unique, 5 total): 1038 + 1039 +1. Original Article (NYTimes) 1040 + - Also appeared in: WashPost, Guardian (syndicated) 1041 + 1042 +2. Research Paper (Nature) 1043 + 1044 +3. Official Statement (WHO) 1045 +{{/code}} 1046 + 1047 +**Acceptance Criteria:** 1048 + 1049 +* ✅ URL normalization works 1050 +* ✅ Content similarity detected 1051 +* ✅ Syndicated content identified 1052 +* ✅ Unique vs. total counts accurate 1053 +* ✅ Improves evidence quality metrics 1054 + 1055 + 1056 +== Additional Requirements (Lower Priority) ===== FR7: Automated Verdicts (Enhanced with Quality Gates) === 1057 + 1081 1081 **POC1+ Enhancement:** 1082 1082 1083 1083 After AKEL generates verdict, it passes through quality gates: