Changes for page Requirements
Last modified by Robert Schaub on 2025/12/23 11:03
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -306,7 +306,7 @@ 306 306 4. How common is this pattern? 307 307 5. Store in ErrorPattern table (improvement queue) 308 308 309 -=== 6.2 ContinuousImprovement Cycle ===309 +=== 6.2 Weekly Improvement Cycle === 310 310 311 311 1. **Review**: Analyze top error patterns 312 312 2. **Develop**: Create fix (prompt, model, validation) ... ... @@ -326,7 +326,7 @@ 326 326 * Re-work rate 327 327 * Claims processed per hour 328 328 329 -**Goal**: continuousimprovement in error rate329 +**Goal**: 10% monthly improvement in error rate 330 330 331 331 == 7. Automated Quality Monitoring == 332 332 ... ... @@ -826,8 +826,162 @@ 826 826 827 827 **Milestone:** POC2 (internal), Beta 0 (public), V1.0 (real-time) 828 828 829 +== 10. Requirements Priority Matrix == 829 829 831 +This table shows all functional and non-functional requirements ordered by urgency and priority. 830 830 833 +**Note:** Implementation phases (POC1, POC2, Beta 0, V1.0) are defined in [[POC Requirements>>FactHarbor.Specification.POC.Requirements]] and [[Implementation Roadmap>>FactHarbor.Implementation-Roadmap.WebHome]], not in this priority matrix. 834 + 835 +**Priority Levels:** 836 +* **CRITICAL** - System doesn't work without it, or major safety/legal risk 837 +* **HIGH** - Core functionality, essential for success 838 +* **MEDIUM** - Important but not blocking 839 +* **LOW** - Nice to have, can be deferred 840 + 841 +**Urgency Levels:** 842 +* **HIGH** - Immediate need (critical for proof of concept) 843 +* **MEDIUM** - Important but not immediate 844 +* **LOW** - Future enhancement 845 + 846 +|= ID |= Title |= Priority |= Urgency 847 +| **HIGH URGENCY** ||| 848 +| **FR1** | Claim Intake | CRITICAL | HIGH 849 +| **FR5** | Evidence Collection | CRITICAL | HIGH 850 +| **FR7** | Verdict Computation | CRITICAL | HIGH 851 +| **NFR11** | Quality Assurance Framework | CRITICAL | HIGH 852 +| **FR2** | Claim Normalization | HIGH | HIGH 853 +| **FR3** | Claim Classification | HIGH | HIGH 854 +| **FR4** | Scenario Generation | HIGH | HIGH 855 +| **FR6** | Evidence Evaluation | HIGH | HIGH 856 +| **MEDIUM URGENCY** ||| 857 +| **NFR12** | Security Controls | CRITICAL | MEDIUM 858 +| **FR9** | Corrections | HIGH | MEDIUM 859 +| **FR44** | ClaimReview Schema | HIGH | MEDIUM 860 +| **FR45** | Corrections Notification | HIGH | MEDIUM 861 +| **FR48** | Safety Framework | HIGH | MEDIUM 862 +| **NFR3** | Transparency | HIGH | MEDIUM 863 +| **NFR13** | Quality Metrics | HIGH | MEDIUM 864 +| **FR8** | User Contribution | MEDIUM | MEDIUM 865 +| **FR10** | Publishing | MEDIUM | MEDIUM 866 +| **FR13** | API | MEDIUM | MEDIUM 867 +| **FR46** | Image Verification | MEDIUM | MEDIUM 868 +| **FR47** | Archive.org Integration | MEDIUM | MEDIUM 869 +| **NFR1** | Performance | MEDIUM | MEDIUM 870 +| **NFR2** | Scalability | MEDIUM | MEDIUM 871 +| **NFR4** | Security & Privacy | MEDIUM | MEDIUM 872 +| **NFR5** | Maintainability | MEDIUM | MEDIUM 873 +| **LOW URGENCY** ||| 874 +| **FR11** | Social Sharing | LOW | LOW 875 +| **FR12** | Notifications | LOW | LOW 876 +| **FR49** | A/B Testing | LOW | LOW 877 +| **FR50** | OSINT Toolkit Integration | LOW | LOW 878 +| **FR51** | Video Verification System | LOW | LOW 879 +| **FR52** | Interactive Detection Training | LOW | LOW 880 +| **FR53** | Cross-Organizational Sharing | LOW | LOW 881 + 882 +**Total:** 31 requirements (23 Functional, 8 Non-Functional) 883 + 884 +**See also:** 885 +* [[POC Requirements>>FactHarbor.Specification.POC.Requirements]] - POC1 scope and simplifications 886 +* [[Implementation Roadmap>>FactHarbor.Implementation-Roadmap.WebHome]] - Phase-by-phase implementation plan 887 +* [[User Needs>>FactHarbor.Specification.Requirements.User Needs.WebHome]] - Foundation that drives these requirements 888 + 889 +=== 10.1 User Needs Priority === 890 + 891 +User Needs (UN) are the foundation that drives functional and non-functional requirements. They are not independently prioritized; instead, their priority is inherited from the FR/NFR requirements they drive. 892 + 893 +|= ID |= Title |= Drives Requirements 894 +| **UN-1** | Trust Assessment at a Glance | Multiple FR/NFR 895 +| **UN-2** | Claim Extraction and Verification | FR1-7 896 +| **UN-3** | Article Summary with FactHarbor Analysis Summary | FR4 897 +| **UN-4** | Social Media Fact-Checking | FR1, FR4 898 +| **UN-5** | Source Provenance and Track Records | FR6 899 +| **UN-6** | Publisher Reliability History | FR6 900 +| **UN-7** | Evidence Transparency | NFR3 901 +| **UN-8** | Understanding Disagreement and Consensus | FR4 902 +| **UN-9** | Methodology Transparency | NFR3, NFR11 903 +| **UN-10** | Manipulation Tactics Detection | FR48 904 +| **UN-11** | Filtered Research | FR3 905 +| **UN-12** | Submit Unchecked Claims | FR8 906 +| **UN-13** | Cite FactHarbor Verdicts | FR10 907 +| **UN-14** | API Access for Integration | FR13 908 +| **UN-15** | Verdict Evolution Timeline | FR7 909 +| **UN-16** | AI vs. Human Review Status | FR9 910 +| **UN-17** | In-Article Claim Highlighting | FR1 911 +| **UN-26** | Search Engine Visibility | FR44 912 +| **UN-27** | Visual Claim Verification | FR46 913 +| **UN-28** | Safe Contribution Environment | FR48 914 + 915 +**Total:** 20 User Needs 916 + 917 +**Note:** Each User Need inherits priority from the requirements it drives. For example, UN-2 (Claim Extraction and Verification) drives FR1-7, which are CRITICAL/HIGH priority, therefore UN-2 is also critical to the project. 918 + 919 +== 11. MVP Scope == 920 + 921 +**Phase 1 (Months 1-3): Read-Only MVP** 922 + 923 +Build: 924 +* Automated claim analysis 925 +* Confidence scoring 926 +* Source evaluation 927 +* Browse/search interface 928 +* User flagging system 929 + 930 +**Goal**: Prove AI quality before adding user editing 931 + 932 +**User Needs fulfilled in Phase 1**: UN-1, UN-2, UN-3, UN-4, UN-5, UN-6, UN-7, UN-8, UN-9, UN-12 933 + 934 +**Phase 2 (Months 4-6): User Contributions** 935 + 936 +Add only if needed: 937 +* Simple editing (Wikipedia-style) 938 +* Reputation system 939 +* Basic moderation 940 +* In-article claim highlighting (FR13) 941 + 942 +**Additional User Needs fulfilled**: UN-13, UN-17 943 + 944 +**Phase 3 (Months 7-12): Refinement** 945 + 946 +* Continuous quality improvement 947 +* Feature additions based on real usage 948 +* Scale infrastructure 949 + 950 +**Additional User Needs fulfilled**: UN-14 (API access), UN-15 (Full evolution tracking) 951 + 952 +**Deferred**: 953 +* Federation (until multiple successful instances exist) 954 +* Complex contribution workflows (focus on automation) 955 +* Extensive role hierarchy (keep simple) 956 + 957 +== 12. Success Metrics == 958 + 959 +**System Quality** (track weekly): 960 +* Error rate by category (target: -10%/month) 961 +* Average confidence score (target: increase) 962 +* Source quality distribution (target: more high-quality) 963 +* Contradiction detection rate (target: increase) 964 + 965 +**Efficiency** (track monthly): 966 +* Claims processed per hour (target: increase) 967 +* Human hours per claim (target: decrease) 968 +* Automation coverage (target: >90%) 969 +* Re-work rate (target: <5%) 970 + 971 +**User Satisfaction** (track quarterly): 972 +* User flag rate (issues found) 973 +* Correction acceptance rate (flags valid) 974 +* Return user rate 975 +* Trust indicators (surveys) 976 + 977 +**User Needs Metrics** (track quarterly): 978 +* UN-1: % users who understand trust scores 979 +* UN-4: Time to verify social media claim (target: <30s) 980 +* UN-7: % users who access evidence details 981 +* UN-8: % users who view multiple scenarios 982 +* UN-15: % users who check evolution timeline 983 +* UN-17: % users who enable in-article highlighting; avg. time spent on highlighted vs. non-highlighted articles 984 + 831 831 == 13. Requirements Traceability == 832 832 833 833 For full traceability matrix showing which requirements fulfill which user needs, see: ... ... @@ -911,150 +911,19 @@ 911 911 912 912 **Milestone:** V1.0 913 913 914 -=== FR50: OSINT ToolkitIntegration ===1068 +=== FR50-FR53: Future Enhancements (V2.0+) === 915 915 1070 +* **FR50:** OSINT Toolkit Integration 1071 +* **FR51:** Video Verification System 1072 +* **FR52:** Interactive Detection Training 1073 +* **FR53:** Cross-Organizational Sharing 916 916 1075 +**Milestone:** V2.0+ (12-18 months post-launch) 917 917 918 -**Priority:** HIGH (V1.1) 919 -**Fulfills:** Advanced media verification 920 -**Phase:** V1.1 1077 +== Enhanced Existing Requirements == 921 921 922 - **Purpose:**Integrateopen-sourceintelligencetoolsforadvancedverification.1079 +=== FR7: Automated Verdicts (Enhanced with Quality Gates) === 923 923 924 -**Tools to Integrate:** 925 -* InVID/WeVerify (video verification) 926 -* Bellingcat toolkit 927 -* Additional TBD based on V1.0 learnings 928 - 929 -=== FR51: Video Verification System === 930 - 931 - 932 - 933 -**Priority:** HIGH (V1.1) 934 -**Fulfills:** UN-27 (Visual claims), advanced media verification 935 -**Phase:** V1.1 936 - 937 -**Purpose:** Verify video-based claims. 938 - 939 -**Specification:** 940 -* Keyframe extraction 941 -* Reverse video search 942 -* Deepfake detection (AI-powered) 943 -* Metadata analysis 944 -* Acoustic signature analysis 945 - 946 -=== FR52: Interactive Detection Training === 947 - 948 - 949 - 950 -**Priority:** MEDIUM (V1.5) 951 -**Fulfills:** Media literacy education 952 -**Phase:** V1.5 953 - 954 -**Purpose:** Teach users to identify misinformation. 955 - 956 -**Specification:** 957 -* Interactive tutorials 958 -* Practice exercises 959 -* Detection quizzes 960 -* Gamification elements 961 - 962 -=== FR53: Cross-Organizational Sharing === 963 - 964 - 965 - 966 -**Priority:** MEDIUM (V1.5) 967 -**Fulfills:** Collaboration with other fact-checkers 968 -**Phase:** V1.5 969 - 970 -**Purpose:** Share findings with IFCN/EFCSN members. 971 - 972 -**Specification:** 973 -* API for fact-checking organizations 974 -* Structured data exchange 975 -* Privacy controls 976 -* Attribution requirements 977 - 978 - 979 -== Summary == 980 - 981 -**V1.0 Critical Requirements (Must Have):** 982 - 983 -* FR44: ClaimReview Schema ✅ 984 -* FR45: Corrections Notification ✅ 985 -* FR46: Image Verification ✅ 986 -* FR47: Archive.org Integration ✅ 987 -* FR48: Contributor Safety ✅ 988 -* FR49: A/B Testing ✅ 989 -* FR54: Evidence Deduplication ✅ 990 -* NFR11: Quality Assurance Framework ✅ 991 -* NFR12: Security Controls ✅ 992 -* NFR13: Quality Metrics Dashboard ✅ 993 - 994 -**V1.1+ (Future):** 995 - 996 -* FR50: OSINT Integration 997 -* FR51: Video Verification 998 -* FR52: Detection Training 999 -* FR53: Cross-Org Sharing 1000 - 1001 - 1002 -**Total:** 11 critical requirements for V1.0 1003 - 1004 -=== FR54: Evidence Deduplication === 1005 - 1006 - 1007 - 1008 -**Priority:** CRITICAL (POC2/Beta) 1009 -**Fulfills:** Accurate evidence counting, quality metrics 1010 -**Phase:** POC2, Beta 0, V1.0 1011 - 1012 -**Purpose:** Avoid counting the same source multiple times when it appears in different forms. 1013 - 1014 -**Specification:** 1015 - 1016 -**Deduplication Logic:** 1017 - 1018 -1. **URL Normalization:** 1019 - * Remove tracking parameters (?utm_source=...) 1020 - * Normalize http/https 1021 - * Normalize www/non-www 1022 - * Handle redirects 1023 - 1024 -2. **Content Similarity:** 1025 - * If two sources have >90% text similarity → Same source 1026 - * If one is subset of other → Same source 1027 - * Use fuzzy matching for minor differences 1028 - 1029 -3. **Cross-Domain Syndication:** 1030 - * Detect wire service content (AP, Reuters) 1031 - * Mark as single source if syndicated 1032 - * Count original publication only 1033 - 1034 -**Display:** 1035 - 1036 -{{code}} 1037 -Evidence Sources (3 unique, 5 total): 1038 - 1039 -1. Original Article (NYTimes) 1040 - - Also appeared in: WashPost, Guardian (syndicated) 1041 - 1042 -2. Research Paper (Nature) 1043 - 1044 -3. Official Statement (WHO) 1045 -{{/code}} 1046 - 1047 -**Acceptance Criteria:** 1048 - 1049 -* ✅ URL normalization works 1050 -* ✅ Content similarity detected 1051 -* ✅ Syndicated content identified 1052 -* ✅ Unique vs. total counts accurate 1053 -* ✅ Improves evidence quality metrics 1054 - 1055 - 1056 -== Additional Requirements (Lower Priority) ===== FR7: Automated Verdicts (Enhanced with Quality Gates) === 1057 - 1058 1058 **POC1+ Enhancement:** 1059 1059 1060 1060 After AKEL generates verdict, it passes through quality gates: