Changes for page Requirements

Last modified by Robert Schaub on 2025/12/24 18:27

From 3.1 to 3.2

From version 1.1

edited by Robert Schaub
on 2025/12/24 11:54

Change comment: Imported from XAR

To version 3.1

edited by Robert Schaub
on 2025/12/24 17:59

Change comment: Imported from XAR

Raw
Rendered

Summary

Page properties (1 modified, 0 added, 0 removed)

Details

Page properties

Content

@@ -1,8 +1,7 @@
  = Requirements =
--
  {{info}}
--**Phase Assignments:** See [[Requirements Roadmap Matrix>>Test.FactHarbor.Roadmap.Requirements-Roadmap-Matrix.WebHome]] for which requirements are implemented in which phases.
++**Phase Assignments:** See [[Requirements Roadmap Matrix>>FactHarbor.Roadmap.Requirements-Roadmap-Matrix.WebHome]] for which requirements are implemented in which phases.
  {{/info}}
  **This page defines Roles, Content States, Rules, and System Requirements for FactHarbor.**
@@ -449,8 +449,6 @@
  This requirement has been **dropped from the current architecture and design**. Versioned entities have been replaced with simple edit history tracking only. Full evolution timeline functionality is deferred to future releases beyond V1.0.
  {{/warning}}
--
--
  **Fulfills**: UN-15 (Verdict evolution timeline)
  * Claims and verdicts update as new evidence emerges
@@ -625,11 +625,11 @@
  **Interaction Design**:
  * Hover/click on highlighted claim → Show tooltip with:
--  * Claim text
--  * Verdict (e.g., "WELL SUPPORTED")
--  * Confidence score (e.g., "85%")
--  * Brief evidence summary
--  * Link to detailed analysis
++ * Claim text
++ * Verdict (e.g., "WELL SUPPORTED")
++ * Confidence score (e.g., "85%")
++ * Brief evidence summary
++ * Link to detailed analysis
  * Toggle highlighting on/off (user preference)
  * Adjustable color intensity for accessibility
@@ -818,7 +818,6 @@
  **Fulfills:** Data protection, system integrity, user privacy, production readiness
--
  **Purpose:** Protect FactHarbor systems, user data, and operations from security threats, ensuring production-grade security posture.
  **Specification:**
@@ -837,10 +837,10 @@
  * **JWT tokens:** For user sessions (1-hour expiry)
  * **OAuth2:** For third-party integrations
  * **Role-Based Access Control (RBAC):**
--  * Public: Read-only access to published claims
--  * Contributor: Submit claims, provide evidence
--  * Moderator: Review contributions, manage quality
--  * Admin: System configuration, user management
++ * Public: Read-only access to published claims
++ * Contributor: Submit claims, provide evidence
++ * Moderator: Review contributions, manage quality
++ * Admin: System configuration, user management
  **CORS Policies:**
  * Whitelist approved domains only
@@ -931,10 +931,10 @@
  **Monitoring & Alerting:**
  * Real-time security event monitoring
  * Alerts for:
--  * Failed login attempts (>5 in 10 minutes)
--  * API abuse patterns
--  * Unusual data access patterns
--  * Security scan detections
++ * Failed login attempts (>5 in 10 minutes)
++ * API abuse patterns
++ * Unusual data access patterns
++ * Security scan detections
  * Integration with SIEM (Security Information and Event Management)
  **Incident Response:**
@@ -982,12 +982,10 @@
  * ✅ Incident response plan documented and tested
  * ✅ 95% uptime over 30-day period
--
  === NFR13: Quality Metrics Transparency ===
  **Fulfills:** User trust, transparency, continuous improvement, IFCN methodology transparency
--
  **Purpose:** Provide transparent, measurable quality metrics that demonstrate AKEL's performance and build user trust in automated fact-checking.
  **Specification:**
@@ -1009,9 +1009,9 @@
  Overall: 84.2 ▲ (+2.1 from last month)
  Distribution:
--  Excellent (>80): 67%
--  Good (60-80): 28%
--  Needs Improvement (<60): 5%
++ Excellent (>80): 67%
++ Good (60-80): 28%
++ Needs Improvement (<60): 5%
  Trend: [Graph showing improvement over time]
  {{/code}}
@@ -1029,8 +1029,8 @@
  Average: 0.87 ▼ (-0.02 from last month)
  Hallucination Rate: 4.2%
--  - Claims without evidence support: 3.1%
--  - Misrepresented evidence: 1.1%
++ - Claims without evidence support: 3.1%
++ - Misrepresented evidence: 1.1%
  Action: Prompt engineering review scheduled
  {{/code}}
@@ -1055,9 +1055,9 @@
  Claims with ≥2 sources: 94% (EFCSN compliant)
  Source Quality Distribution:
--  High quality (>0.8): 48%
--  Medium quality (0.5-0.8): 43%
--  Low quality (<0.5): 9%
++ High quality (>0.8): 48%
++ Medium quality (0.5-0.8): 43%
++ Low quality (<0.5): 9%
  Geographic Diversity: 23 countries represented
  {{/code}}
@@ -1068,10 +1068,10 @@
  * **Calculation:** Cohen's Kappa or Fleiss' Kappa for multiple raters
  * **Scale:** 0-1 (higher is better)
  * **Interpretation:**
--  * >0.8: Almost perfect agreement
--  * 0.6-0.8: Substantial agreement
--  * 0.4-0.6: Moderate agreement
--  * <0.4: Poor agreement
++ * >0.8: Almost perfect agreement
++ * 0.6-0.8: Substantial agreement
++ * 0.4-0.6: Moderate agreement
++ * <0.4: Poor agreement
  * **Target:** Maintain ≥0.7 (substantial agreement)
  **Display:**
@@ -1079,9 +1079,9 @@
  Contributor Consensus:
  Inter-Rater Reliability (IRR): 0.73 (Substantial agreement)
--  - Verdict agreement: 78%
--  - Evidence quality agreement: 71%
--  - Scenario structure agreement: 69%
++ - Verdict agreement: 78%
++ - Evidence quality agreement: 71%
++ - Scenario structure agreement: 69%
  Cases requiring moderator review: 12
  Moderator override rate: 8%
@@ -1111,16 +1111,16 @@
  {{code}}
  ┌─────────────────────────────────────────────────────────────┐
--│ FactHarbor Quality Metrics                    Last updated: │
--│ Public Dashboard                               2 hours ago   │
++│ FactHarbor Quality Metrics Last updated: │
++│ Public Dashboard 2 hours ago │
  └─────────────────────────────────────────────────────────────┘
  📊 KEY METRICS
  ─────────────────────────────────────────────────────────────
--TIGERScore (Verdict Quality):        84.2 ▲ (+2.1)
--AlignScore (Faithfulness):            0.87 ▼ (-0.02)
--Hallucination Rate:                   4.2% ✓ (Target: <5%)
--Average Sources per Claim:            4.2  ▲ (+0.3)
++TIGERScore (Verdict Quality): 84.2 ▲ (+2.1)
++AlignScore (Faithfulness): 0.87 ▼ (-0.02)
++Hallucination Rate: 4.2% ✓ (Target: <5%)
++Average Sources per Claim: 4.2 ▲ (+0.3)
  📈 TRENDS (30 days)
  ─────────────────────────────────────────────────────────────
@@ -1150,25 +1150,25 @@
  **How Metrics Inform AKEL Improvements:**
 . **Identify Weak Areas:**
--   * Low TIGERScore → Review prompt engineering
--   * High hallucination → Strengthen evidence grounding
--   * Low IRR → Clarify evaluation criteria
++ * Low TIGERScore → Review prompt engineering
++ * High hallucination → Strengthen evidence grounding
++ * Low IRR → Clarify evaluation criteria
 . **A/B Testing Integration:**
--   * Test prompt variations
--   * Measure impact on quality metrics
--   * Deploy winners automatically
++ * Test prompt variations
++ * Measure impact on quality metrics
++ * Deploy winners automatically
 . **Alert Thresholds:**
--   * TIGERScore drops below 75 → Alert team
--   * Hallucination rate exceeds 7% → Pause auto-publishing
--   * IRR below 0.6 → Moderator training needed
++ * TIGERScore drops below 75 → Alert team
++ * Hallucination rate exceeds 7% → Pause auto-publishing
++ * IRR below 0.6 → Moderator training needed
 . **Monthly Quality Reviews:**
--   * Analyze trends
--   * Identify systematic issues
--   * Plan prompt improvements
--   * Update AKEL models
++ * Analyze trends
++ * Identify systematic issues
++ * Plan prompt improvements
++ * Update AKEL models
  ---
@@ -1210,9 +1210,6 @@
  * ✅ Mobile-responsive dashboard design
  * ✅ Metrics inform quarterly AKEL improvement planning
--
--
--
  == 13. Requirements Traceability ==
  For full traceability matrix showing which requirements fulfill which user needs, see:
@@ -1247,7 +1247,6 @@
  **Fulfills:** UN-13 (Cite FactHarbor Verdicts), UN-14 (API Access for Integration), UN-26 (Search Engine Visibility)
--
  **Purpose:** Generate valid ClaimReview structured data for every published analysis to enable Google/Bing search visibility and fact-check discovery.
  **Specification:**
@@ -1260,35 +1260,35 @@
  {{code language="json"}}
  {
--  "@context": "https://schema.org",
--  "@type": "ClaimReview",
--  "datePublished": "YYYY-MM-DD",
--  "url": "https://factharbor.org/claims/{claim_id}",
--  "claimReviewed": "The exact claim text",
--  "author": {
--    "@type": "Organization",
--    "name": "FactHarbor",
--    "url": "https://factharbor.org"
--  },
--  "reviewRating": {
--    "@type": "Rating",
--    "ratingValue": "1-5",
--    "bestRating": "5",
--    "worstRating": "1",
--    "alternateName": "FactHarbor likelihood score"
--  },
--  "itemReviewed": {
--    "@type": "Claim",
--    "author": {
--      "@type": "Person",
--      "name": "Claim author if known"
--    },
--    "datePublished": "YYYY-MM-DD if known",
--    "appearance": {
--      "@type": "CreativeWork",
--      "url": "Original claim URL if from article"
--    }
--  }
++ "@context": "https://schema.org",
++ "@type": "ClaimReview",
++ "datePublished": "YYYY-MM-DD",
++ "url": "https://factharbor.org/claims/{claim_id}",
++ "claimReviewed": "The exact claim text",
++ "author": {
++ "@type": "Organization",
++ "name": "FactHarbor",
++ "url": "https://factharbor.org"
++ },
++ "reviewRating": {
++ "@type": "Rating",
++ "ratingValue": "1-5",
++ "bestRating": "5",
++ "worstRating": "1",
++ "alternateName": "FactHarbor likelihood score"
++ },
++ "itemReviewed": {
++ "@type": "Claim",
++ "author": {
++ "@type": "Person",
++ "name": "Claim author if known"
++ },
++ "datePublished": "YYYY-MM-DD if known",
++ "appearance": {
++ "@type": "CreativeWork",
++ "url": "Original claim URL if from article"
++ }
++ }
  }
  {{/code}}
@@ -1334,12 +1334,10 @@
  * ✅ All required fields populated with correct data types
  * ✅ Handles multi-scenario claims correctly (separate ClaimReview per scenario)
--
  === FR45: User Corrections Notification System ===
  **Fulfills:** IFCN Principle 5 (Open & Honest Corrections), EFCSN compliance
--
  **Purpose:** When any claim analysis is corrected, notify users who previously viewed the claim to maintain transparency and build trust.
  **Specification:**
@@ -1375,10 +1375,10 @@
  * Public changelog at `/claims/{id}/corrections`
  * Displays for each correction:
--  * Date/time of correction
--  * What changed (before/after comparison)
--  * Why changed (reason if provided)
--  * Who made change (AKEL auto-update vs. contributor override)
++ * Date/time of correction
++ * What changed (before/after comparison)
++ * Why changed (reason if provided)
++ * Who made change (AKEL auto-update vs. contributor override)
  **3. Email Notifications (opt-in):**
@@ -1422,12 +1422,10 @@
  * ✅ Mobile-responsive banner design
  * ✅ Accessible (screen reader compatible)
--
  === FR46: Image Verification System ===
  **Fulfills:** UN-27 (Visual Claim Verification)
--
  **Purpose:** Verify authenticity and context of images shared with claims to detect manipulation, misattribution, and out-of-context usage.
  **Specification:**
@@ -1440,18 +1440,18 @@
  **Implementation:**
  * Integrate APIs:
--  * **Google Vision AI** (reverse search)
--  * **TinEye** (oldest known uses)
--  * **Bing Visual Search** (broad coverage)
++ * **Google Vision AI** (reverse search)
++ * **TinEye** (oldest known uses)
++ * **Bing Visual Search** (broad coverage)
  **Process:**
 . Extract image from claim or user upload
 . Query multiple reverse search services
 . Analyze results for:
--   * Earliest known publication
--   * Original context (what was it really showing?)
--   * Publication timeline
--   * Geographic spread
++ * Earliest known publication
++ * Original context (what was it really showing?)
++ * Publication timeline
++ * Geographic spread
  **Output:**
  {{code}}
@@ -1479,26 +1479,26 @@
  **Implementation:**
  * Integrate detection services:
--  * **Sensity AI** (deepfake detection)
--  * **Reality Defender** (multimodal analysis)
--  * **AWS Rekognition** (face detection inconsistencies)
++ * **Sensity AI** (deepfake detection)
++ * **Reality Defender** (multimodal analysis)
++ * **AWS Rekognition** (face detection inconsistencies)
  **Detection Categories:**
 . **Face Manipulation:**
--   * Deepfake face swaps
--   * Expression manipulation
--   * Identity replacement
++ * Deepfake face swaps
++ * Expression manipulation
++ * Identity replacement
 . **Image Manipulation:**
--   * Copy-paste artifacts
--   * Clone stamp detection
--   * Content-aware fill detection
--   * JPEG compression inconsistencies
++ * Copy-paste artifacts
++ * Clone stamp detection
++ * Content-aware fill detection
++ * JPEG compression inconsistencies
 . **AI Generation:**
--   * Detect fully AI-generated images
--   * Identify generation artifacts
--   * Check for model signatures
++ * Detect fully AI-generated images
++ * Identify generation artifacts
++ * Check for model signatures
  **Confidence Scoring:**
  * **HIGH (80-100%):** Strong evidence of manipulation
@@ -1511,8 +1511,8 @@
  Face Manipulation: LOW RISK (12%)
  Image Editing: MEDIUM RISK (64%)
--  • Clone stamp artifacts detected in sky region
--  • JPEG compression inconsistent between objects
++ • Clone stamp artifacts detected in sky region
++ • JPEG compression inconsistent between objects
  AI Generation: LOW RISK (8%)
@@ -1622,11 +1622,10 @@
  * ✅ Mobile-friendly image comparison interface
  * ✅ False positive rate <15%
--
  === FR47: Archive.org Integration ===
--**Importance:** CRITICAL
--**Fulfills:** Evidence persistence, FR5 (Evidence linking)
++**Importance:** CRITICAL
++**Fulfills:** Evidence persistence, FR5 (Evidence linking)
  **Purpose:** Ensure evidence remains accessible even if original sources are deleted.
@@ -1669,11 +1669,10 @@
  * ✅ API rate limits respected
  * ✅ Archive status visible in evidence display
--
  == Category 4: Community Safety ===== FR48: Contributor Safety Framework ===
--**Importance:** CRITICAL
--**Fulfills:** UN-28 (Safe contribution environment)
++**Importance:** CRITICAL
++**Fulfills:** UN-28 (Safe contribution environment)
  **Purpose:** Protect contributors from harassment, doxxing, and coordinated attacks.
@@ -1722,11 +1722,10 @@
  * ✅ Moderator tools implemented
  * ✅ Safety policy published
--
  == Category 5: Continuous Improvement ===== FR49: A/B Testing Framework ===
--**Importance:** CRITICAL
--**Fulfills:** Continuous system improvement
++**Importance:** CRITICAL
++**Fulfills:** Continuous system improvement
  **Purpose:** Test and measure improvements to AKEL prompts, algorithms, and workflows.
@@ -1735,19 +1735,19 @@
  **Test Capabilities:**
 . **Prompt Variations:**
--   * Test different claim extraction prompts
--   * Test different verdict generation prompts
--   * Measure: Accuracy, clarity, completeness
++ * Test different claim extraction prompts
++ * Test different verdict generation prompts
++ * Measure: Accuracy, clarity, completeness
 . **Algorithm Variations:**
--   * Test different source scoring algorithms
--   * Test different confidence calculations
--   * Measure: Audit accuracy, user satisfaction
++ * Test different source scoring algorithms
++ * Test different confidence calculations
++ * Measure: Audit accuracy, user satisfaction
 . **Workflow Variations:**
--   * Test different quality gate thresholds
--   * Test different risk tier assignments
--   * Measure: Publication rate, quality scores
++ * Test different quality gate thresholds
++ * Test different risk tier assignments
++ * Measure: Publication rate, quality scores
  **Implementation:**
@@ -1777,11 +1777,10 @@
  * ✅ Statistical significance calculated
  * ✅ Results inform system improvements
--
  === FR54: Evidence Deduplication ===
--**Importance:** CRITICAL (POC2/Beta)
--**Fulfills:** Accurate evidence counting, quality metrics
++**Importance:** CRITICAL (POC2/Beta)
++**Fulfills:** Accurate evidence counting, quality metrics
  **Purpose:** Avoid counting the same source multiple times when it appears in different forms.
@@ -1790,20 +1790,20 @@
  **Deduplication Logic:**
 . **URL Normalization:**
--   * Remove tracking parameters (?utm_source=...)
--   * Normalize http/https
--   * Normalize www/non-www
--   * Handle redirects
++ * Remove tracking parameters (?utm_source=...)
++ * Normalize http/https
++ * Normalize www/non-www
++ * Handle redirects
 . **Content Similarity:**
--   * If two sources have >90% text similarity → Same source
--   * If one is subset of other → Same source
--   * Use fuzzy matching for minor differences
++ * If two sources have >90% text similarity → Same source
++ * If one is subset of other → Same source
++ * Use fuzzy matching for minor differences
 . **Cross-Domain Syndication:**
--   * Detect wire service content (AP, Reuters)
--   * Mark as single source if syndicated
--   * Count original publication only
++ * Detect wire service content (AP, Reuters)
++ * Mark as single source if syndicated
++ * Count original publication only
  **Display:**
@@ -1811,7 +1811,7 @@
  Evidence Sources (3 unique, 5 total):
 . Original Article (NYTimes)
--   - Also appeared in: WashPost, Guardian (syndicated)
++ - Also appeared in: WashPost, Guardian (syndicated)
 . Research Paper (Nature)
@@ -1826,13 +1826,10 @@
  * ✅ Unique vs. total counts accurate
  * ✅ Improves evidence quality metrics
--
  == Additional Requirements (Lower Importance) ===== FR50: OSINT Toolkit Integration ===
++**Fulfills:** Advanced media verification
--
--**Fulfills:** Advanced media verification
--
  **Purpose:** Integrate open-source intelligence tools for advanced verification.
  **Tools to Integrate:**
@@ -1842,10 +1842,8 @@
  === FR51: Video Verification System ===
++**Fulfills:** UN-27 (Visual claims), advanced media verification
--
--**Fulfills:** UN-27 (Visual claims), advanced media verification
--
  **Purpose:** Verify video-based claims.
  **Specification:**
@@ -1857,10 +1857,8 @@
  === FR52: Interactive Detection Training ===
++**Fulfills:** Media literacy education
--
--**Fulfills:** Media literacy education
--
  **Purpose:** Teach users to identify misinformation.
  **Specification:**
@@ -1871,10 +1871,8 @@
  === FR53: Cross-Organizational Sharing ===
++**Fulfills:** Collaboration with other fact-checkers
--
--**Fulfills:** Collaboration with other fact-checkers
--
  **Purpose:** Share findings with IFCN/EFCSN members.
  **Specification:**
@@ -1883,7 +1883,6 @@
  * Privacy controls
  * Attribution requirements
--
  == Summary ==
  **V1.0 Critical Requirements (Must Have):**
@@ -1906,15 +1906,12 @@
  * FR52: Detection Training
  * FR53: Cross-Org Sharing
--
  **Total:** 11 critical requirements for V1.0
  === FR54: Evidence Deduplication ===
++**Fulfills:** Accurate evidence counting, quality metrics
--
--**Fulfills:** Accurate evidence counting, quality metrics
--
  **Purpose:** Avoid counting the same source multiple times when it appears in different forms.
  **Specification:**
@@ -1922,20 +1922,20 @@
  **Deduplication Logic:**
 . **URL Normalization:**
--   * Remove tracking parameters (?utm_source=...)
--   * Normalize http/https
--   * Normalize www/non-www
--   * Handle redirects
++ * Remove tracking parameters (?utm_source=...)
++ * Normalize http/https
++ * Normalize www/non-www
++ * Handle redirects
 . **Content Similarity:**
--   * If two sources have >90% text similarity → Same source
--   * If one is subset of other → Same source
--   * Use fuzzy matching for minor differences
++ * If two sources have >90% text similarity → Same source
++ * If one is subset of other → Same source
++ * Use fuzzy matching for minor differences
 . **Cross-Domain Syndication:**
--   * Detect wire service content (AP, Reuters)
--   * Mark as single source if syndicated
--   * Count original publication only
++ * Detect wire service content (AP, Reuters)
++ * Mark as single source if syndicated
++ * Count original publication only
  **Display:**
@@ -1943,7 +1943,7 @@
  Evidence Sources (3 unique, 5 total):
 . Original Article (NYTimes)
--   - Also appeared in: WashPost, Guardian (syndicated)
++ - Also appeared in: WashPost, Guardian (syndicated)
 . Research Paper (Nature)
@@ -1958,7 +1958,6 @@
  * ✅ Unique vs. total counts accurate
  * ✅ Improves evidence quality metrics
--
  == Additional Requirements (Lower Importance) ===== FR7: Automated Verdicts (Enhanced with Quality Gates) ===
  **POC1+ Enhancement:**
@@ -1968,15 +1968,15 @@
  {{code}}
  Workflow:
 . Extract claims
--   ↓
++ ↓
 . [GATE 1] Validate fact-checkable
--   ↓
++ ↓
 . Generate scenarios
--   ↓
++ ↓
 . Generate verdicts
--   ↓
++ ↓
 . [GATE 4] Validate confidence
--   ↓
++ ↓
 . Display to user
  {{/code}}
@@ -1995,11 +1995,11 @@
  {{code}}
  Analysis Summary:
--  Verifiable Claims: 3/5
--  High Confidence Verdicts: 1
--  Medium Confidence: 2
--  Evidence Sources: 12
--  Avg Source Quality: 0.73
--  Quality Score: 8.5/10
++ Verifiable Claims: 3/5
++ High Confidence Verdicts: 1
++ Medium Confidence: 2
++ Evidence Sources: 12
++ Avg Source Quality: 0.73
++ Quality Score: 8.5/10
  {{/code}}

Changes for page Requirements

Summary

Details

Applications

Navigation

Need help?