Changes for page Requirements

Last modified by Robert Schaub on 2025/12/24 18:27

From 2.1 to 1.1

From version 3.2

edited by Robert Schaub
on 2025/12/24 18:27

Change comment: Update document after refactoring.

To version 2.1

edited by Robert Schaub
on 2025/12/24 13:58

Change comment: Imported from XAR

Raw
Rendered

Summary

Page properties (2 modified, 0 added, 0 removed)

Details

Page properties

Parent

@@ -1,1 +1,1 @@
--Test.FactHarbor V0\.9\.103.Specification.WebHome
++Test.FactHarbor.Specification.WebHome

Content

@@ -1,5 +1,6 @@
  = Requirements =
++
  {{info}}
  **Phase Assignments:** See [[Requirements Roadmap Matrix>>FactHarbor.Roadmap.Requirements-Roadmap-Matrix.WebHome]] for which requirements are implemented in which phases.
  {{/info}}
@@ -448,6 +448,8 @@
  This requirement has been **dropped from the current architecture and design**. Versioned entities have been replaced with simple edit history tracking only. Full evolution timeline functionality is deferred to future releases beyond V1.0.
  {{/warning}}
++
++
  **Fulfills**: UN-15 (Verdict evolution timeline)
  * Claims and verdicts update as new evidence emerges
@@ -622,11 +622,11 @@
  **Interaction Design**:
  * Hover/click on highlighted claim → Show tooltip with:
-- * Claim text
-- * Verdict (e.g., "WELL SUPPORTED")
-- * Confidence score (e.g., "85%")
-- * Brief evidence summary
-- * Link to detailed analysis
++  * Claim text
++  * Verdict (e.g., "WELL SUPPORTED")
++  * Confidence score (e.g., "85%")
++  * Brief evidence summary
++  * Link to detailed analysis
  * Toggle highlighting on/off (user preference)
  * Adjustable color intensity for accessibility
@@ -815,6 +815,7 @@
  **Fulfills:** Data protection, system integrity, user privacy, production readiness
++
  **Purpose:** Protect FactHarbor systems, user data, and operations from security threats, ensuring production-grade security posture.
  **Specification:**
@@ -833,10 +833,10 @@
  * **JWT tokens:** For user sessions (1-hour expiry)
  * **OAuth2:** For third-party integrations
  * **Role-Based Access Control (RBAC):**
-- * Public: Read-only access to published claims
-- * Contributor: Submit claims, provide evidence
-- * Moderator: Review contributions, manage quality
-- * Admin: System configuration, user management
++  * Public: Read-only access to published claims
++  * Contributor: Submit claims, provide evidence
++  * Moderator: Review contributions, manage quality
++  * Admin: System configuration, user management
  **CORS Policies:**
  * Whitelist approved domains only
@@ -927,10 +927,10 @@
  **Monitoring & Alerting:**
  * Real-time security event monitoring
  * Alerts for:
-- * Failed login attempts (>5 in 10 minutes)
-- * API abuse patterns
-- * Unusual data access patterns
-- * Security scan detections
++  * Failed login attempts (>5 in 10 minutes)
++  * API abuse patterns
++  * Unusual data access patterns
++  * Security scan detections
  * Integration with SIEM (Security Information and Event Management)
  **Incident Response:**
@@ -978,10 +978,12 @@
  * ✅ Incident response plan documented and tested
  * ✅ 95% uptime over 30-day period
++
  === NFR13: Quality Metrics Transparency ===
  **Fulfills:** User trust, transparency, continuous improvement, IFCN methodology transparency
++
  **Purpose:** Provide transparent, measurable quality metrics that demonstrate AKEL's performance and build user trust in automated fact-checking.
  **Specification:**
@@ -1003,9 +1003,9 @@
  Overall: 84.2 ▲ (+2.1 from last month)
  Distribution:
-- Excellent (>80): 67%
-- Good (60-80): 28%
-- Needs Improvement (<60): 5%
++  Excellent (>80): 67%
++  Good (60-80): 28%
++  Needs Improvement (<60): 5%
  Trend: [Graph showing improvement over time]
  {{/code}}
@@ -1023,8 +1023,8 @@
  Average: 0.87 ▼ (-0.02 from last month)
  Hallucination Rate: 4.2%
-- - Claims without evidence support: 3.1%
-- - Misrepresented evidence: 1.1%
++  - Claims without evidence support: 3.1%
++  - Misrepresented evidence: 1.1%
  Action: Prompt engineering review scheduled
  {{/code}}
@@ -1049,9 +1049,9 @@
  Claims with ≥2 sources: 94% (EFCSN compliant)
  Source Quality Distribution:
-- High quality (>0.8): 48%
-- Medium quality (0.5-0.8): 43%
-- Low quality (<0.5): 9%
++  High quality (>0.8): 48%
++  Medium quality (0.5-0.8): 43%
++  Low quality (<0.5): 9%
  Geographic Diversity: 23 countries represented
  {{/code}}
@@ -1062,10 +1062,10 @@
  * **Calculation:** Cohen's Kappa or Fleiss' Kappa for multiple raters
  * **Scale:** 0-1 (higher is better)
  * **Interpretation:**
-- * >0.8: Almost perfect agreement
-- * 0.6-0.8: Substantial agreement
-- * 0.4-0.6: Moderate agreement
-- * <0.4: Poor agreement
++  * >0.8: Almost perfect agreement
++  * 0.6-0.8: Substantial agreement
++  * 0.4-0.6: Moderate agreement
++  * <0.4: Poor agreement
  * **Target:** Maintain ≥0.7 (substantial agreement)
  **Display:**
@@ -1073,9 +1073,9 @@
  Contributor Consensus:
  Inter-Rater Reliability (IRR): 0.73 (Substantial agreement)
-- - Verdict agreement: 78%
-- - Evidence quality agreement: 71%
-- - Scenario structure agreement: 69%
++  - Verdict agreement: 78%
++  - Evidence quality agreement: 71%
++  - Scenario structure agreement: 69%
  Cases requiring moderator review: 12
  Moderator override rate: 8%
@@ -1105,16 +1105,16 @@
  {{code}}
  ┌─────────────────────────────────────────────────────────────┐
--│ FactHarbor Quality Metrics Last updated: │
--│ Public Dashboard 2 hours ago │
++│ FactHarbor Quality Metrics                    Last updated: │
++│ Public Dashboard                               2 hours ago   │
  └─────────────────────────────────────────────────────────────┘
  📊 KEY METRICS
  ─────────────────────────────────────────────────────────────
--TIGERScore (Verdict Quality): 84.2 ▲ (+2.1)
--AlignScore (Faithfulness): 0.87 ▼ (-0.02)
--Hallucination Rate: 4.2% ✓ (Target: <5%)
--Average Sources per Claim: 4.2 ▲ (+0.3)
++TIGERScore (Verdict Quality):        84.2 ▲ (+2.1)
++AlignScore (Faithfulness):            0.87 ▼ (-0.02)
++Hallucination Rate:                   4.2% ✓ (Target: <5%)
++Average Sources per Claim:            4.2  ▲ (+0.3)
  📈 TRENDS (30 days)
  ─────────────────────────────────────────────────────────────
@@ -1144,25 +1144,25 @@
  **How Metrics Inform AKEL Improvements:**
 . **Identify Weak Areas:**
-- * Low TIGERScore → Review prompt engineering
-- * High hallucination → Strengthen evidence grounding
-- * Low IRR → Clarify evaluation criteria
++   * Low TIGERScore → Review prompt engineering
++   * High hallucination → Strengthen evidence grounding
++   * Low IRR → Clarify evaluation criteria
 . **A/B Testing Integration:**
-- * Test prompt variations
-- * Measure impact on quality metrics
-- * Deploy winners automatically
++   * Test prompt variations
++   * Measure impact on quality metrics
++   * Deploy winners automatically
 . **Alert Thresholds:**
-- * TIGERScore drops below 75 → Alert team
-- * Hallucination rate exceeds 7% → Pause auto-publishing
-- * IRR below 0.6 → Moderator training needed
++   * TIGERScore drops below 75 → Alert team
++   * Hallucination rate exceeds 7% → Pause auto-publishing
++   * IRR below 0.6 → Moderator training needed
 . **Monthly Quality Reviews:**
-- * Analyze trends
-- * Identify systematic issues
-- * Plan prompt improvements
-- * Update AKEL models
++   * Analyze trends
++   * Identify systematic issues
++   * Plan prompt improvements
++   * Update AKEL models
  ---
@@ -1204,6 +1204,9 @@
  * ✅ Mobile-responsive dashboard design
  * ✅ Metrics inform quarterly AKEL improvement planning
++
++
++
  == 13. Requirements Traceability ==
  For full traceability matrix showing which requirements fulfill which user needs, see:
@@ -1238,6 +1238,7 @@
  **Fulfills:** UN-13 (Cite FactHarbor Verdicts), UN-14 (API Access for Integration), UN-26 (Search Engine Visibility)
++
  **Purpose:** Generate valid ClaimReview structured data for every published analysis to enable Google/Bing search visibility and fact-check discovery.
  **Specification:**
@@ -1250,35 +1250,35 @@
  {{code language="json"}}
  {
-- "@context": "https://schema.org",
-- "@type": "ClaimReview",
-- "datePublished": "YYYY-MM-DD",
-- "url": "https://factharbor.org/claims/{claim_id}",
-- "claimReviewed": "The exact claim text",
-- "author": {
-- "@type": "Organization",
-- "name": "FactHarbor",
-- "url": "https://factharbor.org"
-- },
-- "reviewRating": {
-- "@type": "Rating",
-- "ratingValue": "1-5",
-- "bestRating": "5",
-- "worstRating": "1",
-- "alternateName": "FactHarbor likelihood score"
-- },
-- "itemReviewed": {
-- "@type": "Claim",
-- "author": {
-- "@type": "Person",
-- "name": "Claim author if known"
-- },
-- "datePublished": "YYYY-MM-DD if known",
-- "appearance": {
-- "@type": "CreativeWork",
-- "url": "Original claim URL if from article"
-- }
-- }
++  "@context": "https://schema.org",
++  "@type": "ClaimReview",
++  "datePublished": "YYYY-MM-DD",
++  "url": "https://factharbor.org/claims/{claim_id}",
++  "claimReviewed": "The exact claim text",
++  "author": {
++    "@type": "Organization",
++    "name": "FactHarbor",
++    "url": "https://factharbor.org"
++  },
++  "reviewRating": {
++    "@type": "Rating",
++    "ratingValue": "1-5",
++    "bestRating": "5",
++    "worstRating": "1",
++    "alternateName": "FactHarbor likelihood score"
++  },
++  "itemReviewed": {
++    "@type": "Claim",
++    "author": {
++      "@type": "Person",
++      "name": "Claim author if known"
++    },
++    "datePublished": "YYYY-MM-DD if known",
++    "appearance": {
++      "@type": "CreativeWork",
++      "url": "Original claim URL if from article"
++    }
++  }
  }
  {{/code}}
@@ -1324,10 +1324,12 @@
  * ✅ All required fields populated with correct data types
  * ✅ Handles multi-scenario claims correctly (separate ClaimReview per scenario)
++
  === FR45: User Corrections Notification System ===
  **Fulfills:** IFCN Principle 5 (Open & Honest Corrections), EFCSN compliance
++
  **Purpose:** When any claim analysis is corrected, notify users who previously viewed the claim to maintain transparency and build trust.
  **Specification:**
@@ -1363,10 +1363,10 @@
  * Public changelog at `/claims/{id}/corrections`
  * Displays for each correction:
-- * Date/time of correction
-- * What changed (before/after comparison)
-- * Why changed (reason if provided)
-- * Who made change (AKEL auto-update vs. contributor override)
++  * Date/time of correction
++  * What changed (before/after comparison)
++  * Why changed (reason if provided)
++  * Who made change (AKEL auto-update vs. contributor override)
  **3. Email Notifications (opt-in):**
@@ -1410,10 +1410,12 @@
  * ✅ Mobile-responsive banner design
  * ✅ Accessible (screen reader compatible)
++
  === FR46: Image Verification System ===
  **Fulfills:** UN-27 (Visual Claim Verification)
++
  **Purpose:** Verify authenticity and context of images shared with claims to detect manipulation, misattribution, and out-of-context usage.
  **Specification:**
@@ -1426,18 +1426,18 @@
  **Implementation:**
  * Integrate APIs:
-- * **Google Vision AI** (reverse search)
-- * **TinEye** (oldest known uses)
-- * **Bing Visual Search** (broad coverage)
++  * **Google Vision AI** (reverse search)
++  * **TinEye** (oldest known uses)
++  * **Bing Visual Search** (broad coverage)
  **Process:**
 . Extract image from claim or user upload
 . Query multiple reverse search services
 . Analyze results for:
-- * Earliest known publication
-- * Original context (what was it really showing?)
-- * Publication timeline
-- * Geographic spread
++   * Earliest known publication
++   * Original context (what was it really showing?)
++   * Publication timeline
++   * Geographic spread
  **Output:**
  {{code}}
@@ -1465,26 +1465,26 @@
  **Implementation:**
  * Integrate detection services:
-- * **Sensity AI** (deepfake detection)
-- * **Reality Defender** (multimodal analysis)
-- * **AWS Rekognition** (face detection inconsistencies)
++  * **Sensity AI** (deepfake detection)
++  * **Reality Defender** (multimodal analysis)
++  * **AWS Rekognition** (face detection inconsistencies)
  **Detection Categories:**
 . **Face Manipulation:**
-- * Deepfake face swaps
-- * Expression manipulation
-- * Identity replacement
++   * Deepfake face swaps
++   * Expression manipulation
++   * Identity replacement
 . **Image Manipulation:**
-- * Copy-paste artifacts
-- * Clone stamp detection
-- * Content-aware fill detection
-- * JPEG compression inconsistencies
++   * Copy-paste artifacts
++   * Clone stamp detection
++   * Content-aware fill detection
++   * JPEG compression inconsistencies
 . **AI Generation:**
-- * Detect fully AI-generated images
-- * Identify generation artifacts
-- * Check for model signatures
++   * Detect fully AI-generated images
++   * Identify generation artifacts
++   * Check for model signatures
  **Confidence Scoring:**
  * **HIGH (80-100%):** Strong evidence of manipulation
@@ -1497,8 +1497,8 @@
  Face Manipulation: LOW RISK (12%)
  Image Editing: MEDIUM RISK (64%)
-- • Clone stamp artifacts detected in sky region
-- • JPEG compression inconsistent between objects
++  • Clone stamp artifacts detected in sky region
++  • JPEG compression inconsistent between objects
  AI Generation: LOW RISK (8%)
@@ -1608,10 +1608,11 @@
  * ✅ Mobile-friendly image comparison interface
  * ✅ False positive rate <15%
++
  === FR47: Archive.org Integration ===
--**Importance:** CRITICAL
--**Fulfills:** Evidence persistence, FR5 (Evidence linking)
++**Importance:** CRITICAL
++**Fulfills:** Evidence persistence, FR5 (Evidence linking)
  **Purpose:** Ensure evidence remains accessible even if original sources are deleted.
@@ -1654,10 +1654,11 @@
  * ✅ API rate limits respected
  * ✅ Archive status visible in evidence display
++
  == Category 4: Community Safety ===== FR48: Contributor Safety Framework ===
--**Importance:** CRITICAL
--**Fulfills:** UN-28 (Safe contribution environment)
++**Importance:** CRITICAL
++**Fulfills:** UN-28 (Safe contribution environment)
  **Purpose:** Protect contributors from harassment, doxxing, and coordinated attacks.
@@ -1706,10 +1706,11 @@
  * ✅ Moderator tools implemented
  * ✅ Safety policy published
++
  == Category 5: Continuous Improvement ===== FR49: A/B Testing Framework ===
--**Importance:** CRITICAL
--**Fulfills:** Continuous system improvement
++**Importance:** CRITICAL
++**Fulfills:** Continuous system improvement
  **Purpose:** Test and measure improvements to AKEL prompts, algorithms, and workflows.
@@ -1718,19 +1718,19 @@
  **Test Capabilities:**
 . **Prompt Variations:**
-- * Test different claim extraction prompts
-- * Test different verdict generation prompts
-- * Measure: Accuracy, clarity, completeness
++   * Test different claim extraction prompts
++   * Test different verdict generation prompts
++   * Measure: Accuracy, clarity, completeness
 . **Algorithm Variations:**
-- * Test different source scoring algorithms
-- * Test different confidence calculations
-- * Measure: Audit accuracy, user satisfaction
++   * Test different source scoring algorithms
++   * Test different confidence calculations
++   * Measure: Audit accuracy, user satisfaction
 . **Workflow Variations:**
-- * Test different quality gate thresholds
-- * Test different risk tier assignments
-- * Measure: Publication rate, quality scores
++   * Test different quality gate thresholds
++   * Test different risk tier assignments
++   * Measure: Publication rate, quality scores
  **Implementation:**
@@ -1760,10 +1760,11 @@
  * ✅ Statistical significance calculated
  * ✅ Results inform system improvements
++
  === FR54: Evidence Deduplication ===
--**Importance:** CRITICAL (POC2/Beta)
--**Fulfills:** Accurate evidence counting, quality metrics
++**Importance:** CRITICAL (POC2/Beta)
++**Fulfills:** Accurate evidence counting, quality metrics
  **Purpose:** Avoid counting the same source multiple times when it appears in different forms.
@@ -1772,20 +1772,20 @@
  **Deduplication Logic:**
 . **URL Normalization:**
-- * Remove tracking parameters (?utm_source=...)
-- * Normalize http/https
-- * Normalize www/non-www
-- * Handle redirects
++   * Remove tracking parameters (?utm_source=...)
++   * Normalize http/https
++   * Normalize www/non-www
++   * Handle redirects
 . **Content Similarity:**
-- * If two sources have >90% text similarity → Same source
-- * If one is subset of other → Same source
-- * Use fuzzy matching for minor differences
++   * If two sources have >90% text similarity → Same source
++   * If one is subset of other → Same source
++   * Use fuzzy matching for minor differences
 . **Cross-Domain Syndication:**
-- * Detect wire service content (AP, Reuters)
-- * Mark as single source if syndicated
-- * Count original publication only
++   * Detect wire service content (AP, Reuters)
++   * Mark as single source if syndicated
++   * Count original publication only
  **Display:**
@@ -1793,7 +1793,7 @@
  Evidence Sources (3 unique, 5 total):
 . Original Article (NYTimes)
-- - Also appeared in: WashPost, Guardian (syndicated)
++   - Also appeared in: WashPost, Guardian (syndicated)
 . Research Paper (Nature)
@@ -1808,10 +1808,13 @@
  * ✅ Unique vs. total counts accurate
  * ✅ Improves evidence quality metrics
++
  == Additional Requirements (Lower Importance) ===== FR50: OSINT Toolkit Integration ===
--**Fulfills:** Advanced media verification
++
++**Fulfills:** Advanced media verification
++
  **Purpose:** Integrate open-source intelligence tools for advanced verification.
  **Tools to Integrate:**
@@ -1821,8 +1821,10 @@
  === FR51: Video Verification System ===
--**Fulfills:** UN-27 (Visual claims), advanced media verification
++
++**Fulfills:** UN-27 (Visual claims), advanced media verification
++
  **Purpose:** Verify video-based claims.
  **Specification:**
@@ -1834,8 +1834,10 @@
  === FR52: Interactive Detection Training ===
--**Fulfills:** Media literacy education
++
++**Fulfills:** Media literacy education
++
  **Purpose:** Teach users to identify misinformation.
  **Specification:**
@@ -1846,8 +1846,10 @@
  === FR53: Cross-Organizational Sharing ===
--**Fulfills:** Collaboration with other fact-checkers
++
++**Fulfills:** Collaboration with other fact-checkers
++
  **Purpose:** Share findings with IFCN/EFCSN members.
  **Specification:**
@@ -1856,6 +1856,7 @@
  * Privacy controls
  * Attribution requirements
++
  == Summary ==
  **V1.0 Critical Requirements (Must Have):**
@@ -1878,12 +1878,15 @@
  * FR52: Detection Training
  * FR53: Cross-Org Sharing
++
  **Total:** 11 critical requirements for V1.0
  === FR54: Evidence Deduplication ===
--**Fulfills:** Accurate evidence counting, quality metrics
++
++**Fulfills:** Accurate evidence counting, quality metrics
++
  **Purpose:** Avoid counting the same source multiple times when it appears in different forms.
  **Specification:**
@@ -1891,20 +1891,20 @@
  **Deduplication Logic:**
 . **URL Normalization:**
-- * Remove tracking parameters (?utm_source=...)
-- * Normalize http/https
-- * Normalize www/non-www
-- * Handle redirects
++   * Remove tracking parameters (?utm_source=...)
++   * Normalize http/https
++   * Normalize www/non-www
++   * Handle redirects
 . **Content Similarity:**
-- * If two sources have >90% text similarity → Same source
-- * If one is subset of other → Same source
-- * Use fuzzy matching for minor differences
++   * If two sources have >90% text similarity → Same source
++   * If one is subset of other → Same source
++   * Use fuzzy matching for minor differences
 . **Cross-Domain Syndication:**
-- * Detect wire service content (AP, Reuters)
-- * Mark as single source if syndicated
-- * Count original publication only
++   * Detect wire service content (AP, Reuters)
++   * Mark as single source if syndicated
++   * Count original publication only
  **Display:**
@@ -1912,7 +1912,7 @@
  Evidence Sources (3 unique, 5 total):
 . Original Article (NYTimes)
-- - Also appeared in: WashPost, Guardian (syndicated)
++   - Also appeared in: WashPost, Guardian (syndicated)
 . Research Paper (Nature)
@@ -1927,6 +1927,7 @@
  * ✅ Unique vs. total counts accurate
  * ✅ Improves evidence quality metrics
++
  == Additional Requirements (Lower Importance) ===== FR7: Automated Verdicts (Enhanced with Quality Gates) ===
  **POC1+ Enhancement:**
@@ -1936,15 +1936,15 @@
  {{code}}
  Workflow:
 . Extract claims
-- ↓
++   ↓
 . [GATE 1] Validate fact-checkable
-- ↓
++   ↓
 . Generate scenarios
-- ↓
++   ↓
 . Generate verdicts
-- ↓
++   ↓
 . [GATE 4] Validate confidence
-- ↓
++   ↓
 . Display to user
  {{/code}}
@@ -1963,11 +1963,11 @@
  {{code}}
  Analysis Summary:
-- Verifiable Claims: 3/5
-- High Confidence Verdicts: 1
-- Medium Confidence: 2
-- Evidence Sources: 12
-- Avg Source Quality: 0.73
-- Quality Score: 8.5/10
++  Verifiable Claims: 3/5
++  High Confidence Verdicts: 1
++  Medium Confidence: 2
++  Evidence Sources: 12
++  Avg Source Quality: 0.73
++  Quality Score: 8.5/10
  {{/code}}

Changes for page Requirements

Summary

Details

Applications

Navigation

Need help?