Workflows

Version 4.1 by Robert Schaub on 2025/12/12 15:41

Workflows

This chapter defines the core workflows used across the FactHarbor system.

Each workflow describes:

  • Purpose
  • Participants
  • Steps
  • Automation vs. manual work

Workflows included:

  1. Claim Workflow
    2. Scenario Workflow
    3. Evidence Workflow
    4. Verdict Workflow
    5. Re-evaluation Workflow
    6. Federation Synchronization Workflow
    7. User Role & Review Workflow
    8. AKEL Workflow
    9. Global Trigger Flow
    10. Entity Lifecycle Notes

Claim Workflow

Purpose:  
Transform raw text or input material into a normalized, classified, deduplicated, and versioned claim ready for scenario evaluation.

Participants:  

  • Contributor  
  • AKEL  
  • Reviewer  

Steps

  1. Ingestion  
  • User submits text, URL, transcript, or multi-claim content  
  • AKEL extracts one or multiple claims  
  1. Normalization  
  • Standardizes wording  
  • Reduces ambiguity  
  • Flags implicit assumptions  
  1. Classification (AKEL draft → Reviewer confirm)  
  • ClaimType  
  • Domain  
  • Evaluability  
  • SafetyCategory  
  1. Duplicate & Similarity Detection  
  • Embeddings created  
  • Similar claims found  
  • Reviewer merges, splits, or confirms uniqueness  
  1. Version Creation  
  • New ClaimVersion stored  
  • Every edit creates a new immutable version  
  1. Cluster Assignment  
  • AKEL proposes cluster membership  
  • Reviewer confirms  
  1. Scenario Linking (optional)  
  • Existing scenarios connected  
  • AKEL may propose new drafts  
  1. Publication  
  • Claim becomes active and visible  

Flow:  
Ingest → Normalize → Classify → Deduplicate → Cluster → Version → Publish


Scenario Workflow

Purpose:  
Define the specific analytic contexts needed to evaluate each claim.

Participants:  

  • Contributor  
  • Reviewer  
  • Domain Expert  
  • AKEL  

Steps

  1. Scenario Proposal  
  • Drafted by contributor or generated by AKEL  
  1. Completion of Required Fields  
    Must include:  
  • Definitions  
  • Assumptions  
  • ContextBoundary  
  • EvaluationMethod  
  • SafetyClass  
  • VersionMetadata  
  1. Safety Interception (AKEL)  
    Flags:  
  • non-falsifiable structures  
  • pseudoscientific assumptions  
  • unsafe contexts  
  1. Redundancy & Conflict Check  
  • Similar scenarios merged  
  • Contradictions flagged  
  1. Reviewer Validation  
    Ensures clarity, neutrality, and methodological validity.
  1. Expert Approval (mandatory for high-risk domains)  
  1. Version Storage  
  • Each revision = new ScenarioVersion  

Flow:  
Draft → Validate → Safety Check → Review → Expert Approval → Version → Activate


Evidence Workflow

Purpose:  
Structure, classify, validate, version, and link evidence to scenarios.

Participants:  

  • Contributor  
  • Reviewer  
  • Domain Expert  
  • AKEL  

Steps

  1. Evidence Submission  
  • File, dataset, URL, or extracted text  
  1. Metadata Extraction (AKEL)  
  • EvidenceType  
  • Category  
  • Provenance  
  • Study design  
  • ExtractionMethod  
  • ReliabilityHints  
  1. Relevance Check  
    Reviewer verifies which scenarios the evidence applies to.
  1. Reliability Assessment  
  • AKEL proposes reliability  
  • Reviewer confirms  
  • Expert review for complex papers  
  1. ScenarioEvidenceLink Creation  
    Each link stores:  
  • relevance score  
  • justification  
  • evidence version  
  1. Versioning  
  • Any update = new EvidenceVersion  

Flow:  
Submit → Extract Metadata → Evaluate Relevance → Score Reliability → Link → Version


Verdict Workflow

Purpose:  
Generate likelihood estimates per scenario based on evidence and scenario structure.

Participants:  

  • AKEL (drafts)  
  • Reviewer  
  • Domain Expert  

Steps

  1. Evidence Aggregation  
    Collect relevant evidence versions.
  1. Draft Verdict Generation (AKEL)  
    Outputs:  
  • likelihood range  
  • uncertainty factors  
  • conflict detection  
  • sensitivity analysis  
  1. Reasoning Draft  
    Structured explanation chain generated by AKEL.
  1. Reviewer Validation  
    Ensures logic, evidence fit, no hallucinations.
  1. Expert Review  
    Required for:  
  • medicine  
  • psychology  
  • engineering  
  • political misinformation  
  • controversial or risky domains  
  1. Verdict Storage  
  • Every update creates a new VerdictVersion  

Flow:  
Aggregate → Draft Verdict → Draft Explanation → Review → Expert Approval → Version


Re-evaluation Workflow

Purpose:  
Keep verdicts current when evidence or scenarios change.

Trigger Types

  • Evidence updated, disputed, retracted  
  • Scenario assumptions changed  
  • Claim reclassification  
  • AKEL contradiction detection  
  • Federation sync  

Steps

  1. Trigger Detection  
    Re-evaluation engine receives event.
  1. Impact Analysis  
    Find affected:  
  • scenarios  
  • evidence links  
  • verdicts  
  1. AKEL Draft Re-calculation  
    New:  
  • likelihood  
  • reasoning  
  • uncertainty  
  1. Reviewer Validation  
  2. Expert Review (high-risk)  
  3. Version Storage  

Flow:  
Trigger → Analyze → Recompute → Review → Expert → Version


Federation Synchronization Workflow

Purpose:  
Exchange structured data between nodes.

Steps

  

  1. Detect version changes  
  2. Build bundle (diff + Merkle tree + signatures)  
  3. Push to peers  
  4. Validate lineage + hashes  
  5. Resolve conflicts (merge or branch)  
  6. Optional re-evaluation  

Flow:  
Change → Bundle → Push → Validate → Merge/Fork → Update


User Role & Review Workflow

Purpose:  
Ensure correctness, neutrality, safety, and resistance to manipulation.

Steps

  

  1. Submission  
    Claim / scenario / evidence / verdict.
  1. Auto-check (AKEL)  
    Flags unsafe content, contradictions, format issues.
  1. Reviewer Validation
  1. Expert Validation  
    Required for sensitive domains.
  1. Moderator Oversight  
    Triggered by suspicious behavior.

Flow:  
Submit → Auto-check → Review → Expert → Moderator (if needed)


AKEL Workflow

Purpose:  
Support extraction, drafting, structuring, and contradiction detection.

Stages

A — Input Understanding:  
Extraction, normalization, classification.

B — Scenario Drafting:  
Definitions, boundaries, assumptions.

C — Evidence Processing:  
Retrieval, summarization, ranking.

D — Verdict Drafting:  
Likelihood, explanations, uncertainties.

E — Safety & Integrity:  
Contradictions, hallucination detection.

F — Human Approval:  
Reviewer and/or expert.

Flow:  
Input → Drafts → Integrity → Human Approval


Global Trigger Flow (Cascade)

Trigger Sources:  

  • Claim change  
  • Scenario change  
  • Evidence change  
  • Verdict contradiction  
  • Federation update  
  • AKEL model improvements  

Cascade Flow:  
Trigger → Dependency Graph → Re-evaluation → Updated Verdicts