Automation

Version 1.3 by Robert Schaub on 2025/12/11 21:34

Automation

Automation in FactHarbor amplifies human capability but never replaces human oversight.
All automated outputs require human review before publication.

This chapter defines:

  • What must remain human-only
  • What AI (AKEL) can draft
  • What can be fully automated
  • How automation evolves through POC → Beta 0 → Release 1.0

Manual vs Automated Responsibilities

Human-Only Tasks

These require human judgment, ethics, or contextual interpretation:

  • Definition of key terms in claims
  • Approval or rejection of scenarios
  • Interpretation of evidence in context
  • Final verdict approval
  • Governance decisions and dispute resolution
  • High-risk domain oversight
  • Ethical boundary decisions (especially medical, political, psychological)

Semi-Automated (AI Draft → Human Review)

AKEL can draft these, but humans must refine/approve:

  • Scenario structures (definitions, assumptions, context)
  • Evaluation methods
  • Evidence relevance suggestions
  • Reliability hints
  • Verdict reasoning chains
  • Uncertainty and limitations
  • Scenario comparison explanations
  • Suggestions for merging or splitting scenarios
  • Draft public summaries

Fully Automated Structural Tasks

These require no human interpretation:

  • Claim normalization
  • Duplicate & cluster detection (vector embeddings)
  • Evidence metadata extraction
  • Basic reliability heuristics
  • Contradiction detection
  • Re-evaluation triggers
  • Batch layout generation (diagrams, summaries)
  • Federation integrity checks

Automation Roadmap

Automation increases with maturity.

POC (Low Automation)

Automated

  • Claim normalization
  • Light scenario templates
  • Evidence metadata extraction
  • Simple verdict drafts (internal only)

Human

  • All scenario definitions
  • Evidence interpretation
  • Verdict creation
  • Governance

Beta 0 (Medium Automation)

Automated

  • Detailed scenario drafts
  • Evidence reliability scoring
  • Cross-scenario comparisons
  • Contradiction detection (local + remote nodes)
  • Internal Truth Landscape drafts

Human

  • Scenario approval
  • Final verdict validation

Release 1.0 (High Automation)

Automated

  • Full scenario generation (definitions, assumptions, boundaries)
  • Evidence relevance scoring and ranking
  • Bayesian verdict scoring across scenario sets
  • Multi-scenario summary generation
  • Anomaly detection across nodes
  • AKEL-assisted federated synchronization

Human

  • Final approval of all scenarios and verdicts
  • Ethical decisions
  • Oversight and conflict resolution

Automation Levels

Level 0 — Human-Centric (POC)

AI is purely advisory, nothing auto-published.

Level 1 — Assisted (Beta 0)

AI drafts structures; humans approve each part.

Level 2 — Structured (Release 1.0)

AI produces near-complete drafts; humans refine.

Level 3 — Distributed Intelligence (Future)

Nodes exchange embeddings, contradiction alerts, and scenario templates.
Humans still approve everything.


Automation Matrix

Always Human

  • Final verdict approval  
  • Scenario validity  
  • Ethical decisions  
  • Dispute resolution  

Mostly AI (Human Validation Needed)

  • Claim normalization  
  • Clustering  
  • Evidence metadata  
  • Reliability heuristics  
  • Scenario drafts  
  • Contradiction detection  

Mixed

  • Definitions of ambiguous terms  
  • Boundary choices  
  • Assumption evaluation  
  • Evidence selection  
  • Verdict reasoning  

Diagram References

Information

Design Philosophy - This matrix shows the intended division of responsibilities between AKEL and humans. v2.6.33 implements the automated claim evaluation; human responsibilities require the user system (not yet implemented).

Manual vs Automated Matrix


graph TD
    subgraph Automated[Automated by AKEL]
        A1[Claim Evaluation]
        A2[Quality Assessment]
        A3[Content Management]
    end
    subgraph Human[Human Responsibilities]
        H1[Algorithm Improvement]
        H2[Policy Governance]
        H3[Exception Handling]
        H4[Strategic Decisions]
    end

Automated by AKEL

 Function  Details  Status
 Claim Evaluation  Evidence extraction, source scoring, verdict generation, risk classification, publication  Implemented
 Quality Assessment  Contradiction detection, confidence scoring, pattern recognition, anomaly flagging  Partial (Gates 1 and 4)
 Content Management  KeyFactor generation, evidence linking, source tracking  Implemented

Human Responsibilities

 Function  Details  Status
 Algorithm Improvement  Monitor metrics, identify issues, propose fixes, test, deploy  Via code changes
 Policy Governance  Set criteria, define risk tiers, establish thresholds, update guidelines  Not implemented (env vars only)
 Exception Handling  Review flagged items, handle abuse, address safety, manage legal  Not implemented
 Strategic Decisions  Budget, hiring, major policy, partnerships  N/A

Key Principles

Never Manual:

  • Individual claim approval
  • Routine content review
  • Verdict overrides (fix algorithm instead)
  • Publication gates

Key Principle: AKEL handles all content decisions. Humans improve the system, not the data.