Wiki source code of Quality Gates (v2.6.33)
Last modified by Robert Schaub on 2026/02/08 08:31
Show last authors
| author | version | line-number | content |
|---|---|---|---|
| 1 | {{info}} | ||
| 2 | **Current Implementation (v2.6.33)** - Only Gate 1 (Claim Validation) and Gate 4 (Verdict Confidence) are implemented. Gates 2-3 are planned for future. | ||
| 3 | {{/info}} | ||
| 4 | |||
| 5 | = Quality Gates Flow = | ||
| 6 | |||
| 7 | {{mermaid}} | ||
| 8 | |||
| 9 | flowchart TB | ||
| 10 | subgraph Input[Input] | ||
| 11 | CLAIM[Extracted Claim] | ||
| 12 | end | ||
| 13 | |||
| 14 | subgraph Gate1[Gate 1 Claim Validation] | ||
| 15 | G1_CHECK{Is claim factual} | ||
| 16 | G1_OPINION[Opinion Detection] | ||
| 17 | G1_SPECIFIC[Specificity Check] | ||
| 18 | G1_FUTURE[Future Prediction] | ||
| 19 | end | ||
| 20 | |||
| 21 | subgraph Research[Research] | ||
| 22 | EVIDENCE[Gather Evidence] | ||
| 23 | end | ||
| 24 | |||
| 25 | subgraph Gate4[Gate 4 Verdict Confidence] | ||
| 26 | G4_COUNT{Evidence Count} | ||
| 27 | G4_QUALITY{Source Quality} | ||
| 28 | G4_AGREE{Evidence Agreement} | ||
| 29 | G4_TIER[Assign Confidence Tier] | ||
| 30 | end | ||
| 31 | |||
| 32 | subgraph Output[Output] | ||
| 33 | PUBLISH[Publish Verdict] | ||
| 34 | EXCLUDE[Exclude] | ||
| 35 | LOWCONF[Flag for Review] | ||
| 36 | end | ||
| 37 | |||
| 38 | CLAIM --> G1_CHECK | ||
| 39 | G1_CHECK --> G1_OPINION | ||
| 40 | G1_OPINION --> G1_SPECIFIC | ||
| 41 | G1_SPECIFIC --> G1_FUTURE | ||
| 42 | G1_FUTURE -->|Pass| EVIDENCE | ||
| 43 | G1_FUTURE -->|Fail| EXCLUDE | ||
| 44 | EVIDENCE --> G4_COUNT | ||
| 45 | G4_COUNT -->|2 or more| G4_QUALITY | ||
| 46 | G4_COUNT -->|less than 2| LOWCONF | ||
| 47 | G4_QUALITY -->|0.6 or more| G4_AGREE | ||
| 48 | G4_QUALITY -->|less than 0.6| LOWCONF | ||
| 49 | G4_AGREE -->|60 percent or more| G4_TIER | ||
| 50 | G4_AGREE -->|less than 60 percent| LOWCONF | ||
| 51 | G4_TIER -->|HIGH or MEDIUM| PUBLISH | ||
| 52 | G4_TIER -->|LOW| LOWCONF | ||
| 53 | |||
| 54 | {{/mermaid}} | ||
| 55 | |||
| 56 | = Gate Details = | ||
| 57 | |||
| 58 | == Gate 1: Claim Validation == | ||
| 59 | |||
| 60 | **Purpose:** Ensure extracted claims are factual assertions that can be verified. | ||
| 61 | |||
| 62 | |= Check |= Purpose |= Pass Criteria | ||
| 63 | | Factuality Test | Can this claim be proven true/false? | Must be verifiable | ||
| 64 | | Opinion Detection | Contains subjective language? | Opinion score 0.3 or less | ||
| 65 | | Specificity Check | Contains concrete details? | Specificity score 0.3 or more | ||
| 66 | | Future Prediction | About future events? | Must be about past/present | ||
| 67 | |||
| 68 | == Gate 4: Verdict Confidence Assessment == | ||
| 69 | |||
| 70 | **Purpose:** Only display verdicts with sufficient evidence and confidence. | ||
| 71 | |||
| 72 | |= Tier |= Evidence |= Avg Quality |= Agreement |= Publishable? | ||
| 73 | | **HIGH** | 3+ sources | 0.7 or more | 80% or more | Yes | ||
| 74 | | **MEDIUM** | 2+ sources | 0.6 or more | 60% or more | Yes | ||
| 75 | | **LOW** | 2+ sources | 0.5 or more | 40% or more | Needs review | ||
| 76 | | **INSUFFICIENT** | Less than 2 sources | Any | Any | More research needed | ||
| 77 | |||
| 78 | = Not Yet Implemented = | ||
| 79 | |||
| 80 | **Gate 2: Contradiction Search** (planned) - Counter-evidence actively searched | ||
| 81 | |||
| 82 | **Gate 3: Uncertainty Quantification** (planned) - Data gaps identified and disclosed |