Reference

Status and Decisions

Interpret Knotest state words according to what they measure.

Knotest does not use one generic status vocabulary for every kind of state.

MeaningValuesUse
ReadinessReady, Missing, Running, FailedWhether preparation prerequisites are satisfied
LifecycleDraft, Running, Completed, Failed, Cancelled, InterruptedHow work changes over time
VerificationUntested, Needs retest, VerifiedWhether retained identities agree
HealthHealthy, Warning, UnavailableWhether a service or resource can operate
ResultPass, Fail, N/AThe scientific decision for a metric or aggregate

Result decisions

A metric with a threshold is Pass or Fail according to that threshold. A metric without a threshold is N/A with reason no_threshold. A metric that cannot be calculated is N/A with reason unavailable.

Aggregates use this order:

  1. Any Fail produces Fail.
  2. Otherwise, any unavailable N/A produces N/A.
  3. Otherwise, any Pass produces Pass.
  4. An aggregate with no threshold decisions is N/A.

Knotest does not emit a Review result decision.

Avoid common category errors

  • Ready does not mean an Evaluation has started.
  • Completed does not mean all metrics passed.
  • Verified does not mean the result passed a threshold.
  • Healthy does not prove Project files verify.
  • N/A does not mean a hidden manual review state.