hypothesis HY-COMM-2026-0001

Procedural documentation is the highest-value first vertical slice

Hypothesis

Statement

A bounded procedural-documentation comparison is a better first pilot than an exhaustive style taxonomy or a persuasion study because it offers controlled inputs, observable user goals, low-risk synthetic tasks, and multiple outcome measures.

Mechanism

Procedures map communication to visible actions. This makes failures, errors, effort, and successful completion observable while still exercising wording, sequencing, hierarchy, examples, and audience expertise.

Predictions

  • Two materially different instruction variants will produce detectable differences in at least one of task success, error count, time, or confidence calibration.
  • Preference and task performance will sometimes diverge.
  • Effects will vary with participant expertise and task complexity.

Evidence that would support it

A preregistered pilot can recruit representative users, execute safely with synthetic material, and yield reliable outcome differences.

Evidence that would contradict it

Recruitment is infeasible; realistic tasks require sensitive data; ceiling effects dominate; or outcomes cannot discriminate variants at feasible sample sizes.

Tests performed

Comparative desk assessment against the mission criteria and established usability measurement frameworks. No participant experiment has run.

Results

Provisionally supported for selecting the next research project, not yet validated as a product use case.

Falsification attempts

Considered exhaustive taxonomy, generic readability scoring, persuasion, and high-stakes health/legal instructions. Taxonomy lacks a near-term behavioral criterion; readability is an inadequate outcome proxy; persuasion introduces ethical/confounding risks; high-stakes domains raise avoidable safety risks.

Current assessment

Medium confidence. The decisive missing evidence is feasibility and stakeholder value for a specific procedural task.

Next experiment

Compare two versions of a synthetic, multi-step software setup or data-transformation instruction with representative participants.