GrowthOS
Illustrative reconstruction

Task study · Methodology v0.1

An agent installs an SDK and sends the first valid event

An illustrative task reconstruction showing how a browser-only authentication path creates a barrier, how the agent recovers, and how a documentation treatment can be compared in a controlled Eval.

Illustrative reconstructionEVIDENCE SEQUENCE
  1. 01
    Task

    Define the objective and observable completion criterion.

  2. 02
    Original journey

    Reconstruct the cross-surface production path.

  3. 03
    Evidence

    Attach signals and confidence to every connection.

  4. 04
    Barrier

    Name the point that prevented completion.

  5. 05
    Treatment

    Change one product condition for comparison.

  6. 06
    Controlled Eval

    Run the same task under shared criteria.

  7. 07
    Result

    Compare completion, friction, and trajectory.

  8. 08
    Production verification

    Check the next real-world outcome when available.

Objective
Send the first valid product event.
Task
Discover the TypeScript SDK, configure access, install the package, send an event, and validate the observable result.
Completion criterion
The product accepts a valid event and the backend records the matching receipt.
Category
Developer tools
Surfaces
Docs · Auth · API · SDK · Backend
Agents / models
Agent A / Model 1
Sample / time window
1 / Illustrative scenario; no production time window
Evidence confidence
strong
Original outcome
blocked
Barrier
The authentication guide exposes a browser-only credential path and omits an agent-readable scope example.
Treatment
Add a machine-readable scoped-token example to the documentation and link it from the SDK quickstart.
Eval outcome
passed
Controlled result
The illustrative treatment run completed without a retry; the illustrative baseline remained blocked at authentication.
Production verification
not-applicable
Production result
No production verification exists because this is an illustrative reconstruction, not observed customer activity.

Task

The agent must discover the TypeScript SDK, configure access, install the package, send the first valid event, and confirm that the backend received it.

Original journey

The illustrative journey crosses documentation, authentication, API reference, SDK, and backend surfaces. The path is reconstructed as a task graph instead of treated as one browser session.

Evidence

Documentation selection and the final response are exact signals. The authentication-to-API recovery is strong to probable because the illustrative evidence connects resources and timing without claiming a permanent agent identity.

Barrier

The quickstart relies on a browser-only credential path and does not expose a machine-readable scope example. The agent receives an authentication failure before recovering through a separate API reference.

Treatment

The controlled treatment adds an agent-readable scoped-token example to the authentication documentation and links it directly from the SDK quickstart.

Controlled Eval

The illustrative baseline and treatment use the same task, completion criterion, environment, agent label, and model label. Only the documentation treatment changes.

Result

The illustrative treatment completes without a retry. This is an example of the evidence structure GrowthOS can produce, not a measured customer lift or a general model-performance claim.

Production verification status

Not applicable. No production verification exists for illustrative evidence.

Notes on limitations

The scenario is synthetic, the sample size is one, and the result cannot support an ATCR change, customer claim, product ranking, agent ranking, or model ranking.

Limitations

  • This study uses illustrative data and is not customer evidence.
  • The controlled result does not establish production impact.
  • The sample size is intentionally one scenario and cannot support product, agent, or model rankings.

Bring us the task your product should complete.

We’ll scope the evidence surfaces, success criterion, and first useful reconstruction.