Pharos Production ยท Technical reference

Model adapter acceptance worksheet

Record capability refusal, answer scope and failures before or after visible output.

Use this acceptance worksheet when changing a model adapter. These are proposed checks and fictional records, with no current provider feature comparison or executed model evaluation.

Start with the operation the caller requested

Write the model identifier, immutable model revision, adapter revision and requested input type before testing. An accepted request shape does not establish equivalent behavior. A declared capability needs an observable acceptance or refusal rule.

Acceptance checks to record for one configured adapter
BoundaryInput to exerciseEvidence to retain
Text scopeAnswer [A], with a distinct reasoning span mentioning [B].Exact answer and reasoning fields; markers counted from the answer only.
Unsupported inputAn image with a model configured without vision.Explicit refusal and whether any provider request occurred.
Before outputAn eligible transient failure before any visible delta.Retry policy decision and attempt identity.
After outputA terminal error after one visible delta.Preserved partial answer and terminal error; any duplicate generation.
SpeechA transcript with segment time coordinates.Segment boundaries and operation identity in a separate transcription contract.

Read The Capabilities Behind a Swappable LLM Interface for the historical adapter case. Its diagnosis does not establish that every later model configuration was retested.

Keep an unexecuted test visibly unexecuted

Copy this fictional record as a worksheet. Replace the model and adapter references with immutable revisions before a real run. Leave each observation open until the corresponding path has been exercised.

{"record_id":"adapter-worksheet-example","fixture_origin":"synthetic",
 "model_revision":null,"adapter_revision":null,
 "input_kind":"image","declared_vision":false,
 "expected_behavior":"explicit refusal before provider call",
 "observed_behavior":"NOT_RUN","provider_call_observed":null,
 "review_status":"NOT_REVIEWED","release_eligible":false}

For the stream checks, add the first delivered delta, attempt identifier and terminal event to the record. Record the configured retry condition before inducing a failure. A deterministic double can test local handling; a real configured model path needs its own observation.

Use the worksheet with a decision record

Open the existing Decision Lab to retain the decision inputs and missing evidence. Its framework snapshot has a historical cutoff. This worksheet adds no feature claim to that snapshot and grants no operational permission.

Before accepting a replacement, review a mismatch against the caller's contract. Keep unknown behavior unresolved rather than treating the absence of a captured error as success.