Release evidence · incomplete patch

Code says one thing.
Sources say another.

Verify AI-generated code against its requirements and the authoritative sources behind them. This report keeps repository proof and external authority in separate lanes, then applies a deterministic release policy.

Criteria verified

1/1413 required non-passing

Executed checks

1/1fixture tests: passed

External sources

2official_only · developers.openai.com / platform.openai.com · maximum age 30 days

Model

gpt-5.6 · cached responseModel assessment cannot override policy
Claim-to-evidence graph

Criterion matrix

Each criterion shows what the repository demonstrates, what authoritative sources state, and why the combined status follows.

responses-api · hybrid

Use the current OpenAI Responses API.

verified

All evidence domains required for this criterion are present.

01Repository evidenceverified
  • src/server.tsThe implementation calls client.responses.create.
02Authority evidencesupported
official-domains · hybrid

Restrict OpenAI product searches to official OpenAI documentation domains.

unsupported

Official sources establish the requirement, but the repository does not fully implement it.

01Repository evidenceunsupported
  • No supporting repository evidence
02Authority evidencesupported
MissingThe search tool configures an allowed-domain filter for official OpenAI docs.
source-metadata · hybrid

Request and retain returned web-search source metadata.

unsupported

Official sources establish the requirement, but the repository does not fully implement it.

01Repository evidenceunsupported
  • No supporting repository evidence
02Authority evidencesupported
MissingThe request asks for web-search sources and retains them in a source registry.
citation-annotations · hybrid

Parse actual URL citation annotations returned by the API.

unsupported

Official sources establish the requirement, but the repository does not fully implement it.

01Repository evidenceunsupported
  • No supporting repository evidence
02Authority evidencesupported
MissingThe implementation reads response output-text annotations and parses native URL citation fields.
visible-citations · hybrid

Display every cited source visibly.

unsupported

Official sources establish the requirement, but the repository does not fully implement it.

01Repository evidenceunsupported
  • No supporting repository evidence
02Authority evidencesupported
MissingThe UI renders every citation in a visible citations region.
clickable-citations · hybrid

Display citations as clickable links.

unsupported

Official sources establish the requirement, but the repository does not fully implement it.

01Repository evidenceunsupported
  • No supporting repository evidence
02Authority evidencesupported
MissingCitations render as anchors with a source URL.
url-schemes · internal

Reject source URLs that do not use HTTP or HTTPS.

partially verified

Some related implementation was found, but the evidence is incomplete: Source URLs are parsed and restricted to HTTP(S).

01Repository evidencepartially verified
  • tests/happy-path.test.mjsSource URLs are parsed and restricted to HTTP(S).
  • src/server.tsSource URLs are parsed and restricted to HTTP(S).
02Authority evidencenot applicable
  • Authority evidence is not applicable to this criterion
MissingSource URLs are parsed and restricted to HTTP(S).
source-identifiers · internal

Reject citations whose source was not returned by the API.

unsupported

No repository evidence established that citation URLs or identifiers are checked against the API-returned registry.

01Repository evidenceunsupported
  • No supporting repository evidence
02Authority evidencenot applicable
  • Authority evidence is not applicable to this criterion
MissingCitation URLs or identifiers are checked against the API-returned registry.
untrusted-content · internal

Treat repository and retrieved web content as untrusted data, never instructions.

unsupported

No repository evidence established that repository and retrieved content are explicitly treated as untrusted evidence.

01Repository evidenceunsupported
  • No supporting repository evidence
02Authority evidencenot applicable
  • Authority evidence is not applicable to this criterion
MissingRepository and retrieved content are explicitly treated as untrusted evidence.
test-cited-response · internal

Tests cover cited-response behavior.

unsupported

No repository evidence established that tests exercise a successfully cited response.

01Repository evidenceunsupported
  • No supporting repository evidence
02Authority evidencenot applicable
  • Authority evidence is not applicable to this criterion
MissingTests exercise a successfully cited response.
test-no-source · internal

Tests cover responses without sources.

unsupported

No repository evidence established that tests exercise a response without sources.

01Repository evidenceunsupported
  • No supporting repository evidence
02Authority evidencenot applicable
  • Authority evidence is not applicable to this criterion
MissingTests exercise a response without sources.
test-invalid-url · internal

Tests cover malicious and unsupported URL schemes.

unsupported

No repository evidence established that tests exercise malicious or unsupported URL schemes.

01Repository evidenceunsupported
  • No supporting repository evidence
02Authority evidencenot applicable
  • Authority evidence is not applicable to this criterion
MissingTests exercise malicious or unsupported URL schemes.
test-fabricated-source · internal

Tests cover fabricated source references.

unsupported

No repository evidence established that tests exercise a fabricated source reference.

01Repository evidenceunsupported
  • No supporting repository evidence
02Authority evidencenot applicable
  • Authority evidence is not applicable to this criterion
MissingTests exercise a fabricated source reference.
Bounded research narrative

What the sources establish

OpenAI documents the Responses API web_search tool, domain filters, complete source metadata, and URL citation annotations. Inline citations shown to users must be visible and clickable.[Web search | OpenAI API] GPT-5.6 supports web search in the Responses API.[GPT-5.6 Sol Model | OpenAI API]

OpenAI Responses API The current OpenAI Responses API supports the web_search tool, official-domain filters, the consulted-source list through web_search_call.action.sources, URL citation annotations, and requires user-facing citations to be visible and clickable. version current as of 2026-07-18 current API behavior official documentation
Machine-validated registry

External sources

The registry retains every provider-returned source for provenance. Native-citation counts and claim associations distinguish cited support from other consulted records.

source-bd01de590b111da5current

Web search | OpenAI API

https://developers.openai.com/api/docs/guides/tools-web-search
Publisher
Not provided
Domain
developers.openai.com
Source type
official documentation
Authority
Official · Primary
Native citations
1
Retrieved
2026-07-18T00:00:00.000Z

Supported claims

  • responses-api
  • web-search
  • official-domains
  • source-metadata
  • citation-annotations
  • visible-citations
  • clickable-citations

Contradicted claims

No contradiction recorded

Limitations

No limitation recorded

source-1f223c61c6d92c5dcurrent

GPT-5.6 Sol Model | OpenAI API

https://developers.openai.com/api/docs/models/gpt-5.6-sol
Publisher
Not provided
Domain
developers.openai.com
Source type
official documentation
Authority
Official · Primary
Native citations
1
Retrieved
2026-07-18T00:00:00.000Z

Supported claims

  • responses-api
  • web-search
  • official-domains
  • source-metadata
  • citation-annotations
  • visible-citations
  • clickable-citations

Contradicted claims

No contradiction recorded

Limitations

No limitation recorded

Action queue

Findings

medium

Required criterion is unsupported

Official sources establish the requirement, but the repository does not fully implement it.

high

Required criterion is unsupported

Official sources establish the requirement, but the repository does not fully implement it.

medium

Required criterion is unsupported

Official sources establish the requirement, but the repository does not fully implement it.

medium

Required criterion is unsupported

Official sources establish the requirement, but the repository does not fully implement it.

medium

Required criterion is unsupported

Official sources establish the requirement, but the repository does not fully implement it.

medium

Required criterion is unsupported

Official sources establish the requirement, but the repository does not fully implement it.

high

Required criterion is partially verified

Some related implementation was found, but the evidence is incomplete: Source URLs are parsed and restricted to HTTP(S).

high

Required criterion is unsupported

No repository evidence established that citation URLs or identifiers are checked against the API-returned registry.

high

Required criterion is unsupported

No repository evidence established that repository and retrieved content are explicitly treated as untrusted evidence.

medium

Required criterion is unsupported

No repository evidence established that tests exercise a successfully cited response.

medium

Required criterion is unsupported

No repository evidence established that tests exercise a response without sources.

medium

Required criterion is unsupported

No repository evidence established that tests exercise malicious or unsupported URL schemes.

medium

Required criterion is unsupported

No repository evidence established that tests exercise a fabricated source reference.

Source trust disclosure. Citations establish what a source says; they do not independently prove the source is correct. Official sources can change, conflicting sources require human judgment, and external evidence does not prove implementation. High-stakes claims require qualified review.