AI audit log

What each entry records

When and what

Timestamp, feature, provider and model, and the run id that groups an evaluation run's calls.

Input

The full system prompt and user prompt, the JSON schema the reply was held to, and the generation settings (temperature, output-token limit, thinking effort). Never the API key.

Output

The raw reply, the parsed JSON when it matched the schema, the validation error when it did not, and the provider's message and category when the model refused.

Cost and speed

The final attempt's response time, the total time over all attempts (retries and back-off waits included), the stop reason and token usage as reported by the provider.

Human decision

Pending, accepted or rejected, with an optional note saying why: set here, or next to the answer in the evaluation. (The log also supports “edited” for features whose output a person can change; the Card Table evaluation has none.)

Entries are scrubbed for your key before they are stored. Your provider keeps its own records under its own terms. How AI is used here is set out in the AI use statement.