Skills / Run It in Production / AI in production
Dory Dial

AI Memory & Bias Audit

Sets how much an AI system remembers and how much it varies, then runs a Bias Audit that produces evidence, not opinion.

Private skill · shared by invitation · How access works

Illustrative output of AI Memory & Bias Audit: Sets how much an AI system remembers and how much it varies, then runs a Bias Audit that produces evidence, not opinion.
Illustrative output with sample data.
The challenge

You were asked to evidence your AI is not biased. You sent them the policy.

Memory treated as a feature

More context is assumed to be better, and it isn't always.

Two axes conflated

Memory and randomness are independent, and configurations mix them up.

Controls that don't exist

Vendors imply knobs the platform doesn't have.

No evidence

Policies describe fairness without testing it.

How it works

From first question to finished output.

Pick the surface

Map the dial to the controls your platform actually exposes.

Choose a preset

Four starting presets across memory and variance, with the fabrication risk stated.

Run the Bias Audit

The same decision at full, partial and no context, matched pairs, five or more runs.

Read the deltas

What moves when context is stripped is what the context was doing.

What you get

  • Memory and variance settings mapped to real platform controls
  • Bias Audit: the same query at 0, 50 and 100%, matched pairs, five-plus runs. The deltas are the bias
  • A plain statement of which controls do not exist

What goes in

The AI system, its configuration, and the queries that matter to the business.

Time to answer

As a consulting engagement6 weeks2 people · 12 consultant-weeks
Running the skill1–2 hours plus audit runsone sitting, then repeatable audits

What it still needs from you

Deciding what level of variance the business will accept.

Also in Run It in Production

See where this fits in the sequence →

See AI Memory & Bias Audit in action.

Thirty minutes with Harveer, on your own data problem.