Essay

Theory

3 min reading · 549 words

A Tool Is Not a Witness

Why an output can be useful evidence without being a speaker with a stake.

A witness is not simply something that produces information. A camera can record a street. A sensor can report a temperature. A spreadsheet can preserve a sequence of transactions. Those outputs may matter enormously, but the instrument is not the person who can be questioned about what it saw, why it framed the scene as it did, or what it loses by being wrong. A witness has a relation to an event and can be accountable for a report. A tool has a designed relation to inputs and outputs.

This is not a claim that tools are unimportant. It is a claim about where responsibility lives. When a model is used to summarize a legal file, recommend a treatment, flag a student, or invent a biography, the question is not whether its prose has a point of view. The question is which people and institutions selected the task, set the thresholds, chose the data, approved the deployment, and have the power to repair an error. Accountability is not consciousness, but it also cannot be outsourced to a sentence generator.

The grammar of a report can mislead

Interfaces encourage us to say that a system 'thinks,' 'knows,' 'believes,' or 'admits.' Sometimes this is harmless shorthand. Sometimes it quietly changes the legal and moral picture. A model can output a confident first-person explanation for a score or recommendation even when that explanation is not a record of a private deliberation. It may be a plausible continuation shaped by the request, the context window, and a product's training and guardrails. Treating it as testimony makes a performance look like an accountable act.

The distinction resembles an old philosophical debate, but it has ordinary consequences. Arguments about form and meaning ask whether matching the outward form of language demonstrates the kind of understanding language ordinarily expresses. The answer need not be settled to reject a much simpler inference: a polished sentence is not a sworn statement. The source of authority belongs to the people who decide how to use it.

Evidence can still be evidence

A tool's output can be probative. A system may identify a pattern worth investigating, translate a document, retrieve a lead, or surface a discrepancy. The right response is not to banish the output from view. It is to preserve the chain of interpretation: what data entered, what task was specified, what error rate or uncertainty was known, who reviewed the result, and what recourse exists for a person affected by it.

  • Ask what the system measured, predicted, generated, or retrieved.
  • Ask what human decision converted that output into an action.
  • Ask who can explain, contest, and repair that action.
  • Do not let a first-person interface erase the chain.

Calling a tool a witness can be especially tempting when an organization wants an aura of neutrality. A system sounds less like a vendor's product and more like an independent observer. But a model is embedded in a supply chain of energy, labor, data, hardware, policy, and profit. It does not become disinterested because its screen speaks in a calm voice.

An instrument may extend observation. It does not automatically inherit the obligations of an observer.
From the Field Manual

Read this essay beside Anthropomorphism Is an Interface Choice and The Operator Is Not Optional. Together they offer a less enchanted description: the system can be impressive, useful, and sometimes dangerous without becoming the party to whom public institutions owe their first duty.

Continue the route

Related work.

Search the field archive

Type a word or browse the suggested paths below.

Open the full libraryTrace an argumentRead source notes

Local reading list

Nothing saved yet. Use “Save +” on any work; your list stays in this browser only.