Trust, Data Rights, and Accountability

Trust infrastructure (executive framing)

The Attention Economy

Herbert Simon on Information

What information consumes is rather obvious: it consumes the attention of its recipients. Hence a wealth of information creates a poverty of attention …

Simon (1971)

Executive framing

  • If attention is the bottleneck, then influence is the prize.
  • Privacy is not “compliance”: it is control of information flows.
  • Ethics is not “values statements”: it is recourse, auditability, and accountable escalation.

System Zero: influence below awareness

.

.

What makes System Zero risky at scale

  • Asymmetry: systems see more about us than we see about them.
  • Homogeneity: one ranking model becomes a society-wide control surface.
  • Optimisation: incentives push toward engagement/manipulation unless constrained.

Data rights, governance, and recourse

Embodiment Factors

bits/min billions 2,000
billion
calculations/s
~100 a billion
embodiment 20 minutes 5 billion years

Data Rights

GDPR Origins

Feudal Era Data Ecosystem

Information Barons threaten our Privacy

Personal Data Trusts

Recourse and accountability (minimum viable)

  • Right to challenge: how can someone appeal a decision?
  • Right to explanation: what evidence is recorded and reviewable?
  • Named owner: who is accountable for outcomes (not just the tooling)?
  • Escalation path: when do we pause automation and revert to humans?

Agent-era governance checklist

  • Log what the agent saw, what tools it used, and what it changed.
  • Limit blast radius: scopes, rate limits, sandboxes, and kill switches.
  • Monitor drift/novelty and route to human escalation.
  • Treat failures as incidents: postmortems and control upgrades.

Thanks!

References

Lawrence, N.D., 2017. Living together: Mind and machine intelligence. arXiv.
Simon, H.A., 1971. Designing organizations for an information-rich world. Johns Hopkins University Press, Baltimore, MD.