
Your Agent Ran 400 Steps and Nobody Watched: Agent Observability
A practical spec for AI agent observability: what to capture in every trace — tool calls, token spend, decision forks, and the silent failures nobody logs.
Blog
Practical writing on productivity, AI, and building software.

A practical spec for AI agent observability: what to capture in every trace — tool calls, token spend, decision forks, and the silent failures nobody logs.

You don't need an ML platform to measure AI quality. A well-structured sheet turns vibes-based prompting into something you can actually score and improve.

Inside the eval harness we run on inbox triage, doc drafting, and calendar scheduling — the golden sets, the scoring rubrics, and the failure modes we refuse to ship.

Shared service accounts make agent activity untraceable. Here's how scoped per-agent identities, capability grants, and audit trails fix that.

Tamaton search spans mail, docs, and files — but every hit is checked against the caller's grants at query time, so an over-eager agent can't retrieve what it was never allowed to see.

New adoption data shows the biggest productivity gains go to people using purpose-built AI tools, not general chatbots. The difference isn't model quality — it's context and integration.

A field guide to choosing between deterministic automation and goal-seeking agents — with a decision tree, cost math, and the honest cases where a plain script still wins.

Model quality isn't your bottleneck anymore — context portability is. We map where the time actually goes in AI-assisted work, and what to fix first.

Every agent touching your inbox, files, and calendar is a non-human user with credentials and blast radius. Most orgs provision them like scripts and hope for the best.

Memory, not model size, decides whether an agent finishes a task or loops forever. Here's how planning, working memory, and retrieval actually fit together.

Mailboxes, files, and calendars are structured, timestamped, and permissioned — which is why naive vector search fails on them. Here's a retrieval design that works.

A practitioner's guide to when LLM-based forecasting earns its keep and when it's confidently extending a trend line into thin air.
Get started
Claim your address before someone else does — free to start, with an AI-native inbox built in.