Trace all your agentsUse all your tracesImprove all your workflows

thirdeye logo

Comprehensive observability and agent-oriented analytics for your local harness, with Pydantic Logfire integration

$brew install duncankmckinnon/tap/thirdeye

How it works

Install

One command, including the browser UI and Logfire support.

$ brew install duncankmckinnon/tap/thirdeye

Wire it up

Set up tracing, agent skills, and optional Logfire sync in one guided flow.

$ thirdeye setup

Understand & improve your workflow

List, tail, search, tag, and evaluate every session

$ thirdeye list && thirdeye search "auth refactor" --tag review

From session to insight in two commands

Search and inspect
$ thirdeye search "OAuth bug" --tag review
4 result(s) — claude (2), codex (1), cursor (1)
$ thirdeye events sess_3f9e2a
[seq 12] tool_use Edit auth/oauth.py
[seq 13] tool_result ok
[seq 14] message user "still failing on refresh"
[seq 31] tool_use Bash pytest tests/test_oauth.py
Evaluate a session
$ thirdeye eval run sess_3f9e2a \
--agent claude --using token-efficiency
→ dispatching claude in read-only mode...
✓ completed in 41s
VERDICT: warn
findings:
seq 12 redundant Edit before reading file
seq 31 test rerun could have been targeted

Everything you need to see what your agents did

Claude + Codex + Cursor capture

Three coding-agent harnesses, one unified local history and trace model.

Local-first storage

Everything stays in ~/.thirdeye/. No account or remote service required.

Pydantic Logfire export

Optionally mirror completed turns as nested OpenTelemetry traces without adding hook latency.

Per-turn token usage

JSONL sidecars + a SQLite index. Roll up by model, time, or platform.

Tag & search

Annotate any event with tags. Search substring or filter by platform, tag, or date.

Evals as rubrics

Named directive rubrics graded by an installed CLI agent as LLM-as-judge.

Sync to Logfire

Mirror completed agent turns to Pydantic Logfire as structured traces.

$ thirdeye logfire enable
Set up Logfire

Pair with workbench

Dispatch parallel agents and watch the trail unfold.

Set up the integration

Open Thirdeye UI

Explore sessions, evals, usage, and settings in a local browser.

$ thirdeye ui
thirdeye
tags
bugreviewauditexemplarrefactormigration
Ask
4 sessions
sessionplatformcwdstartedeventsstatus
a3f2c8b1claudethrdi-web2026-05-22 14:0847open
91e4d20acodexthirdeye2026-05-22 11:0391closed
7d12c9b3claudewbcli-web2026-05-21 18:4123closed
4e0f6b88codexworkbench2026-05-20 09:1412closed

Live preview — not interactive. The real UI streams open sessions via SSE and persists filters in localStorage.

Explore the UI