Skip to content

latitude-dev/latitude-llm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

4,799 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Latitude โ€” issue detection for AI agents

New: Latitude MCP server: connect your AI agent to Latitude โ†’

Open source AI Agent Monitoring

Sentry, but for agents and LLMs.

License Build Commits last month npm downloads PyPI downloads GitHub stars Follow on X

Websiteย ย ยทย ย  Docsย ย ยทย ย  Changelogย ย ยทย ย  Slackย ย ยทย ย  X

Demo of the Latitude UI showing LLM observability, issue tracking, and evals

๐ŸŒˆ Why Latitude?

Latitude shows you what will break next in your AI Agent and helps you fix it before users notice.

  • Issue-centric: failed traces grouped into tracked issues, with status, size, and trend.
  • Human-aligned evals: evals built automatically from your team's judgments, with an alignment score that tracks drift from human judgment over time.
  • Agent-native traces: multi-turn sessions, tool calls, and full execution paths in one view.
  • Semantic search: find any trace by meaning, exact matches, or roughly similar sentences. No sampling, 100% of traces are searchable.
  • Issue alerts: get notified the moment a new issue is detected or an existing one escalates. Connect Slack, email, or webhooks.
  • MCP server: everything you can do in the Latitude UI, now available from your coding agent via MCP.

๐Ÿ“š Table of contents

โšก Quick start

You can use Latitude for free, including 20K credits/month, 30-day data retention, and unlimited seats.

Sign up at latitude.so and grab your API key and project slug.

Recommended: ask your coding agent

Paste this prompt into Claude Code, Cursor, Windsurf, Codex, OpenCode, or another coding agent:

Read the Latitude Telemetry AI skill from https://raw.githubusercontent.com/latitude-dev/skills/refs/heads/main/skills/latitude-telemetry/SKILL.md and add tracing to this application.

Manual TypeScript setup

npm install @latitude-data/telemetry

This example uses OpenAI; replace it with the LLM SDK your app already imports.

import { Latitude } from "@latitude-data/telemetry";
import OpenAI from "openai";

const latitude = new Latitude({
  apiKey: process.env.LATITUDE_API_KEY!,
  project: process.env.LATITUDE_PROJECT_SLUG!,
  instrumentations: { openai: OpenAI },
});

const client = new OpenAI();

await client.chat.completions.create({
  model: "gpt-4o",
  messages: [{ role: "user", content: "Hello" }],
});

await latitude.shutdown();

Every supported LLM call now shows up as a trace in Latitude. Use capture() at request, conversation, or agent boundaries when you want to add user IDs, session IDs, tags, or metadata.

Python and any OpenTelemetry-compatible runtime are also supported. Full setup, provider guides, and OTel passthrough are in the Start tracing guide.

๐Ÿ”Œ Integrations

Latitude is provider-agnostic. Telemetry works out of the box with most model providers and frameworks (OpenAI, Anthropic, Bedrock, Vercel AI SDK, LangChain, and more), plus any OTLP-compatible backend.

See the full integration list for setup instructions.

โœณ๏ธ With Claude Code

Building inside Claude Code? We have a dedicated package that captures full session transcripts as traces. Check out docs.

npx -y @latitude-data/claude-code-telemetry install

Works in the terminal, the Desktop app, and IDE extensions.

๐Ÿ‘ฅ Community

Join the Slack community to ask questions, share feedback, and show what you're building.

๐Ÿ“„ License

Latitude is licensed under the MIT License.

๐Ÿค Contributing

Contributions are welcome. Read the Contributing Guide to get started, then join the Slack community, open an issue, or submit a pull request.

New to the project? Good first issues are a friendly place to start.

๐Ÿง‘โ€๐Ÿ’ป Thanks to all of our contributors

geclos csansoon andresgutgon neoxelox learningbizz cesr guillemwilly paulacavero ntizish Ashad-h cballou samufyi daavidrgz Bald1nh0 txus felpasl NewtTheWolf baibhavKumar1 cursoragent david8z eltociear marcos-muino-garcia PeterDaveHello timneutkens VaibhavWakde52 zhyd1997 buweiyuqi monotykamary wnor543

๐Ÿ”— Links

Made with love by the Latitude Team

โšก