AI Observability with Grafana

Ever added AI to a Drupal site and wondered which model actually ran, how slow it was, how many tokens it used and what that cost? And when an AI agent calls sub-agents, what really happened inside?

This video shows a complete, self-hosted AI observability stack for Drupal that answers all of it - built and running in one command.

Using the One Line Installer, we spin up a Drupal site wired to Grafana, Tempo, Mimir, Loki and Alloy, then watch every AI call show up live: request rate and latency, token usage, real cost priced from models.dev, and a full parent to sub-agent trace where you can read the actual prompts and responses flowing between agents.

Everything is open source, provider-agnostic (OpenAI, Anthropic, Gemini, Mistral, Fireworks and more) and self-hosted - your prompts and data never leave the box.

What's covered:

One command to build Drupal plus a full observability stack and demo AI agents. How the pieces fit together: the AI Observability module sends data over OpenTelemetry to Alloy, which routes traces to Tempo, metrics to Mimir and logs to Loki, all visualized in Grafana. The requests overview with rate, errors and latency. The token and cost dashboard with live pricing from models.dev. And the AI Agent Sessions view, with a nested agent to sub-agent tree and the prompt-and-response message flow between them.

Links:

AI Observability OpenTelemetry recipe: https://www.drupal.org/project/ai_observability_opentel_recipe

One Line Installer: https://www.drupal.org/project/one_line_installer

Drupal AI module: https://www.drupal.org/project/ai

Model pricing data: https://models.dev

Complexity
Full Setup