Adding observability to RubyLLM with OpenTelemetry

[clarissalimab]

Hi everyone! 👋

I'm Clarissa, a developer at thoughtbot. I built an OpenTelemetry instrumentation gem for RubyLLM and wanted to share it with the community.

https://github.com/thoughtbot/opentelemetry-instrumentation-ruby_llm

It automatically instruments RubyLLM with traces that follow the Semantic conventions for generative AI systems. Chat completions, tool calls, token usage, and errors are all captured out of the box, so no manual tracing code is needed. Works with any OTel-compatible backend (Langfuse, Jaeger, Datadog, Honeycomb, Arize Phoenix, etc).

The minimal setup, along with OpenTelemetry, is:

OpenTelemetry::SDK.configure do |c|
  c.use 'OpenTelemetry::Instrumentation::RubyLLM'
end

Let me know if you have any feedback :)

---

Thank you for building RubyLLM, it's a really cool gem!