Skip to content

Commit 27bcbf5

Browse files
authored
Add OpenLIT Integration Example Cookbook (#55)
1 parent c39865d commit 27bcbf5

File tree

5 files changed

+2308
-0
lines changed

5 files changed

+2308
-0
lines changed

β€ŽREADME.mdβ€Ž

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -55,6 +55,7 @@ Are you ready to cook? πŸš€ This is a collection of example code and guides for
5555
- [Langroid with Groq](/tutorials/langroid-llm-agents): Create a multi-agent system using Langroid and Groq.
5656
- [LiteLLM Proxy with Groq](/tutorials/litellm-proxy-groq): Call Groq through the LiteLLM proxy.
5757
- [Toolhouse with Groq](/tutorials/toolhouse-for-tool-use-with-groq-api): Use Toolhouse to create simple tool integrations with Groq.
58+
- [OpenTelemetry with Groq](/tutorials/opentelemetry-observability-groq): Integrate OpenTelemetry tracing and metrics for insights into Groq usage.
5859

5960
### Agentic
6061
- [Mixture of Agents](/tutorials/mixture-of-agents): Create a mixture-of-agents system powered by Groq.
Lines changed: 44 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,44 @@
1+
<div align="center">
2+
<img src="https://github.com/openlit/.github/blob/main/profile/assets/wide-logo-no-bg.png?raw=true" alt="OpenLIT Logo" width="30%">
3+
4+
#### OpenTelemetry-native
5+
6+
# Open Source Platform for AI Engineering
7+
8+
**[GitHub](https://github.com/openlit/openlit/) | [Documentation](https://docs.openlit.io/) | [Quickstart](-getting-started-with-llm-observability)**
9+
10+
11+
[![License](https://img.shields.io/github/license/openlit/openlit?label=License&logo=github&color=f80&logoColor=white)](https://github.com/openlit/openlit/blob/main/LICENSE)
12+
[![Downloads](https://static.pepy.tech/badge/openlit/month)](https://pepy.tech/project/openlit)
13+
14+
[![OpenLIT Slack](https://img.shields.io/badge/OpenLIT_Slack-4A154B?logo=slack&logoColor=white)](https://join.slack.com/t/openlit/shared_invite/zt-2etnfttwg-TjP_7BZXfYg84oAukY8QRQ)
15+
[![X](https://img.shields.io/badge/follow-%40openlit__io-1DA1F2?logo=x&style=social)](https://twitter.com/openlit_io)
16+
</div>
17+
18+
OpenLIT is an open-source tool that makes it simple to monitor the performance of LLMs, AI agents, and GPUs with just one line of code.
19+
20+
It provides OpenTelemetry-native tracing and metrics to track important parameters like cost, latency, interactions and task sequences.
21+
This setup enables you to track hyperparameters and monitor for performance issues, helping you find ways to enhance and fine-tune your applications and agents over time.
22+
23+
It provides:
24+
25+
- πŸ“ˆ **Analytics Dashboard**: Monitor your AI application's health and performance with detailed dashboards that track metrics, costs, and user interactions, providing a clear view of overall efficiency.
26+
- πŸ”Œ **OpenTelemetry-native Observability SDKs**: Vendor-neutral SDKs to send traces and metrics to your existing observability tools.
27+
- πŸ’² **Cost Tracking for Custom and Fine-Tuned Models**: Tailor cost estimations for specific models using custom pricing files for precise budgeting.
28+
- πŸ› **Exceptions Monitoring Dashboard**: Quickly spot and resolve issues by tracking common exceptions and errors with a dedicated monitoring dashboard.
29+
- πŸ’­ **Prompt Management**: Manage and version prompts using Prompt Hub for consistent and easy access across applications.
30+
- πŸ”‘ **API Keys and Secrets Management**: Securely handle your API keys and secrets centrally, avoiding insecure practices.
31+
32+
OpenLIT can be Self-hosted in your preferred environment
33+
34+
## Installation
35+
36+
The latest OpenLIT + Groq docs can be found [here](https://docs.openlit.io/latest/integrations/groq).
37+
38+
## See it in action
39+
40+
https://github.com/user-attachments/assets/6909bf4a-f5b4-4060-bde3-95e91fa36168
41+
42+
## Other Resources
43+
- 🀝 [Join the OpenLIT community](https://join.slack.com/t/openlit/shared_invite/zt-2etnfttwg-TjP_7BZXfYg84oAukY8QRQ)
44+
- πŸ› [Submit an issue or feature request](https://github.com/openlit/openlit/issues)

0 commit comments

Comments
Β (0)