|
| 1 | +<div align="center"> |
| 2 | +<img src="https://github.com/openlit/.github/blob/main/profile/assets/wide-logo-no-bg.png?raw=true" alt="OpenLIT Logo" width="30%"> |
| 3 | + |
| 4 | +#### OpenTelemetry-native |
| 5 | + |
| 6 | +# Open Source Platform for AI Engineering |
| 7 | + |
| 8 | +**[GitHub](https://github.com/openlit/openlit/) | [Documentation](https://docs.openlit.io/) | [Quickstart](-getting-started-with-llm-observability)** |
| 9 | + |
| 10 | + |
| 11 | +[](https://github.com/openlit/openlit/blob/main/LICENSE) |
| 12 | +[](https://pepy.tech/project/openlit) |
| 13 | + |
| 14 | +[](https://join.slack.com/t/openlit/shared_invite/zt-2etnfttwg-TjP_7BZXfYg84oAukY8QRQ) |
| 15 | +[](https://twitter.com/openlit_io) |
| 16 | +</div> |
| 17 | + |
| 18 | +OpenLIT is an open-source tool that makes it simple to monitor the performance of LLMs, AI agents, and GPUs with just one line of code. |
| 19 | + |
| 20 | +It provides OpenTelemetry-native tracing and metrics to track important parameters like cost, latency, interactions and task sequences. |
| 21 | +This setup enables you to track hyperparameters and monitor for performance issues, helping you find ways to enhance and fine-tune your applications and agents over time. |
| 22 | + |
| 23 | +It provides: |
| 24 | + |
| 25 | +- π **Analytics Dashboard**: Monitor your AI application's health and performance with detailed dashboards that track metrics, costs, and user interactions, providing a clear view of overall efficiency. |
| 26 | +- π **OpenTelemetry-native Observability SDKs**: Vendor-neutral SDKs to send traces and metrics to your existing observability tools. |
| 27 | +- π² **Cost Tracking for Custom and Fine-Tuned Models**: Tailor cost estimations for specific models using custom pricing files for precise budgeting. |
| 28 | +- π **Exceptions Monitoring Dashboard**: Quickly spot and resolve issues by tracking common exceptions and errors with a dedicated monitoring dashboard. |
| 29 | +- π **Prompt Management**: Manage and version prompts using Prompt Hub for consistent and easy access across applications. |
| 30 | +- π **API Keys and Secrets Management**: Securely handle your API keys and secrets centrally, avoiding insecure practices. |
| 31 | + |
| 32 | +OpenLIT can be Self-hosted in your preferred environment |
| 33 | + |
| 34 | +## Installation |
| 35 | + |
| 36 | +The latest OpenLIT + Groq docs can be found [here](https://docs.openlit.io/latest/integrations/groq). |
| 37 | + |
| 38 | +## See it in action |
| 39 | + |
| 40 | +https://github.com/user-attachments/assets/6909bf4a-f5b4-4060-bde3-95e91fa36168 |
| 41 | + |
| 42 | +## Other Resources |
| 43 | +- π€ [Join the OpenLIT community](https://join.slack.com/t/openlit/shared_invite/zt-2etnfttwg-TjP_7BZXfYg84oAukY8QRQ) |
| 44 | +- π [Submit an issue or feature request](https://github.com/openlit/openlit/issues) |
0 commit comments