LLMonitor

0

Open-source monitoring & analytics for AI apps and agent

Observability

ai
llm
logs
monitoring

Lunary Logo

lunary

Developer toolkit for LLM chatbots

website - docs

npm version PyPI - Version GitHub last commit (by committer) GitHub commit activity (branch)

Features

Lunary helps developers of LLM Chatbots develop and improve them.

  • ๐Ÿ–ฒ๏ธ Conversation & feedback tracking
  • ๐Ÿ’ต Analytics (costs, token, latency, ..)
  • ๐Ÿ” Debugging (logs, traces, user tracking, ..)
  • โ›ฉ๏ธ Prompt Directory (versioning, team collaboration, ..)
  • ๐Ÿท๏ธ Create fine-tuning datasets
  • ๐Ÿงช Automatic topic classification

It also designed to be:

  • ๐Ÿค– Usable with any model, not just OpenAI
  • ๐Ÿ“ฆ Easy to integrate (2 minutes)
  • ๐Ÿง‘โ€๐Ÿ’ป Self-hostable

1-min Demo

https://github.com/lunary-ai/lunary/assets/5092466/a2b4ba9b-4afb-46e3-9b6b-faf7ddb4a931

โš™๏ธ Integration

Modules available for:

Lunary natively supports:

Additionally you can use it with any other LLM by manually sending events.

๐Ÿ“š Documentation

Full documentation is available on the website.

โ˜๏ธ Hosted version

We offer a hosted version with a free plan of up to 10k requests / month.

With the hosted version:

  • ๐Ÿ‘ท don't worry about devops or managing updates
  • ๐Ÿ™‹ get priority 1:1 support with our team
  • ๐Ÿ‡ช๐Ÿ‡บ your data is stored safely in Europe

Running locally

  1. Clone the repository
  2. Setup a PostgreSQL instance (version 15 minimum)
  3. Copy the content of packages/backend/.env.example to packages/backend/.env and fill the missing values
  4. Copy the content of packages/frontend/.env.example to packages/frontend/.env and fill the missing values
  5. Run npm install
  6. Run npm run migrate:db
  7. Run npm run dev

You can now open the dashboard at http://localhost:8080. When using our JS or Python SDK, you need to set the environment variable LUNARY_API_URL to http://localhost:3333. You can use LUNARY_VERBOSE=True to see all the event sent by the SDK

๐Ÿ™‹ Support

Need help or have questions? Chat with us on the website or email us: hello [at] lunary.ai. We're here to help every step of the way.

License

This project is licensed under the Apache 2.0 License.