Feature/vllm support #2981
Merged
Feature/vllm support #2981
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Add VllmLLM provider with OpenAI-compatible API - Support for environment variables (VLLM_BASE_URL, VLLM_API_KEY) - Complete tool calling support - Comprehensive test coverage - Documentation and usage examples - Production-ready implementation following mem0 patterns
|
|
|
Hi @NILAY1556, thanks for adding support for this. Can you please sign the CLA and resolve conflicts so that we can review the PR? |
|
yes sure , i resolved it and singed in . |
Dev-Khant
suggested changes
Jun 19, 2025
There was a problem hiding this comment.
Can you please add vLLM here as well: https://github.com/mem0ai/mem0/blob/main/docs/docs.json#L120?
docs/components/llms/models/vllm.mdx
Outdated
| title: vLLM | ||
| --- | ||
|
|
||
| vLLM is a high-performance inference engine for large language models that provides significant performance improvements for local inference. |
There was a problem hiding this comment.
Can you please add a link to vLLM docs here?
mem0/llms/vllm.py
Outdated
|
|
||
| try: | ||
| from openai import OpenAI | ||
| except ImportError: |
There was a problem hiding this comment.
We won't need this as openai gets installed with default installation.
Dev-Khant
reviewed
Jun 20, 2025
docs/components/llms/config.mdx
Outdated
| @@ -90,45 +92,39 @@ Config is essential for: | |||
| Here's a comprehensive list of all parameters that can be used across different LLMs: | |||
|
|
|||
| <Tabs> | |||
| <Tab title="Python"> | |||
There was a problem hiding this comment.
Why are we changing this?
Dev-Khant
approved these changes
Jun 23, 2025
|
Hey @NILAY1556, Thanks for the contribution! |
merlinfrombelgium
pushed a commit
to merlinfrombelgium/mem0
that referenced
this pull request
Jul 4, 2025
Gradonhf
pushed a commit
to Gradonhf/mem0
that referenced
this pull request
Jul 11, 2025
brockshanson
pushed a commit
to brockshanson/mem0
that referenced
this pull request
Jul 30, 2025
thestumonkey
pushed a commit
to thestumonkey/mem0
that referenced
this pull request
Sep 7, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
mem0 vllm support
Fixes #2918
Type of change
How Has This Been Tested?
Checklist: