Skip to content

feat: Adding nixl read() multimodal support for vLLM backend #4271

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
KrishnanPrash wants to merge 22 commits into
base: main
Choose a base branch
from
Open

feat: Adding nixl read() multimodal support for vLLM backend #4271

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
b9f3484
feat: decoded media via NIXL
milesial Nov 10, 2025
b6ca505
feat: NIXL stub support
milesial Nov 8, 2025
f145c1c
chore: cleanups
milesial Nov 10, 2025
cb0d388
fix: image-rs serde
milesial Nov 10, 2025
b0221bb
feat: switch to media-nixl feature flag
milesial Nov 10, 2025
a2687d2
chore: cleanups
milesial Nov 10, 2025
cfee423
feat: decoded media via NIXL
milesial Nov 10, 2025
43a3f0c
feat: NIXL stub support
milesial Nov 8, 2025
01f94d6
chore: cleanups
milesial Nov 10, 2025
0aabc41
fix: image-rs serde
milesial Nov 11, 2025
d33d718
feat: switch to media-nixl feature flag
milesial Nov 10, 2025
94d027d
chore: cleanups
milesial Nov 10, 2025
518e768
Initial Working Version
KrishnanPrash Nov 12, 2025
76a4683
Simplified workflow
KrishnanPrash Nov 12, 2025
3089249
Merge branch 'alexandrem/frontend-image-decoding-nixl' into kprashant…
KrishnanPrash Nov 13, 2025
e5c495b
Cleaning up comments + Logs
KrishnanPrash Nov 13, 2025
90fcf54
Merge branch 'main' into alexandrem/frontend-image-decoding-nixl
ayushag-nv Nov 14, 2025
8343753
Merge branch 'main' into alexandrem/frontend-image-decoding-nixl
ayushag-nv Nov 17, 2025
5b89fdc
Merge branch 'main' into alexandrem/frontend-image-decoding-nixl
ayushag-nv Nov 21, 2025
1d67335
Removing duplicate moxcms in Cargo.lock
KrishnanPrash Nov 24, 2025
0e2af92
Merge branch 'alexandrem/frontend-image-decoding-nixl' into kprashant…
KrishnanPrash Nov 24, 2025
7f41e85
update variable name + add --frontend-decoding flag
KrishnanPrash Nov 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix: image-rs serde 
Signed-off-by: Alexandre Milesi <[email protected]>
  • Loading branch information
@milesial
milesial committed Nov 10, 2025
commit cb0d38806c3934c694867b44ec153a671ff5d9ff
12 changes: 6 additions & 6 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

83 changes: 65 additions & 18 deletions lib/bindings/python/Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion lib/llm/Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -145,7 +145,7 @@ json-five = { version = "0.3" }
# media loading in the preprocessor
reqwest = { workspace = true }
base64 = { version = "0.22" }
image = { version = "0.25", features = ["default", "serde"] }
image = { version = "0.25", features = ["serde"] }
tokio-rayon = {version = "2" }
ndarray = { version = "0.16" }

Expand Down