Skip to content

Gradio Web Server for Multimodal Models #2960

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merrymercy merged 16 commits into from
Feb 10, 2024
Merged

Gradio Web Server for Multimodal Models #2960

Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
9eba123
Move <image> tokens to openai_server
BabyChouSr Jan 25, 2024
10f63a2
Add gradio vision block and have workers register themselves as multi…
BabyChouSr Jan 25, 2024
606f7f7
Add gradio web server demo
BabyChouSr Jan 25, 2024
eafd1aa
Address comments and test using llava v1.6
BabyChouSr Feb 1, 2024
6b17f34
Merge branch 'main' into gradio-multi
BabyChouSr Feb 7, 2024
19375f7
format
BabyChouSr Feb 7, 2024
f976725
Add hashing images and storing them in server
BabyChouSr Feb 7, 2024
cd019e6
Fix
BabyChouSr Feb 7, 2024
9695257
Merge remote-tracking branch 'origin/main' into gradio-multi
merrymercy Feb 10, 2024
77dc1f3
update gradio version
merrymercy Feb 10, 2024
6a4d1dd
update
merrymercy Feb 10, 2024
d0d319f
format
merrymercy Feb 10, 2024
8997ad1
fix pydantic
merrymercy Feb 10, 2024
4e3132c
update
merrymercy Feb 10, 2024
93a1e84
update
merrymercy Feb 10, 2024
7bb8f11
format
merrymercy Feb 10, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
format
  • Loading branch information
@BabyChouSr
BabyChouSr committed Feb 7, 2024
commit 19375f788c016fc1b2ae2cab018bb760b2e24f9d
8 changes: 2 additions & 6 deletions fastchat/serve/gradio_web_server.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -197,9 +197,7 @@ def load_demo(url_params, request: gr.Request):

if args.model_list_mode == "reload":
models, all_models = get_model_list(
controller_url,
args.register_api_endpoint_file,
False
controller_url, args.register_api_endpoint_file, False
)

return load_demo_single(models, url_params)
Expand Down Expand Up @@ -955,9 +953,7 @@ def build_demo(models):
# Set global variables
set_global_vars(args.controller_url, args.moderate)
models, all_models = get_model_list(
args.controller_url,
args.register_api_endpoint_file,
False
args.controller_url, args.register_api_endpoint_file, False
)

# Set authorization credentials
Expand Down