Merge branch 'feature/gui'

Author: ControlNet

.gitignore

@@ -392,4 +392,55 @@ pixi.lock
 *.jpg
 *.jsonl
 *.scl
-*.pl
+*.pl
+
+# Build artifacts
+gui/build/
+gui/.svelte-kit/
+gui/node_modules/
+gui/dist/
+
+# Logs
+*.log
+logs/
+
+# Environment variables
+.env.local
+
+# Python
+__pycache__/
+*.py[cod]
+*$py.class
+*.so
+.Python
+env/
+venv/
+ENV/
+env.bak/
+venv.bak/
+
+# Temporary files
+temp/
+tmp/
+*.tmp
+
+# IDE
+.vscode/
+.idea/
+*.swp
+*.swo
+
+# OS
+.DS_Store
+Thumbs.db
+
+# Coverage
+.coverage
+htmlcov/
+
+# Distribution
+*.egg-info/
+dist/
+build/
+
+!gui/src/lib

README.md

@@ -45,7 +45,7 @@
 ## TODOs
 
 We're working on the following TODOs:
-- [ ] GUI demo.
+- [x] GUI demo.
 - [ ] Support more LLMs.
 - [ ] Video demo & slides presentation.
 
@@ -101,6 +101,18 @@ python -m hydra_vl4ai.download_model --base_config config/refcoco.yaml --model_c
 
 You may need 28GB vRAM to run NAVER. Consider editing the file in `./config/model_config.yaml` to load the models in multiple GPUs.
 
+### Inference with GUI
+
+You need `nodejs` and `npm` to run the GUI demo. It will automatically compile and build the frontend.
+
+The GUI will be available at `http://0.0.0.0:8000`.
+
+```Bash
+python demo_gui.py \
+  --base_config <YOUR-CONFIG-DIR> \
+  --model_config <MODEL-CONFIG-PATH>
+```
+
 ### Inference with given one image and query
 ```Bash
 python demo_cli.py \

demo_cli.py

@@ -1,10 +1,4 @@
 import asyncio
-import json
-import os
-import time
-import tensorneko as N
-import torch
-from pathlib import Path
 from dotenv import load_dotenv
 
 load_dotenv()