bot/requirements.txt

discord.py
aiohttp
requests
langchain-core
langchain-text-splitters
faiss-cpu
langchain-community
aiofiles
apscheduler
fastapi
uvicorn
docker
nest_asyncio
twscrape
playwright
python-multipart
Pillow
opencv-contrib-python
numpy
scikit-learn
transformers
torch
Initial commit: Miku Discord Bot 2025-12-07 17:15:09 +02:00			`discord.py`
			`aiohttp`
			`requests`
			`langchain-core`
			`langchain-text-splitters`
			`faiss-cpu`
			`langchain-community`
			`aiofiles`
			`apscheduler`
			`fastapi`
			`uvicorn`
			`docker`
			`nest_asyncio`
			`twscrape`
			`playwright`
			`python-multipart`
			`Pillow`
			`opencv-contrib-python`
			`numpy`
			`scikit-learn`
Add dual GPU support with web UI selector Features: - Built custom ROCm container for AMD RX 6800 GPU - Added GPU selection toggle in web UI (NVIDIA/AMD) - Unified model names across both GPUs for seamless switching - Vision model always uses NVIDIA GPU (optimal performance) - Text models (llama3.1, darkidol) can use either GPU - Added /gpu-status and /gpu-select API endpoints - Implemented GPU state persistence in memory/gpu_state.json Technical details: - Multi-stage Dockerfile.llamaswap-rocm with ROCm 6.2.4 - llama.cpp compiled with GGML_HIP=ON for gfx1030 (RX 6800) - Proper GPU permissions without root (groups 187/989) - AMD container on port 8091, NVIDIA on port 8090 - Updated bot/utils/llm.py with get_current_gpu_url() and get_vision_gpu_url() - Modified bot/utils/image_handling.py to always use NVIDIA for vision - Enhanced web UI with GPU selector button (blue=NVIDIA, red=AMD) Files modified: - docker-compose.yml (added llama-swap-amd service) - bot/globals.py (added LLAMA_AMD_URL) - bot/api.py (added GPU selection endpoints and helper function) - bot/utils/llm.py (GPU routing for text models) - bot/utils/image_handling.py (GPU routing for vision models) - bot/static/index.html (GPU selector UI) - llama-swap-rocm-config.yaml (unified model names) New files: - Dockerfile.llamaswap-rocm - bot/memory/gpu_state.json - bot/utils/gpu_router.py (load balancing utility) - setup-dual-gpu.sh (setup verification script) - DUAL_GPU_*.md (documentation files) 2026-01-09 00:03:59 +02:00			`transformers`
			`torch`