109 lines
3.6 KiB
Plaintext
109 lines
3.6 KiB
Plaintext
|
|
================================================================================
|
||
|
|
🐱 CHESHIRE CAT TEST ENVIRONMENT - QUICK START GUIDE
|
||
|
|
================================================================================
|
||
|
|
|
||
|
|
📍 Location: /home/koko210Serve/docker/miku-discord/cheshire-cat
|
||
|
|
|
||
|
|
🎯 Purpose: Test Cheshire Cat as memory/context system for Miku Bot
|
||
|
|
|
||
|
|
================================================================================
|
||
|
|
⚡ QUICK START (3 Commands)
|
||
|
|
================================================================================
|
||
|
|
|
||
|
|
1. Start services:
|
||
|
|
./start.sh
|
||
|
|
|
||
|
|
2. Configure and upload knowledge:
|
||
|
|
python3 test_setup.py
|
||
|
|
|
||
|
|
3. Run benchmarks:
|
||
|
|
python3 benchmark_cat.py
|
||
|
|
|
||
|
|
================================================================================
|
||
|
|
📊 WHAT TO LOOK FOR
|
||
|
|
================================================================================
|
||
|
|
|
||
|
|
✅ GOOD (Proceed with integration):
|
||
|
|
- Mean latency < 1500ms
|
||
|
|
- P95 latency < 2000ms
|
||
|
|
- RAG retrieval is accurate
|
||
|
|
|
||
|
|
⚠️ BORDERLINE (Try GPU embeddings):
|
||
|
|
- Mean latency 1500-2000ms
|
||
|
|
- Consider hybrid approach
|
||
|
|
|
||
|
|
❌ POOR (Stick with current system):
|
||
|
|
- Mean latency > 2000ms
|
||
|
|
- RAG quality is poor
|
||
|
|
|
||
|
|
================================================================================
|
||
|
|
🔗 USEFUL LINKS
|
||
|
|
================================================================================
|
||
|
|
|
||
|
|
Admin Panel: http://localhost:1865/admin
|
||
|
|
API Docs: http://localhost:1865/docs
|
||
|
|
Qdrant: http://localhost:6333/dashboard
|
||
|
|
|
||
|
|
================================================================================
|
||
|
|
📝 FILES CREATED
|
||
|
|
================================================================================
|
||
|
|
|
||
|
|
Configuration:
|
||
|
|
✓ .env Environment variables
|
||
|
|
✓ docker-compose.test.yml Docker services
|
||
|
|
|
||
|
|
Scripts:
|
||
|
|
✓ start.sh Start services
|
||
|
|
✓ stop.sh Stop services
|
||
|
|
✓ test_setup.py Configure Cat & upload knowledge
|
||
|
|
✓ benchmark_cat.py Performance benchmarks
|
||
|
|
✓ compare_systems.py Compare Cat vs current system
|
||
|
|
|
||
|
|
Documentation:
|
||
|
|
✓ SETUP_COMPLETE.md Full setup guide
|
||
|
|
✓ TEST_README.md Testing documentation
|
||
|
|
✓ QUICK_START.txt This file
|
||
|
|
|
||
|
|
================================================================================
|
||
|
|
🎯 EXPECTED RESULTS (FX-6100)
|
||
|
|
================================================================================
|
||
|
|
|
||
|
|
With CPU embeddings:
|
||
|
|
Mean: 1600-2200ms ⚠️ Borderline for voice chat
|
||
|
|
|
||
|
|
With GPU embeddings:
|
||
|
|
Mean: 900-1400ms ✅ Good for voice chat
|
||
|
|
|
||
|
|
================================================================================
|
||
|
|
🛠️ TROUBLESHOOTING
|
||
|
|
================================================================================
|
||
|
|
|
||
|
|
Services won't start:
|
||
|
|
docker logs miku_cheshire_cat_test
|
||
|
|
|
||
|
|
Can't connect to llama-swap:
|
||
|
|
Edit test_setup.py line 10 with correct URL
|
||
|
|
|
||
|
|
Embeddings too slow:
|
||
|
|
Try GPU acceleration (requires spare VRAM)
|
||
|
|
|
||
|
|
================================================================================
|
||
|
|
🧹 CLEANUP
|
||
|
|
================================================================================
|
||
|
|
|
||
|
|
Stop services:
|
||
|
|
./stop.sh
|
||
|
|
|
||
|
|
Remove all data:
|
||
|
|
docker-compose -f docker-compose.test.yml down -v
|
||
|
|
|
||
|
|
================================================================================
|
||
|
|
📚 DETAILED DOCS
|
||
|
|
================================================================================
|
||
|
|
|
||
|
|
Full guide: cat SETUP_COMPLETE.md
|
||
|
|
Test docs: cat TEST_README.md
|
||
|
|
View all files: ls -lah
|
||
|
|
|
||
|
|
================================================================================
|