llm-recipes
LLM Recipes
- Assistant
- On-device assistant with Speech, Vision, Text search
| Version | Concept | Status | Tech |
|---|---|---|---|
| v0.8 | Quantisation | In progress | llama.cpp |
| v0.7 | On-device Mobile | In progress | Android + TF lite |
| v0.6 | UI | In progress | Typescript |
| v0.5 | Indoor Maps + v0.4 | In progress | ROS2 |
| v0.4 | Image/Scene Recognition + v0.3 | complete | llava/moondream |
| v0.3 | Speech output + v0.2 | Complete | coqui tts + v1 |
| v0.2 | Speech input + v0.1 | Complete | whisper + ffpmeg + v0 |
| v0.1 | Text Query + API calls | Complete | mistral7B-v0.3 + ollama + RestAPI |
- Base Setup
- ChatUI : ollama + open-webui + mistral-7B + docker
- Setup + Documentation at ollama-open-webui.md
- Code CoPilot : vscode + continue + ollama + mistral-7B
- Setup document at code-pair.md
- ChatUI : ollama + open-webui + mistral-7B + docker
- Extra
- Clean install of ubuntu + docker + nvidia requirements
- Applications
- Reconnaisance with Drone
- Use Drones to create real-time insights of Warehouse, Home securiy
- Upcoming Challenges