llm-recipes

Tutorials

Tutorials

• v8
  • Quantisation - tensors to GGUF
    • llama.cpp
  • Indic AI - Sarvam
    • sarvam-ai
• v7
  • Mobile - On device Inference
    • Android
• v6
  • GUI - Graphical User Interface
    • UI : typescript + docker/ollama
• v5
  • Indoor Maps for Drone
• v4
  • Vision /Image Recognition
    • vision-search.ipynb : moondream2/llava + ollama
• v3
  • Speech Output / TODO
• v2
  • Voice Output + v1
    • speech-to-speech-inference.ipynb - Coqui tts + voice clone
      • Speech to Speech Inference Demo
• v1
  • Voice Input + v0
    • aws-bedrock-mistral-whisper.ipynb - Whisper + AWS Bedrock + Mistral + RestAPI
• v0
  • Rest API + local LLM
    • local_function_call_rest_api.ipynb - function calling using mistral-inference and Mistral-7B-Instruct-v0.3
    • ollama_mistral_function_calling.ipynb - function calling using ollama + mistral7b (4bit) + tokenizer.v3
    • aws-bedrock-mistral.ipynbAWS Bedrock + Mistral Large + Function call

This site is open source. Improve this page.