AUTOMATICALLY DISCOVERED / rtk-ai/rtk
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
AT A GLANCE
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
Discovered automatically from GitHub. Description and facts come from the project, not an independent review or security audit.
KEEP EXPLORING
Website snapshot
ollama/ollama
Run, customize, and bundle Llama 3, Mistral, Gemma, and custom models locally via simple CLI or OpenAI-compatible API.
git clone https://github.com/ollama/ollama.git
Repository preview
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs featuring PagedAttention.
git clone https://github.com/vllm-project/vllm.git
Repository preview
janhq/jan
Turn your computer into an AI machine. 100% offline, local-first alternative to ChatGPT with support for local GGUF models.
git clone https://github.com/janhq/jan.git
Short demos. New discoveries. Less noise in your feed.