このトピックのトレンドリポジトリ（4件）
A high-throughput and memory-efficient inference and serving engine for LLMs
A bundler for javascript and friends. Packs many modules into a few bundled assets. Code Splitting allows for loading parts of the application on demand. Through "loaders", modules can be CommonJs, AMD, ES6 modules, CSS, Images, JSON, Coffeescript, LESS, ... and your custom stuff.
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.