jundot/omlx
jundot/omlxOtherPython
20.0k3回登場
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
apple-siliconinference-serverllmmacosmlxopenai-api
# inference-server
このトピックのトレンドリポジトリ（2件）
superlinked/sie
superlinked/sieOtherPython
3.0k
Open-source inference server and production cluster for all the models your agent needs.
bgecolbertdata-pipelinedeep-learningembeddingsinferenceinference-serverinformation-retrievalllmmlmlopsnatural-language-processingnlppythonrerankingretrievalretrieval-augmented-generationsemantic-searchspladevector-search