freshcrate — Search

freshcrate

Search for

Search results for "quantization"

3 results found (C++)

ctranslate2 📁4.7.1🌳 Mature⭐4,444

Fast inference engine for Transformer models

cuda inference machine mkl neural nmt opennmt pypi translationby OpenNMTC++

llama.cpp 📁b8871🏛️ Flagship⭐105,537

LLM inference in C/C++

c++ggmlby ggerganovC++

zvec 📁v0.3.1🌳 Mature⭐9,474

A lightweight, lightning-fast, in-process vector database

agent-memory ann-search c++embedded-database local nodejs python rag vector-searchby alibabaC++