freshcrate

Search results for "decoding"

Clear filters
3 results found (C++)
xgrammar📁0.1.33🌳 Mature⭐1,637

Efficient, Flexible and Portable Structured Generation

inferencelearningmachinepypiby MLC TeamC++
ctranslate2📁4.7.1🌳 Mature⭐4,444

Fast inference engine for Transformer models

cudainferencemachinemklneuralnmtopennmtpypitranslationby OpenNMTC++
llama.cpp📁b8871🏛️ Flagship⭐105,537

LLM inference in C/C++

c++ggmlby ggerganovC++