Python bindings for the Transformer models implemented in C/C++ using GGML library.

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (ggml/gguf), Llama models.

Python bindings for @ggerganov's llama.cpp library. Package provides: Low-level access to C API via ctypes interface,High-level Python API for text completion,OpenAI-like API ,LangChain compatibility

Port of Facebook's LLaMA model in C/C++

Go bindings for llama.cpp as high level, to avoid any extra computational cost, be more performant and lastly ease out maintenance, while keeping the usage as simple as possible.