Skip to content

README.md

Latest commit

 

History

History
21 lines (15 loc) · 512 Bytes

README.md

File metadata and controls

21 lines (15 loc) · 512 Bytes

llama-cpp-rs

Rust bindings for llama.cpp. Minimal, close to raw bindings, kept up to date with upstream.

Quick start

git clone --recursive https://github.com/intentee/llama-cpp-bindings
cd llama-cpp-rs
cargo build --release

Add --features cuda for GPU acceleration.

Crates

Crate Description
llama-cpp-bindings Safe Rust API
llama-cpp-bindings-sys Raw FFI bindings
llama-cpp-bindings-build Build system