mirror of
https://github.com/ggml-org/ggml.git
synced 2026-11-16 18:11:39 +00:00
Tensor library for machine learning
https://github.com/ggml-org
- C++ 54.5%
- C 28.6%
- Cuda 9%
- Metal 2.6%
- GLSL 1.5%
- Other 3.8%
| Filename | Latest commit message | Latest commit date |
|---|---|---|
This commit removes the ggml version test-cmake and instead uses the version that is supplied by CMAKE_PREFIX_PATH. The motivation for this is to avoid issues when bumping major versions. Refs: https://github.com/ggml-org/ggml/actions/runs/43385979342/job/131763861057?pr=1690 |
||
| .github | ||
| .pi/gg | ||
| ci | ||
| cmake | ||
| docs | ||
| examples | ||
| include | ||
| scripts | ||
| src | ||
| tests | ||
| .editorconfig | ||
| .gitignore | ||
| .gitmodules | ||
| AUTHORS | ||
| CMakeLists.txt | ||
| CONTRIBUTING.md | ||
| ggml.pc.in | ||
| LICENSE | ||
| README.md | ||
| requirements.txt | ||
ggml
Quick start
Build from source:
git clone https://github.com/ggml-org/ggml
cd ggml
mkdir build && cd build
cmake ..
cmake --build . --config Release -j 8
For a minimal, fully commented example (matrix multiplication), see examples/simple.
Description
The main goal of ggml is to be a simple, portable, and efficient tensor library for machine learning with minimal setup.
- Plain C/C++ implementation without any dependencies
- Cross-platform - x86, ARM, RISC-V, LoongArch, PowerPC, s390x, and WebAssembly
- SIMD-optimized kernels for x86, ARM, and RISC-V
- Broad backend support - CPU, GPU, NPU, and browser
- 2- to 8-bit integer quantization, plus MXFP4 and NVFP4 microscaling formats
- Zero memory allocations during runtime
Documentation
Contributing
- For changes to the core
ggmllibrary (including to the CMake build system), please open a PR in llama.cpp - doing so will make your PR more visible, better tested, and more likely to be reviewed