Skip to content

Latest commit

 

History

58 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

New books available for subscription

Deep Learning for Programmers

Numerical Linear Algebra for Programmers

iLLaManati - The clojure CPU & GPU LLM

Become a patron.

iLLaManati is a Clojure library for running Large Language Models on the CPU and GPU. iLLaManati is powered by Neanderthal, Deep Diamond, and LLM runner backends. Currently, available backends are:

How to use it

As usual with Uncomplicate projects, there's a Hello World project to get you started.

Until I set up a dedicated website with the documentation and tutorials, please refer to my blog Dragan Rocks, the ONNX Runtime backend tests, and Hello World project.

There is not only enough step-by-step material there to get you started, but to deep-dive into both higher-level and lower-level features.

Please note that this library does not even introduce much public API, beyond the core.async and Flow functions, since it does everything automatically under the hood, and the implementation neatly blends into Neanderthal and Deep Diamond, which is very extensively documented in the Deep Learning for Programmers book.

Please also note that the current release is a preview, and not yet ready for production use.

License

Copyright © 2025-2026 Dragan Djuric

Distributed under the Eclipse Public License either version 1.0 or (at your option) any later version.

About

Clojure LLM

Resources

Stars

14 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages