#

rkllm

Here are 25 public repositories matching this topic...

c0zaut / ez-er-rkllm-toolkit

Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU

ai python3 huggingface-transformers rknn rk3588 huggingface-hub rkllm

Updated Nov 11, 2024
Python

Qengineering / Qwen3-VL-2B-NPU

Qwen3-VL-2B on the RK3588 NPU

ai vision image-to-text vlm npu rknn rk3588 rock-5c rkllm qwen3 qwen3-vl

Updated Feb 2, 2026
C++

Qengineering / SmolVLM2-256M-NPU

SmolVLM2 on the RK3588 NPU

ai image-to-text vlm visi npu rknn rk3588 rock-5c rkllm smolvlm smolvlm2

Updated Feb 2, 2026
C++

rkllm-rs

darkautism / rkllm-rs

rkllm rust ffi binding

rust ai embedded-systems embedded-rust rk3588 rknpu2 rkllm

Updated Mar 16, 2026
Rust

Qengineering / Qwen3-VL-4B-NPU

Qwen3-VL-4B on the RK3588 NPU

ai vision image-to-text vlm npu rknn rk3588 rock-5c rkllm qwen3 qwen3-vl

Updated Feb 2, 2026
C++

Qengineering / SmolVLM2-2B-NPU

SmolVLM2 on the RK3588 NPU

ai vision image-to-text vlm npu rknn rk3588 rock-5c rkllm smolvlm smolvlm2

Updated Feb 2, 2026
C++

Qengineering / Qwen3-VL-NPU-VIDEO

Qwen3-VL video on the RK3588 NPU

ai vision image-to-text vlm video-to-text npu rknn rk3588 rkllm qwen3-vl

Updated Feb 16, 2026
C++

Qengineering / InternVL3-NPU

InternVL3 VLM on the RK3588 NPU

ai vision image-to-text vlm npu rknn rk3588 rknpu rk3588s rock-5c rkllm internvl3

Updated Feb 2, 2026
C++

freed-dev-llc / terraform-provider-turingpi

Terraform provider for Turing Pi 2.5 BMC. Use with freed-dev-llc/modules/turingpi for cluster deployment.

golang kubernetes-cluster rockchip terraform-modules terraform-providers infrastructure-as-a-code k3s k3s-cluster turing-pi k8s-stack rk3588 rkllm homelabs rkllm-runtime talos-cloud

Updated Jun 2, 2026
Go

freed-dev-llc / exo-rkllama

A fork of exo-explore/exo that adds RKLLM inference engine support for Rockchip RK3588/RK3576 NPU devices.📱💻 🖥️⌚

machine-learning rknn rk3588 rknpu2 rkllm rkllm-runtime

Updated May 23, 2026
Python

Qengineering / SmolVLM2-500M-NPU

SmolVLM2 on the RK3588 NPU

ai vision image-to-text vlm npu rknn rk3588 rock-5c rkllm smolvlm smolvlm2

Updated Feb 2, 2026
C++

Qengineering / InternVL3.5-8B-NPU

InternVL3.5-8B on the RK3588 NPU

ai vision image-to-text vlm npu rknn llm rk3588 rock-5c rkllm internvl3-5

Updated Feb 2, 2026
C++

tkumata / rkllm-cli

Rockchip RK3588 NPU を Rust で利用する

rust cli rk3588 rock5b rkllm rockchip-npu

Updated Dec 25, 2025
Rust

freed-dev-llc / terraform-turingpi-modules

Terraform modules for Turing Pi clusters. Use with freed-dev-llc/turingpi provider.

Updated May 25, 2026
HCL

alefris / RKLLM-Gradio-adv

Based on RKLLM-Gradio and smolLM2-GradioChatbot, runs LLMs on the R3588 NPU using Gradio interface.

python ai chatbot rockchip gradio-interface rk3588 gradio-python-app rkllm

Updated Jun 23, 2025
Python

mafischer / oRKLLM

OpenAI-compatible LLM inference server for Rockchip NPU (RK3576/RK3588). Run local AI on a $50 SBC.

nodejs vue inference self-hosted rockchip vuetify nanopi vue3 npu openai-api llm rk3588 llms rk3576 rkllm rkllm-runtime

Updated Jun 3, 2026
Vue

kylefoxaustin / rk182x-evk-setup-guide

Pedantic, beginner-friendly setup guide for the Firefly RK182X 3D RAM Stacking Development Kit (AIO-GS1N2 + Core-3588JD4 + RK1820/RK1828) — from unboxing to running an LLM on the NPU.

rockchip firefly npu edge-ai single-board-computer rknn llm rk3588 deepseek rkllm rk182x rk1828

Updated May 22, 2026

Randomblock1 / ez-rkllm-converter

Convert HuggingFace models to RKLLM format and upload to HuggingFace.

rockchip huggingface llm rkllm

Updated Apr 6, 2026
Python

Qengineering / InternVL3.5-4B-NPU

InternVL3.5-4B on the RK3588 NPU

ai vision image-to-text vlm npu rknn llm rk3588 rock-5c rkllm internvl3-5

Updated Feb 2, 2026
C++

Qengineering / InternVL3.5-1B-NPU

InternVL3.5-1B on the RK3588 NPU

ai vision image-to-text vlm npu rknn rk3588 rock-5c rkllm internvl-3-5

Updated Feb 2, 2026
C++

Improve this page

Add a description, image, and links to the rkllm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the rkllm topic, visit your repo's landing page and select "manage topics."