From 1da2500adc84b71b02a9fa88bdeb35425b14fe9c Mon Sep 17 00:00:00 2001 From: Jhin Lee Date: Fri, 19 Jun 2026 08:36:03 -0400 Subject: [PATCH] Prepare 0.8.3 release --- CHANGELOG.md | 11 ++++++----- README.md | 4 ++-- packages/llamadart_litert_lm_flutter/README.md | 2 +- packages/llamadart_llama_cpp_flutter/README.md | 2 +- pubspec.yaml | 2 +- website/docs/changelog/recent-releases.md | 7 +++++++ website/docs/getting-started/installation.md | 4 ++-- 7 files changed, 20 insertions(+), 12 deletions(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 62d2ba30..e71669a8 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,9 +1,10 @@ -## Unreleased +## 0.8.3 -* Preload Windows backend modules with `LOAD_WITH_ALTERED_SEARCH_PATH` from - the resolved native backend bundle directory before handing them to - llama.cpp, so CUDA backend discovery can resolve colocated CUDA - redistributables without app `PATH` changes. +* Fixed Windows CUDA backend discovery when the native asset bundle directory is + not on the app `PATH`. llama.cpp backend modules are now loaded from their + resolved bundle path in a way that lets colocated CUDA redistributables such + as `cudart64_12.dll`, `cublas64_12.dll`, and `cublasLt64_12.dll` resolve + correctly. ## 0.8.2 diff --git a/README.md b/README.md index 7c1e6923..51135f06 100644 --- a/README.md +++ b/README.md @@ -52,7 +52,7 @@ JavaScript runtime. ```yaml dependencies: - llamadart: ^0.8.2 + llamadart: ^0.8.3 ``` Flutter iOS/macOS apps that want Swift Package Manager-linked Apple @@ -61,7 +61,7 @@ they ship: ```yaml dependencies: - llamadart: ^0.8.2 + llamadart: ^0.8.3 llamadart_llama_cpp_flutter: ^0.0.3 # GGUF / llama.cpp llamadart_litert_lm_flutter: ^0.0.2 # .litertlm / LiteRT-LM ``` diff --git a/packages/llamadart_litert_lm_flutter/README.md b/packages/llamadart_litert_lm_flutter/README.md index 7a85a8a9..1d8c9ec6 100644 --- a/packages/llamadart_litert_lm_flutter/README.md +++ b/packages/llamadart_litert_lm_flutter/README.md @@ -10,7 +10,7 @@ core package's native-assets fallback. ```yaml dependencies: - llamadart: ^0.8.2 + llamadart: ^0.8.3 llamadart_litert_lm_flutter: ^0.0.2 ``` diff --git a/packages/llamadart_llama_cpp_flutter/README.md b/packages/llamadart_llama_cpp_flutter/README.md index 58526d2b..16fd1e9a 100644 --- a/packages/llamadart_llama_cpp_flutter/README.md +++ b/packages/llamadart_llama_cpp_flutter/README.md @@ -9,7 +9,7 @@ core package's native-assets fallback. ```yaml dependencies: - llamadart: ^0.8.2 + llamadart: ^0.8.3 llamadart_llama_cpp_flutter: ^0.0.3 ``` diff --git a/pubspec.yaml b/pubspec.yaml index 23867ec1..22d9d8d2 100644 --- a/pubspec.yaml +++ b/pubspec.yaml @@ -1,6 +1,6 @@ name: llamadart description: Dart and Flutter local LLM inference with llama.cpp GGUF and LiteRT-LM across native platforms and web. -version: 0.8.2 +version: 0.8.3 homepage: https://github.com/leehack/llamadart repository: https://github.com/leehack/llamadart issue_tracker: https://github.com/leehack/llamadart/issues diff --git a/website/docs/changelog/recent-releases.md b/website/docs/changelog/recent-releases.md index 48f43669..d4072548 100644 --- a/website/docs/changelog/recent-releases.md +++ b/website/docs/changelog/recent-releases.md @@ -7,6 +7,13 @@ For canonical full release notes, use: - [`CHANGELOG.md`](https://github.com/leehack/llamadart/blob/main/CHANGELOG.md) +## 0.8.3 + +- Fixed Windows CUDA backend discovery when the native asset bundle directory is + not on the app `PATH`. Apps using the CUDA llama.cpp backend can now resolve + bundled CUDA redistributables beside `ggml-cuda.dll` without manually adding + `.dart_tool/lib` or the native bundle path to `PATH`. + ## 0.8.2 - Updated the default llama.cpp native runtime pin to diff --git a/website/docs/getting-started/installation.md b/website/docs/getting-started/installation.md index dad10a31..04187b2a 100644 --- a/website/docs/getting-started/installation.md +++ b/website/docs/getting-started/installation.md @@ -27,7 +27,7 @@ In Xcode, set `IPHONEOS_DEPLOYMENT_TARGET = 16.4` or ```yaml dependencies: - llamadart: ^0.8.2 + llamadart: ^0.8.3 ``` For Flutter iOS/macOS apps that should link Apple XCFrameworks through Swift @@ -35,7 +35,7 @@ Package Manager, also add the runtime companion packages you need: ```yaml dependencies: - llamadart: ^0.8.2 + llamadart: ^0.8.3 llamadart_llama_cpp_flutter: ^0.0.3 # GGUF / llama.cpp llamadart_litert_lm_flutter: ^0.0.2 # .litertlm / LiteRT-LM ```