feat: add Moonshine MLX speech models#58
Closed
pyrex41 wants to merge 230 commits into
Closed
Conversation
Fix overlay constraint crash
Models section shows each model with loaded/not loaded status. Taller settings window (580px) to fit all sections. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Shows when any model isn't loaded. Downloads WhisperKit and/or cleanup models directly from Settings — no need to re-run onboarding. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
LLM.swift's bundled llama.cpp doesn't support Qwen3/3.5 architecture. Reverted to Qwen 2.5 1.5B + 3B which work reliably. Will upgrade when LLM.swift updates its llama.cpp. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Info.plist was still at v1.1 so Sparkle thought the "update" was the same version. Now properly at v1.3 build 4. Fixes #2. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Improve post-paste learning via Accessibility
Picker in Settings under Input section. Switching models triggers re-download and reload. Default remains small.en for accuracy. tiny.en is ~75 MB and much faster for shorter recordings. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
…oggle) Matches the original Ghost Pepper behavior. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Input Monitoring prompt doesn't reliably show the system dialog for debug-signed apps. Now attempts to start the hotkey monitor even without it — Accessibility alone is sufficient for Control key. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Fixed codesign verification failure reported in #4. Now verifies signature after extracting from DMG before release. Also includes: speech model picker, default Control shortcuts, non-blocking Input Monitoring check. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
macOS kills the app after Screen Recording is granted but doesn't relaunch it. Now spawns a background process that reopens the app after 3 seconds. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Replace no-audio modal with status pill
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Addresses #5 — users should know about local transcript log and auto-launch behavior. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
File-based logging was replaced by in-memory DebugLogStore. Nothing is written to disk. Updated disclosure accordingly. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
No longer blocks Continue button. Shown as "(optional)" with a bordered (not prominent) Enable button. Users can skip it and enable later in Settings. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Matches WhisperFlow and other dictation tools. Toggle is Right Command + Right Option + Space. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Supports Spanish and 90+ other languages. Same size as small.en. Users can tweak the cleanup prompt for their language's filler words. Addresses #6. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This reverts commit ad68a2e.
Reduce transcription latency and improve speaker tagging
…idebar, detect meeting name & attendees - Inline summary prompt editor with model picker on Summary tab (click "Customize") - "Imported from Granola" badge on imported meeting files - Granola files show green import icon in sidebar, no speaker badges on transcript - Resizable sidebar (drag divider, 160-400px range) - Sidebar open by default when Meetings window opens - "Detect" button grabs meeting name from Zoom/Teams window title + OCR attendees - Auto-detect scans known meeting apps even for manual recordings - Attendee OCR retries at 3s, 15s, 30s, 60s to catch late joiners - Attendees accumulate across retries (no duplicates) - Title auto-update only marks as done on success (retries on failure) - "Zoom Meeting" cleaned from window titles Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
…rowser meetings - Test dictation now uses selected mic (was always using system default) - Settings mic picker initializes from saved selection, not system default - Detect button activates meeting app (including browsers) before OCR - Added browser bundle IDs (Brave, Chrome, Arc, Safari, Firefox) for Google Meet detection - Falls back to frontmost non-Ghost Pepper app if no known meeting app found - Attendee chips UI instead of plain text - Debug logging for attendee OCR capture - Cleaned "Zoom Meeting" from window titles Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- One-time migration: enables meetingTranscriptEnabled for existing users (detects update by checking if selectedCleanupModelKind exists but meetingTranscriptEnabled was never set) - Shows "What's New" NSAlert on first launch after update with "Open Meetings" and "Got It" buttons - Persists hasSeenMeetingTranscriptAnnouncement to only show once - Fix: Settings mic picker initializes from saved selection, not system default - Fix: test dictation targets selected mic device - Fix: prioritize native Zoom over browsers for Detect button - Fix: filter out ZM_ internal Zoom windows from title detection - Fix: strip pronouns from attendee names (she/her, he/him, they/them) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- UpdaterController checks appcast XML 15s after launch to compare versions - Menu bar dropdown shows 'Update Available — Install Now' in orange when update found - Sparkle still handles the actual update dialog and installation Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Add three Moonshine speech-to-text models (Tiny, Small, Medium) via the moonshine-mlx pure-Swift Metal-accelerated backend. Models appear in the Settings picker and download from HuggingFace on first use. - Moonshine Tiny (43M params, ~170 MB) — fastest - Moonshine Small (147M params, ~590 MB) — balanced - Moonshine Medium (245M params, ~980 MB) — best accuracy Moonshine models are optimized for on-device inference and offer a different accuracy/speed tradeoff compared to Whisper. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
pyrex41
force-pushed
the
feat/moonshine-mlx-upstream
branch
from
d6e393a to
c3e0b76
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds three Moonshine speech-to-text models via the moonshine-mlx pure-Swift Metal-accelerated backend.
Models appear in the Settings picker and download from HuggingFace on first use. Only available on Apple Silicon (
#if arch(arm64)).Moonshine is optimized for on-device inference and offers a different accuracy/speed tradeoff compared to Whisper — worth having as another option for users.
Changes
project.yml— add MoonshineMLX package dependencySpeechModelCatalog.swift— add.moonshineMLXbackend and three model descriptorsModelManager.swift— add Moonshine model loading and transcriptionREADME.md— document Moonshine models in speech model tableTest plan
🤖 Generated with Claude Code