feat: add Amazon Bedrock as transcription provider#4229
Open
devin-ai-integration[bot] wants to merge 2 commits intomainfrom
Open
feat: add Amazon Bedrock as transcription provider#4229devin-ai-integration[bot] wants to merge 2 commits intomainfrom
devin-ai-integration[bot] wants to merge 2 commits intomainfrom
Conversation
- Add BedrockAdapter with OpenAI-compatible Realtime API support via bedrock-mantle - Implement both RealtimeSttAdapter (WebSocket) and BatchSttAdapter (multipart) - Register Bedrock in all dispatch sites: listener-core, listener2-core, transcribe-proxy - Add Bedrock to desktop settings UI with bedrock-mantle endpoint - Default models: openai.gpt-4o-transcribe (live), openai.whisper-1 (batch) - Uses Bearer token authentication via bedrock-mantle endpoint Co-Authored-By: John <john@hyprnote.com>
✅ Deploy Preview for hyprnote-storybook canceled.
|
✅ Deploy Preview for hyprnote canceled.
|
Contributor
Author
🤖 Devin AI EngineerI'll be helping with this pull request! Here's what you should know: ✅ I will automatically:
Note: I can only respond to comments from users who have write access to this repository. ⚙️ Control Options:
|
Co-Authored-By: John <john@hyprnote.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
feat: add Amazon Bedrock as transcription provider
Summary
Adds Amazon Bedrock as a new STT provider using the bedrock-mantle OpenAI-compatible endpoint (
https://bedrock-mantle.us-east-1.api.aws/v1). Supports both real-time (WebSocket) and batch transcription.Key decisions:
session.update,input_audio_buffer.append/commit)openai.gpt-4o-transcribe, default batch model:amazon.nova-sonic-v1:0us-east-1region; users can override via custom base URLFiles added:
bedrock/mod.rs,bedrock/batch.rs,bedrock/live.rsRegistration across dispatch sites: listener-core, listener2-core, transcribe-proxy (batch + streaming + env + tests), desktop settings UI
Closes #3000
Review & Testing Checklist for Human
default_batch_model()inproviders.rsreturns"amazon.nova-sonic-v1:0"but the desktop UI lists"openai.whisper-1"as a model option. These need to be aligned to whatever bedrock-mantle actually expects for batch transcription.session.updatewith nestedaudio.input.transcriptionconfig,input_audio_buffer.append,conversation.item.input_audio_transcription.completed/delta, etc.). Verify this matches bedrock-mantle's actual WebSocket protocol — especially theinclude: ["item.input_audio_transcription.logprobs"]field in the session config, which may be OpenAI-specific.ws_path()returns/v1/realtimefor Bedrock. Confirm this is the correct path for bedrock-mantle's WebSocket endpoint.<Icon icon="simple-icons:amazonaws" />— confirm this icon resolves correctly in the app's iconify setup.Suggested test plan:
Notes