Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
79 commits
Select commit Hold shift + click to select a range
3003c1b
Add A2E + Japanese audio test suite
claude Feb 20, 2026
cdca526
Add ONNX error diagnostic and VAD handler patch tools
claude Feb 20, 2026
081f904
Add standalone A2E Japanese audio test script
claude Feb 20, 2026
35838a6
Add LLM handler patch for Gemini dict content TypeError
claude Feb 20, 2026
b50178e
Update Gemini model to gemini-2.5-flash (2.0-flash deprecated)
claude Feb 20, 2026
cbc1c7c
Add ASR language patch to force Japanese in SenseVoice
claude Feb 20, 2026
59387bf
Add config patch script to Japanize existing chat_with_lam.yaml
claude Feb 20, 2026
a58395b
Fix ASR 2nd inference 24x slowdown causing system freeze
claude Feb 20, 2026
0875af7
Add audio2exp-service microservice and frontend A2E integration
claude Feb 21, 2026
37ebe2c
Support flat model directory layout for A2E checkpoint
claude Feb 21, 2026
23f10de
Add complete A2E-integrated concierge-controller.ts replacement
claude Feb 21, 2026
2388a86
Replace concierge-controller.ts with actual gourmet-sp version
claude Feb 21, 2026
949bbae
Fix start.sh: uvicorn → gunicorn for Flask WSGI app
claude Feb 21, 2026
76bd40c
Add comprehensive system architecture documentation
claude Feb 21, 2026
cde7c54
fix: correct data format mismatch in applyExpressionFromTts for lip sync
claude Feb 21, 2026
2e09277
fix: integrate ExpressionManager for A2E lip sync (replace broken lam…
claude Feb 21, 2026
3b91d52
fix: inline ExpressionManager to eliminate external import dependency
claude Feb 21, 2026
c2a881c
fix: use LAMAvatar's buffer system instead of non-existent guavaRenderer
claude Feb 21, 2026
461ee0a
fix: add A2E chain diagnostics after analyzing actual LAMAvatar.astro…
claude Feb 21, 2026
0df04b9
fix: match original gourmet-sp behavior - remove destructive clearFra…
claude Feb 21, 2026
4332c8f
fix: prevent autoplay deadlock in all play-and-wait patterns (STT fix)
claude Feb 22, 2026
978b5d3
fix(frontend-patch): applyExpressionFromTts の両形式対応と try/catch 追加
claude Feb 22, 2026
c9cf14c
feat: rewrite A2E patch based on production code - restore GVRM integ…
claude Feb 22, 2026
8887cc2
fix: use gourmet-sp version of concierge-controller.ts (LAMAvatar, no…
claude Feb 22, 2026
65db8dc
feat: improve A2E lip sync quality - amplify mouth blendshapes + inte…
claude Feb 22, 2026
50f4e4d
fix: handle new a2e_engine response format (plain arrays vs {weights}…
claude Feb 22, 2026
c15162e
fix: use proper INFER pipeline for A2E decoder + add renderer diagnostic
claude Feb 22, 2026
8f99c70
fix: resolve INFER pipeline startup errors for A2E service
claude Feb 22, 2026
a8a68c3
chore: add .gitignore for audio2exp-service model files
claude Feb 22, 2026
e1b8d30
fix: disable Flask auto dotenv loading to avoid encoding errors
claude Feb 22, 2026
2e16f78
fix: enable TTS playback for text input in concierge mode
claude Feb 22, 2026
dc85ffd
docs: add session handoff document for next AI session
claude Feb 22, 2026
bc1fe80
test: add CI-friendly pytest suite for A2E service PoC validation
claude Feb 22, 2026
7a2ab7c
fix: add .gcloudignore to include models/ in Cloud Build context
claude Feb 22, 2026
ac3a861
docs: update .gitignore comment to reflect bake-in strategy
claude Feb 22, 2026
a9fc0b5
fix: use Cloud Run PORT env var instead of hardcoded 8081
claude Feb 22, 2026
a633fe1
fix: lazy-load A2E engine in background thread
claude Feb 22, 2026
a4eb9ee
Pre-bake wav2vec2-base-960h in Docker image to avoid runtime download
claude Feb 22, 2026
9f5bd88
Use CPU-only PyTorch + add torchaudio for INFER pipeline
claude Feb 22, 2026
e36190d
fix(audio2exp): add warmup timeout and forward-pass timing logs
claude Feb 23, 2026
2bd1198
fix(docs): correct Cloud Run region from asia-northeast1 to us-central1
claude Feb 23, 2026
81fac9b
fix(deploy): update memory to 4Gi and add CLAUDE.md project notes
claude Feb 23, 2026
528dd5f
docs: update CLAUDE.md as handover document for next session
claude Feb 23, 2026
dbcd169
Add files via upload
mirai-gpro Feb 24, 2026
36bf69b
feat(audio2exp): switch to Non-Streaming full model (6-layer Transfor…
claude Feb 25, 2026
d466f6a
fix(audio2exp): revert to Streaming model (full model未公開) + batch推論 +…
claude Feb 25, 2026
6983725
fix(lipsync): suppress unnatural jaw drop by removing over-amplificat…
claude Feb 25, 2026
e955778
Add files via upload
mirai-gpro Feb 25, 2026
bae5578
refactor(lipsync): reset all parameters to neutral baseline
claude Feb 25, 2026
d4df48f
tune(lipsync): jawOpen 1.8x boost, mouthLowerDown 0.45x suppress
claude Feb 25, 2026
a6d81a1
revert(lipsync): restore MOUTH_AMPLIFY to 1.0 baseline
claude Feb 25, 2026
770dfd1
fix(audio2exp): add INFER load timeout + Wav2Vec2 fallback + diagnost…
claude Feb 25, 2026
84902f6
fix(audio2exp): increase INFER_LOAD_TIMEOUT default to 1200s
claude Feb 25, 2026
38e9f24
fix(audio2exp): match INFER_LOAD_TIMEOUT to proven 1500s
claude Feb 25, 2026
ce103ad
feat(audio2exp): add conservative expression scaling (default 1.8x)
claude Feb 25, 2026
d16e30c
Create stt_stream
mirai-gpro Feb 25, 2026
014c1d2
Add files via upload
mirai-gpro Feb 25, 2026
bce4c6a
Delete AI_Meeting_App/stt_stream
mirai-gpro Feb 25, 2026
1e80e3f
docs: update CLAUDE.md - audio2exp-service health check now OK
claude Feb 25, 2026
b99c277
docs: add platform design document for Live API integration & multi-m…
claude Feb 25, 2026
2964376
fix: add EMA temporal smoothing to eliminate lip-sync jitter
claude Feb 25, 2026
1f23b22
revert(audio2exp): restore all files to e36190d state
claude Feb 25, 2026
2b8109b
revert(frontend): restore LAMAvatar.astro to original (e955778)
claude Feb 25, 2026
539ae0c
docs: プラットフォーム設計書の作成依頼書を追加
claude Feb 26, 2026
e122f68
docs: DESIGN_REQUEST.md にプラットフォーム化の目的・LiveAPI導入背景・記憶統一仕様を追加
claude Feb 26, 2026
c3b7df3
docs: プラットフォーム化の要件定義書と設計書を作成
claude Feb 26, 2026
e04f2d1
docs: 要件定義書・設計書に多言語対応セクションを追加
claude Mar 2, 2026
b27eff6
feat: グルメコンシェルジュ Live API プラットフォーム実装
claude Mar 2, 2026
384879e
refactor: platform → lam_platform にリネーム + Dockerfile 追加
claude Mar 2, 2026
413439c
rename: lam_platform → support_base
claude Mar 2, 2026
4f2950f
feat: gourmet-support コアモジュール統合 + REST API ルーター
claude Mar 2, 2026
00bf16a
fix: 起動時クラッシュ防止 + cloudbuild.yaml 追加
claude Mar 2, 2026
b562536
chore: support-base リポへの初期プッシュスクリプト追加
claude Mar 2, 2026
611ec48
fix: push_support_base.sh を Windows Git Bash 対応に修正
claude Mar 2, 2026
7e952eb
feat: Live API 対応フロントエンド初期実装
claude Mar 2, 2026
5de5d7b
docs: プラットフォーム仕様書 v2 作成 — LiveAPI + REST ハイブリッド仕様
claude Mar 2, 2026
cd80725
docs: 仕様書をgourmet-sp2ベースに修正 — アバターリップシンク実装済
claude Mar 2, 2026
5dfd364
feat: gourmet-sp2 Live API platform integration implementation
claude Mar 2, 2026
1cac5d6
docs: add gourmet-sp2 handover document for new session
claude Mar 3, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1,063 changes: 1,063 additions & 0 deletions AI_Meeting_App/stt_stream.py

Large diffs are not rendered by default.

18 changes: 18 additions & 0 deletions CLAUDE.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
# Project Notes - 引継ぎ文書

## 現在の状況: audio2exp-service デプロイ(完了)

### やったこと
1. audio2exp-service を修正し、再ビルド・再デプロイを実施
2. `--memory 2Gi` ではメモリ不足で3回失敗 → `4Gi` に増やして完走
3. デプロイ完走後のヘルスチェックで **NG** → 原因調査・対処
4. ヘルスチェック **OK** 確認済み (status: healthy, engine_ready: True, device: cpu, mode: fallback)

### 現在のステータス
- **デプロイ**: 完走済み(メモリ4Gi)
- **ヘルスチェック**: OK(解決済み)
- **次のアクション**: パイプライン全体の結合テスト(TTS → A2E → アバター描画)

### ルール
- 推測で回答せず、必ず会話ログ・ファイル・記録を確認してから回答すること
- 確定していない中途半端な情報を書き出さないこと
375 changes: 375 additions & 0 deletions docs/DESIGN_REQUEST.md

Large diffs are not rendered by default.

1,387 changes: 1,387 additions & 0 deletions docs/PLATFORM_ARCHITECTURE.md

Large diffs are not rendered by default.

668 changes: 668 additions & 0 deletions docs/PLATFORM_DESIGN.md

Large diffs are not rendered by default.

421 changes: 421 additions & 0 deletions docs/PLATFORM_REQUIREMENTS.md

Large diffs are not rendered by default.

1,066 changes: 1,066 additions & 0 deletions docs/PLATFORM_SPEC_v2.md

Large diffs are not rendered by default.

377 changes: 377 additions & 0 deletions docs/SESSION_HANDOFF.md

Large diffs are not rendered by default.

Loading