feat(DATAGO-113923): real-time context usage indicator in chat with multiple metrics by amir-ghasemi · Pull Request #1236 · SolaceLabs/solace-agent-mesh

amir-ghasemi · 2026-03-21T13:46:01Z

This pull request introduces a new "Context Usage Indicator" feature to the chat UI, allowing users to monitor and manually compact their session's context window usage. It adds backend API integration, new types, and a user interface component that displays token usage, provides warnings, and enables conversation compaction. Additionally, there are minor improvements to database migration configuration and a bugfix in the compaction logic.

Context Usage and Compaction Feature:

Added ContextUsageIndicator component to the chat interface, displaying current token usage, warnings as usage increases, and a button to manually compact the conversation when usage is high. This component is shown next to the chat input area. [1] [2] [3] [4]
Implemented API client methods getSessionContextUsage and compactSession for fetching context usage and performing manual compaction, respectively. [1] [2]
Defined new types for context usage and compaction requests/responses in context-usage.ts and re-exported them for use across the frontend. [1] [2]

Backend and Migration Improvements:

Configured Alembic to use a custom version table name (alembic_version_adk) for database migrations, ensuring proper version tracking in the ADK module. [1] [2]

Bugfixes:

Fixed a bug in the compaction event logic by passing the correct agent object to the summarizer, ensuring proper summarization behavior.

github-actions · 2026-03-21T13:47:25Z

✅ FOSSA Guard: Licensing (`SolaceLabs_solace-agent-mesh`) • PASSED

Compared against main (9a2f130da2c905a7bf03b0bdd68e94af3eece230) • 0 new, 9 total (9 in base)

Scan Report | View Details in FOSSA

github-actions · 2026-03-21T13:47:33Z

✅ FOSSA Guard: Vulnerability (`SolaceLabs_solace-agent-mesh`) • PASSED

Compared against main (9a2f130da2c905a7bf03b0bdd68e94af3eece230) • 0 new, 0 total (0 in base)

Scan Report | View Details in FOSSA

github-actions · 2026-03-21T13:52:04Z

WhiteSource Policy Violation Summary

✅︎ No Blocking Whitesource Policy Violations found in solaceai/solace-agent-mesh-ui-pr-1236!

efunneko

Looks good!

enavitan

Thanks Amir, this looks nice.

left a few comments related to the architectural decision
token counting is somewhat off, i see tracker showing me 398k out of 200k - my assumption was we should not pass the limit.
could you please fix the unit tests, these are failing for me.

================================================================================================================================= short test summary info =================================================================================================================================
FAILED tests/integration/scenarios_programmatic/test_workflow_errors.py::test_workflow_cancellation - AssertionError: Scenario workflow_cancellation_001: Unexpected state: TaskState.failed
FAILED tests/unit/gateway/http_sse/routers/test_sessions_context_usage.py::TestGetSessionContextUsage::test_returns_zeros_for_empty_session - fastapi.exceptions.HTTPException: 500: Failed to get context usage
FAILED tests/unit/gateway/http_sse/routers/test_sessions_context_usage.py::TestGetSessionContextUsage::test_calculates_tokens_with_events - fastapi.exceptions.HTTPException: 500: Failed to get context usage
FAILED tests/unit/gateway/http_sse/routers/test_sessions_context_usage.py::TestGetSessionContextUsage::test_compaction_events_excluded_from_token_counts - fastapi.exceptions.HTTPException: 500: Failed to get context usage
FAILED tests/unit/gateway/http_sse/routers/test_sessions_context_usage.py::TestGetSessionContextUsage::test_returns_zeros_when_adk_session_service_is_none - fastapi.exceptions.HTTPException: 500: Failed to get context usage
FAILED tests/unit/gateway/http_sse/routers/test_sessions_context_usage.py::TestContextUsageModelResolution::test_uses_component_model_config_as_default - fastapi.exceptions.HTTPException: 500: Failed to get context usage
FAILED tests/unit/gateway/http_sse/routers/test_sessions_context_usage.py::TestContextUsageModelResolution::test_explicit_model_param_overrides_component_config - fastapi.exceptions.HTTPException: 500: Failed to get context usage
FAILED tests/unit/gateway/http_sse/routers/test_sessions_context_usage.py::TestContextUsageModelResolution::test_falls_back_to_default_model_when_no_config - fastapi.exceptions.HTTPException: 500: Failed to get context usage
============================================================================================== 8 failed

Thanks
Eugene

enavitan · 2026-03-23T14:56:45Z

+    ``adk_session_service`` config key.  This config must point at the **same**
+    database that the ADK agent uses (which has the ADK ``sessions`` / ``events``
+    schema).  It must NOT reuse the WebUI gateway's own ``session_service`` config
+    because that database uses a completely different schema.


current approach is based on the assumption all agents use same DB instance, thus adk_session_service - is one common endpoint here, my understanding is/was each agent is free to use its own DB instance, if so shouldn't we instead expose session usage/compaction via agent itself ? i.e gateway sends an evt to agent to request compaction etc?

enavitan · 2026-03-23T15:08:43Z

+    appropriate backend via ``create_session_service_from_config``, runs DB
+    migrations for SQL backends, and optionally wraps the result with
+    ``FilteringSessionService`` when auto-summarization is enabled.
+    """


in one of the upcoming tasks we will auto-enable compaction out of the box, and document how to disable it in public facing docs.

enavitan · 2026-03-23T15:30:04Z

+    log_identifier: str = "[SessionService]",
+    run_db_migrations: bool = False,
+    migration_component=None,
+) -> BaseSessionService:


I understand the intent behind direct database access for manual compaction. However, I have concerns about the architectural implications of this approach.

Current Issue

This PR introduces a second code path that can modify ADK session data:

Agent path: Uses FilteringSessionService wrapper, respects agent configuration

Gateway path: Uses raw DatabaseSessionService, bypasses agent business logic

This creates dual ownership of the session database - both the gateway and agents can now write to the same underlying storage. This approach also requires all agents to share the same database.

Instead of direct database access, could we implement compaction as an agent-to-agent request?

Flow:
Gateway → Solace Message → Agent → Agent compacts its own session → Response → Gateway

enavitan

as discussed, we need auto-compaction on if we want manual compaction to take effect.

one minor nit pick below.

enavitan · 2026-03-25T18:59:51Z

+            session_id = data.get("session_id")
+            user_id = data.get("user_id")
+            agent_id = data.get("agent_id")
+            correlation_id = data.get("correlation_id")


there are a few duplicates here with the above if block, might make sense to extract these

enavitan · 2026-03-25T19:22:21Z

+                app_name=agent_name, user_id=user_id, session_id=session_id
+            )
+            reloaded = _filter_session_by_latest_compaction(
+                reloaded, log_identifier=log_id


this is an interesting case, if I understand correctly you are filtering it second time for cases when auto-compaction is off, but if that's the case then next session load will include all events (since FilteringService is plugged on only if the auto-compaction flag is enabled)

I see 2 options here:

1- We should roll auto-compaction for everyone first then we can allow manual compaction.

2- if we want to have manual compaction capability without auto-compaction then we need to have filtering enabled (

solace-agent-mesh/src/solace_agent_mesh/agent/adk/services.py

Line 530 in a048e27

return FilteringSessionService(base_service)

)
for those session which were subject to manual compaction

sonarqube-solacecloud · 2026-03-28T21:06:37Z

Quality Gate failed

Failed conditions
53.0% Coverage on New Code (required ≥ 60%)
B Reliability Rating on New Code (required ≥ A)

See analysis details on SonarQube

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

…session" fallback path

amir-ghasemi requested a review from efunneko March 21, 2026 21:38

efunneko approved these changes Mar 21, 2026

View reviewed changes

amir-ghasemi force-pushed the amir/token-track branch from a52ab69 to 2a19e78 Compare March 23, 2026 11:46

amir-ghasemi requested review from enavitan March 23, 2026 14:31

enavitan reviewed Mar 23, 2026

View reviewed changes

amir-ghasemi changed the title ~~feat(DATAGO-113923): Real-time context usage indicator in chat with multiple metrics~~ feat(DATAGO-113923): real-time context usage indicator in chat with multiple metrics Mar 24, 2026

amir-ghasemi changed the title ~~feat(DATAGO-113923): real-time context usage indicator in chat with multiple metrics~~ feat(DATAGO-113923): real-time context usage indicator in chat with multiple metrics Mar 25, 2026

enavitan approved these changes Mar 25, 2026

View reviewed changes

amir-ghasemi force-pushed the amir/token-track branch from 5de8e8b to 48c3653 Compare April 17, 2026 18:50

amir-ghasemi added 15 commits April 20, 2026 18:01

feat: context usage tracking

0821a86

fix: review feedback

b18b1f6

fix: compaction fixes

d4765a5

fix: llm model

0444b45

fix: review #1

ba41076

fix: remove db patch

a1d20c2

fix: cached token count, move indicator inside chatInput area

3412d72

fix: remove polling

d6bcb0e

fix: review feedback

d907b99

fix: minor styling

b2e7bba

fix: test coverage

c0a1530

fix: usage indicator fixes

25742d4

fix: use gateway's TaskModel and ChatTaskModel tables in the "no ADK …

82996e4

…session" fallback path

fix: fix failing tests

8ab6609

refactor: use agents' compression logic

6473d18

amir-ghasemi added 9 commits April 20, 2026 18:01

fix: test failure

bee5754

fix: change compact view to pct

4b7d883

fix: Auto-dismiss compaction success message after 5 seconds

05eb64f

fix: logic fixes

965c3d4

fix: summarizer

2ff98ac

fix: model config UI wiring an styling fixes

5c60820

fix: max input token fallback via shared config

2036a6e

fix: docs

bab59a2

fix: minor fixes

9c669f3

amir-ghasemi force-pushed the amir/token-track branch from c5f4374 to 9c669f3 Compare April 20, 2026 22:01

amir-ghasemi added 2 commits April 20, 2026 18:33

fix: review feedback

2a2a974

fix: failing tests

e22d610

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(DATAGO-113923): real-time context usage indicator in chat with multiple metrics#1236

feat(DATAGO-113923): real-time context usage indicator in chat with multiple metrics#1236
amir-ghasemi wants to merge 26 commits intomainfrom
amir/token-track

amir-ghasemi commented Mar 21, 2026

Uh oh!

github-actions Bot commented Mar 21, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Mar 21, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Mar 21, 2026 •

edited

Loading

Uh oh!

efunneko left a comment

Uh oh!

enavitan left a comment

Uh oh!

enavitan Mar 23, 2026

Uh oh!

enavitan Mar 23, 2026

Uh oh!

enavitan Mar 23, 2026

Uh oh!

enavitan left a comment

Uh oh!

enavitan Mar 25, 2026

Uh oh!

enavitan Mar 25, 2026

Uh oh!

sonarqube-solacecloud Bot commented Mar 28, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

amir-ghasemi commented Mar 21, 2026

Uh oh!

github-actions Bot commented Mar 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ FOSSA Guard: Licensing (SolaceLabs_solace-agent-mesh) • PASSED

Uh oh!

github-actions Bot commented Mar 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ FOSSA Guard: Vulnerability (SolaceLabs_solace-agent-mesh) • PASSED

Uh oh!

github-actions Bot commented Mar 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

WhiteSource Policy Violation Summary

Uh oh!

efunneko left a comment

Choose a reason for hiding this comment

Uh oh!

enavitan left a comment

Choose a reason for hiding this comment

Uh oh!

enavitan Mar 23, 2026

Choose a reason for hiding this comment

Uh oh!

enavitan Mar 23, 2026

Choose a reason for hiding this comment

Uh oh!

enavitan Mar 23, 2026

Choose a reason for hiding this comment

Uh oh!

enavitan left a comment

Choose a reason for hiding this comment

Uh oh!

enavitan Mar 25, 2026

Choose a reason for hiding this comment

Uh oh!

enavitan Mar 25, 2026

Choose a reason for hiding this comment

Uh oh!

sonarqube-solacecloud Bot commented Mar 28, 2026

Quality Gate failed

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

github-actions Bot commented Mar 21, 2026 •

edited

Loading

✅ FOSSA Guard: Licensing (`SolaceLabs_solace-agent-mesh`) • PASSED

github-actions Bot commented Mar 21, 2026 •

edited

Loading

✅ FOSSA Guard: Vulnerability (`SolaceLabs_solace-agent-mesh`) • PASSED

github-actions Bot commented Mar 21, 2026 •

edited

Loading