Skip to content

Conversation

@debsmita1
Copy link
Member

@debsmita1 debsmita1 commented Jan 15, 2026

Hey, I just made a Pull Request!

Resolves:
https://issues.redhat.com/browse/RHIDP-11420

Adds an expandable card when the model responds with reasoning

deppthinking.mov
Screenshot 2026-01-16 at 12 45 02 PM

Test setup:

pull a model that supports deep thinking

ollama pull deepseek-r1:7b

replace run.yaml in lightspeed-stack.yaml with this

version: 2
image_name: llama-stack-examples
apis:
  - agents
  - inference
  - safety
  - tool_runtime
  - vector_io

# external_providers_dir: /Users/kjeeyar/Documents/lightspeed-providers/providers.d

providers:
  tool_runtime:
    - provider_id: model-context-protocol
      provider_type: remote::model-context-protocol
      config: {}
  inference:
    - provider_id: ollama
      provider_type: remote::vllm
      config:
        url: http://localhost:11434/v1
        api_token: dummy
    - provider_id: sentence-transformers
      provider_type: inline::sentence-transformers
      config: {}

  safety:
    - provider_id: llama-guard
      provider_type: inline::llama-guard
      config:
        model: llama3.2:3b
    - provider_id: llama-guard
      provider_type: inline::llama-guard
      config:
        model: deepseek-r1:7b
  agents:
    - provider_id: meta-reference
      provider_type: inline::meta-reference
      config:
        persistence_store:
          type: sqlite
          db_path: ${env.SQLITE_STORE_DIR:=~/.llama/distributions/custom}/agents_store.db
        responses_store:
          type: sqlite
          db_path: ${env.SQLITE_STORE_DIR:=~/.llama/distributions/custom}/responses_store.db
  vector_io:
    - provider_id: faiss
      provider_type: inline::faiss
      config:
        kvstore:
          type: sqlite
          namespace: null
          db_path: ${env.SQLITE_STORE_DIR:=~/.llama/distributions/custom}/faiss_store.db

metadata_store:
  type: sqlite
  db_path: ${env.SQLITE_STORE_DIR:=~/.llama/distributions/custom}/registry.db
  namespace: null

inference_store:
  type: sqlite
  db_path: ${env.SQLITE_STORE_DIR:=~/.llama/distributions/custom}/inference_store.db

models:
  - metadata: {}
    model_id: llama3.2:3b
    provider_id: ollama
    provider_model_id: llama3.2:3b
  - metadata: {}
    model_id: deepseek-r1:7b
    provider_id: ollama
    provider_model_id: deepseek-r1:7b
  - model_id: sentence-transformers/all-mpnet-base-v2
    metadata:
      embedding_dimension: 768
    model_type: embedding
    provider_id: sentence-transformers
    provider_model_id: sentence-transformers/all-mpnet-base-v2

shields: []
  # - shield_id: lightspeed_question_validity-shield
  #   provider_id: lightspeed_question_validity

server:
  port: 8321

and llama_stack url in lightspeed-stack.yaml

url: http://localhost:8321

Note: not all AI models support tool calling , like this deepseek model. So, ensure that you do not have mcp server configured in lightspeed-stack.yaml

✔️ Checklist

  • A changeset describing the change and affected packages. (more info)
  • Added or Updated documentation
  • Tests for new functionality and regression tests for bug fixes
  • Screenshots attached (for UI changes)

@rhdh-gh-app
Copy link

rhdh-gh-app bot commented Jan 15, 2026

Changed Packages

Package Name Package Path Changeset Bump Current Version
@red-hat-developer-hub/backstage-plugin-lightspeed workspaces/lightspeed/plugins/lightspeed patch v1.1.2
app workspaces/quickstart/packages/app none v0.0.0

@its-mitesh-kumar
Copy link
Member

@debsmita1 In the recording I can see the Thinking block is below the main content, but I think it should be above the main content ?

@debsmita1
Copy link
Member Author

@debsmita1 In the recording I can see the Thinking block is below the main content, but I think it should be above the main content ?

This is a Patternfly component that I am using for rendering the deepthinking content

@debsmita1 debsmita1 force-pushed the add-thinking-indicator branch from 3ee5dc1 to 6788339 Compare January 15, 2026 19:10
Copy link
Contributor

@rohitkrai03 rohitkrai03 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks good. Just one comment - shouldn't the thinking component be rendered at the top even if the main content is available?

@debsmita1 debsmita1 force-pushed the add-thinking-indicator branch from 6788339 to be30337 Compare January 16, 2026 07:49
@debsmita1
Copy link
Member Author

Fixed it!

Screenshot 2026-01-16 at 12 45 02 PM

cc @rohitkrai03 @its-mitesh-kumar

@sonarqubecloud
Copy link

Copy link
Member

@its-mitesh-kumar its-mitesh-kumar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code looks good to me . Though not able to verify it locally. Adding lgtm based on screen recording.
/lgtm
/approve

Copy link
Contributor

@rohitkrai03 rohitkrai03 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/approve

@rohitkrai03 rohitkrai03 merged commit e16075b into redhat-developer:main Jan 16, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants