Feature Request - Streaming: Support streaming output responses

[pranav-kural]

Checklist

• I have searched the existing issues and this feature has not been requested before.
• I have checked the QvikChat Feature Release project and this feature is not listed there.
• Optional: I have read the QvikChat documentation and there is no alternative to this feature.
• Optional: I am willing to implement this feature and submit a pull request.

Description

Add functionality to support streaming output responses.

Impact (Why is this feature important?)

Will enhance user experience.

Select Components this Feature will Impact

Select component(s) this feature will impact

• API Key Authentication
• Chat Agents
• Chat Endpoints
• Chat History
• Embedding Models
• Endpoint Deployment
• LLM Models
• RAG
• Response Caching
• Vector Stores
• Other

Proposal (Optional)

Will likely have to modify:

• Chat agent response generation.
• defineChatEndpont method.
• add new enableResponseSteaming option.

Alternatives (Optional)

None right now.

Resources (Optional)

Genkit - Streaming responses