Skip to content

stream mode supports output schema #801

@Undertone0809

Description

@Undertone0809

🚀 Feature Request

Now pne cannot use stream + output_schema. For example:

import pne
from pydantic import BaseModel

class LLMResponse(BaseModel):
    content: str = Field(..., description="LLM response content")

response = pne.chat(model="gpt-4o", stream=True, output_schema=LLMResponse)

It will get error if you run this example.

This feature should build after #625.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    Status

    Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions