-
Notifications
You must be signed in to change notification settings - Fork 2.3k
Open
Labels
P2Medium priority, add to the next sprint if no P1 availableMedium priority, add to the next sprint if no P1 available
Milestone
Description
When working on deepset-ai/haystack-core-integrations#2200, I realized that support for streaming reasoning text in Haystack is currently limited.
In that PR, reasoning chunks are only accumulated in StreamingChunk.meta
for later reconstruction, but they are not actually streamed.
What needs to be done
- introduce
reasoning
field inStreamingChunk
to store reasoning chunks- this might be a
str
. - investigate if a more complex object is needed by looking at how providers stream reasoning chunks (Anthropic)
- this might be a
- update
print_streaming_chunk
utility function to also print reasoning
Metadata
Metadata
Assignees
Labels
P2Medium priority, add to the next sprint if no P1 availableMedium priority, add to the next sprint if no P1 available