Skip to content

Instantly share code, notes, and snippets.

@elijahbenizzy

elijahbenizzy/astream_results.py

Created July 5, 2024 05:31
Show Gist options
  • Save elijahbenizzy/168d8782be7d87b3a6e00470bd453e56 to your computer and use it in GitHub Desktop.
Save elijahbenizzy/168d8782be7d87b3a6e00470bd453e56 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
astream_results.py
action, streaming_container = await app.astream_result(
halt_after=["generate_code", "unsafe_response", ...], # terminal actions
inputs={
"prompt": "Please generate a limerick about Alexander Hamilton and Aaron Burr"
}
)
async for item in streaming_container:
print(item['delta'], end="")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment