Last active
September 20, 2024 14:10
-
-
Save CGamesPlay/dd4f108f27e2eec145eedf5c717318f5 to your computer and use it in GitHub Desktop.
I've updated the notebook to use the new tool calling interface and support the parallel tool calling option. Notable changes:
- Validations are now exposed to the model (minimum, maximum, pattern).
- Enums are no longer exposed to the model (note: it's still possible that OpenAI supports them through controlled generation, but untested)
- Type titles are now exposed to the model. If you are autogenerating the schema title from the field name, this is wasting tokens.
One interesting note is that the overhead of the parallel tool calls doesn't seem to be reflected in the prompt usage value.
https://openai.com/index/introducing-structured-outputs-in-the-api/
Any changes from this?
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Amazing work! The latest gpt-3.5-turbo and gpt-4-turbo add support for parallel tool calls by injecting an extra tool. Here is the namespace and description I obtained from the OpenAI's API:
(continuation from the normal functions namespace)