Finally! How to Leverage JSON Mode in OpenAI's New GPT 4 Turbo 128k

@siliconsociety Lead AI Engineer Robert Sharp shows how to use OpenAI's new GPT-4 Turbo 128 with JSON mode.

We'll be posting more pro tips as we go—if you liked this, please do like the video to appease The Algorithm, and subscribe if you're interested in more 🙂

[ExplodeReality]

This is exactly what I was looking for, thanks!

[stefanrows]

Cheers. That was helpful. I'm surprised they aren't as clear about these instructions in their documentation...

[jakeejacobson]

very cool, I am using JSON schema to create the structure in the prompt but pydantic looks cool. also wondering if you can just use function calling for this, as you have to define a JSON schema for the function. have you tested the differences between JSON mode and function calling?

[adrianobleton]

This is great! I have been working on a project that needed json output from open API, and was describing the json object in the system prompt. Similar to what you saw it works most of the time, but fails ~5%. I was solving that by making the call again if the output couldn't be parsed, but that eats up a lot more tokens.

This seems much more elegant.

[Steve-Richter]

Ask the AI agent to check and increase your font size.

[Bangs_Theory]

Excellent tutorial, thank you. Please provide more.

[faustoalbers]

Very inspiring! I reversed your approach to make it create JSON objects with predefined pydantic classes from unstructured text data. The pydantic example guarantees that only the data that is ‘fitting the slots’ is extracted.

Added to it, instructions to reason about the most probable information that is not present in the source data, but can be deduced from what it did found!

Thanks!

[Mhmdmine]

Whats the difference between using JSON Mode and function calling since both extract structered data? which is more accurate and viable? thanks for the pydentic tip btw

[mikulcek]

You need to start making more content. 👍

[Zach-rwjf]

Awesome! I'm in the process of doing something similar and trying to figure out the best way to get my output as consistent as possible. Will definitely look into using a method like this!

[mostafamoustaghni]

I really want to see if this is better way than functions calling?

[JT-Works]

Great tutorial, I am surprised you don't have more subscribers.

[BangaloreYoutube]

What a video, comments section also super helpful.

Cheers everyone.

[chaozhang]

very helpful, the way to get structured output from gpt API. Just wondering if it supports nested object, such as graph structure G(V, E) with nodes and edges?

[adityashinde]

How can i make user_prompt dynamic, meaning instead RPG as input I want to send some other input?

[akshatkant]

Hi, i also need to get a json response from the open ai api from my project, the json is kind of big with around 5082 tokens, so after some time the response is gibberrish and completely unrelated to with what it started, do you think there are some alternatives to my problem and if any solution is there