An AI model is a single standalone file of numbers that predicts the next word — it is not a server farm, not a computer, and not a program connected to the internet.

2:28and billions of dollars in hardware and electricity. But the end result of all of that analyzing and processing is a single standalone model file that essentially has internal representations of every piece of data it analyzed throughout that process. And that model file can do one thing. Predict the next word. Essentially, every interaction you have with a model happens by breaking down your prompt, predicting what word might come next in the response, then

2:55appending the predicted word back into the prompt. repeat, repeat, repeat until you get a full answer from the model. Now, it's important to note that the end result of all of that upfront analyzing all of all of that data is a single file that predicts words. It's not a server farm. It's not a computer. It's not a program running on a computer. It's a file with trillions or billions of

3:16numbers inside of it. Now, if you're not familiar with this file metaphor we use in computers, think about your camera roll on your phone. Every single photo you take is a file. It's an individual thing that you can send to other people or open up on your phone. That's a file. And these models are also files. They're just a a particular kind of file that's very large and have a bunch of numbers

3:37inside of them. Now, this is the key distinction to make because the model file itself is not connected to the internet. It was essentially created by analyzing the occurrence and relationships of every word on the internet. And so, the model file has all of that information embedded inside of it as a collection of numbers. You could think of it like an encyclopedia that predicts words, but it's not connected

3:58to anything. It it can't access the internet. It is literally just a file that when run through some other program predicts words. Now, the process of creating these models and analyzing all of this data is where a lot of the news is coming from. Because when you slurp up all the data from the internet, there's going to be a lot of copyrighted works in there as well as works from

4:17news organizations or individual blogs or musicians or artists. and they didn't necessarily agree up front that their data could be used to create this model file. And these models were not only trained on all of the data that exists on the internet, but also trained on more curated or synthetic data. And this is where this idea of distillation comes in. [music] It's essentially where you can prompt a model to see how it

4:41responds, then save that response in its own file. So these AI labs create these data sets of questions and answers and some of those questions and answers come from an existing model and there are actually a lot of open data sets online that are essentially this distillation of these models [music] because the models really are just a black box. They predict words but there's no way for us