From the course: Introduction to Large Language Models
Join today to access over 26,500 courses taught by industry experts.
What are context lengths?
From the course: Introduction to Large Language Models
What are context lengths?
- [Instructor] When having a conversation with a large language model, how can you figure out how much of the conversation it remembers? That's what context windows are all about. Now, if you remember, a prompt is the text you input into the model and it's made up of a couple of tokens. The completion is the text outputted from the model, which also makes up a couple of tokens. The sum of the tokens of the prompt and the completions is known as the "context window" or "context length". Now, the longer the context length, the more informational background the model has for generating a response. For a language model to produce a more meaningful and relevant response, it needs to be able to take an entire conversation into consideration. Now, different large language models will have different context lengths. Chat GPT currently has a context length of around 4,000 tokens. GPT-4 has 8,000 tokens. GPT-4-32k has 32,000…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.
