GPT Vision allows us to upload an image and use GPT4 to analyse that image meaning we can do some very cool things to help us learn; from solving a written math equation to translating a sign in a foreign country.
Being able to add images to ChatGPT saves me loads of time, but there aren't many guides on how to use it to help us to study and learn faster and more effectively so I've put together 10 of the best vision prompts that you can use right now to take your learning to the next level.
Explain Any Diagram
When we first come across a new diagram in a book it can take time to figure out exactly what it means and deepen our understanding and wider context.
For example this image of the brain is pretty meaningless unless I spend time understanding more about each of the labelled structures so I have context.
With GPT4 Vision we can now massively reduce this time by simply uploading the image to ChatGPT and using a prompt like:
Explain this image to me in simple terms that I can understand and provide wider context to the labelled structures.
Solve Math Problems
Getting stuck on any kind of math problem can be really irritating and unless you have someone there to explain it to you figuring it out can eat into hours of your time.
GPT Vision is a game changer here as you can quickly take a picture of an equation or visual math problem from a text-book or screenshot it online and then upload it to ChatGPT and use a prompt like:
You are a math expert. Please solve this math problem.
Explain in a step-by-step guide how to solve this problem to help me understand.
Summarize A Book Page
If you want to remember everything you read we need to have a capture system that stores what we've read in a knowledge repository. This is what building a second brain is all about.
The problem is that most note systems allow you to capture content but then you need to spend time pulling out the useful information and applying it to your life.
With GPT Vision we can now quickly capture a page from a book or screenshot from an online article and have ChatGPT summarize the key points and also help us to apply those points into our lives.
We can even upload multiple images and summarize multiple pages all at once.
We can use a prompt like:
Summarize this book screenshot and give me actionable steps for apply each of the principles to my life.
Create a Quiz from this Image
Active recall is the most effective way to make sure we are actually learning and that what we are learning is sticking in our brains.
When it comes to images it can be tricky creating recall questions as there's no text to copy and paste.
With ChatGPT we can now upload any image and ask ChatGPT to create recall questions that help us to better remember the image or diagram.
Let's take this incorrectly labeled animal cell from biology and use the following prompt.
Write a multiple choice question with 1 correct answer and 4 incorrect distractor answers from the image.
Answers should be labelled A to E.
Provide an explanation and the correct answer at the end.
Tables, charts and datasets help visually convey information to us quickly but sometimes understanding and interpreting the data can be time-consuming.
Luckily ChatGPT can help us here too. I've been uploading graphs and charts from research papers to save time interpreting what the data actually means.
For example we can upload this series of bar charts from Jeffrey Karpicke's research into effective learning methods use the following prompt to learn more about the data and what it means.
Explain to me the significance of the data shown in these graphs from a study by Karpicke et al into the effectiveness of learning methods
Turn A Design Into Code
If we're learning how to code practical tasks get us to mastery much faster than just reading theory.
Sometimes we have a vision for what we want to code and we're just not sure where to start.
To help short-circuit this I've been using ChatGPT to analyse hand-drawn website wireframes and screenshots of websites and then asking it to breakdown how the code is structured as a coding tutor.
For example we can upload this hand drawn wire frame and then say to ChatGPT:
Take this image of a website landing page wireframe and write the code for the website which I can then use. Provide and explanation for key sections of code so I can learn from the process.
Translate this into English
While deliberate study sessions are necessary for learning sometimes we want to learn something in the moment. This is called just in time learning and it's really effective as we're already curious about a topic and actively want to learn more.
For example if I'm on holiday I'll want to understand what a street sign might say as it helps me to navigate and it also helps me to learn a new language.
With ChatGPT app we can take a picture on our phones and then have GPT Vision translate in real time. And this works great if you like learning a new language from a book too as you can upload and then have ChatGPT act as a language tutor.
For example we can upload a photo of a Japanese street sign and then use the prompt.
Translate this sign into English
Describe this picture in Spanish
One of the best ways to learn a new language quickly is to combine the new language with things you're familiar with.
I like watching a film on Netflix in a different language or reading a book I'm familiar with in a language I'm learning. Our brains then fill in the gaps.
ChatGPT Vision can help here too. We can upload a familiar photograph and then ask ChatGPT to describe the photo. As we sort of know the description already it will challenge us to figure out language we don't know.
We us the prompt:
You are a spanish teacher. Describe this image to me in Spanish so that I can match Spanish words with visual elements I am familiar with in English.
We can then ask ChatGPT to give us the description in our own language to see how we did.
Optimize My Schedule
Creating an effective study schedule helps us to organize how effectively we learn. The problem is organizing learning schedule sessions around a busy life can be really difficult.
ChatGPT Vision can help here. You can upload an image of your hand-drawn time table or grab a screenshot from your computer and then ask ChatGPT to optimize it.
We can use the prompt:
Take this image of my study schedule and optimize it to help me to learn effectively.
Output the final schedule in a table format which I can copy.
Create A Teaching Session With Multiple Images
One cool thing you might have missed with ChatGPT Vision is that you can actually upload multiple images at the same time.
This is great if you want to create a teaching session on a topic from a book where you might want to grab images of multiple pages.
Teaching is a great way to share what you've learned with others while helping you to consolidate your own learning but creating materials takes time.
With ChatGPT Vision we can upload multiple images and then create an interactive teaching session using the prompt:
Summarize the content of these book pages and then design a 20-minute lesson I can use to teach sales people at my company covering the principles in the book pages.
Combine Gagne's 9 event of instruction with immersion learning when creating the lesson.