How To Use ChatGPT Vision To Learn Faster | 10 ChatGPT Vision Prompts For Studying

GPT Vision allows us to upload an image and use GPT4 to analyse that image meaning we can do some very cool things to help us learn; from solving a written math equation to translating a sign in a foreign country.

Being able to add images to ChatGPT saves me loads of time, but there aren't many guides on how to use it to help us to study and learn faster and more effectively so I've put together 10 of the best vision prompts that you can use right now to take your learning to the next level.

Explain Any Diagram

When we first come across a new diagram in a book it can take time to figure out exactly what it means and deepen our understanding and wider context.

For example this image of the brain is pretty meaningless unless I spend time understanding more about each of the labelled structures so I have context.

With GPT4 Vision we can now massively reduce this time by simply uploading the image to ChatGPT and using a prompt like:

/Example Prompt

Explain this image to me in simple terms that I can understand and provide wider context to the labelled structures.

Solve Math Problems

Getting stuck on any kind of math problem can be really irritating and unless you have someone there to explain it to you figuring it out can eat into hours of your time.

GPT Vision is a game changer here as you can quickly take a picture of an equation or visual math problem from a text-book or screenshot it online and then upload it to ChatGPT and use a prompt like:

/Example Prompt

You are a math expert. Please solve this math problem.
Explain in a step-by-step guide how to solve this problem to help me understand.

Summarize A Book Page

If you want to remember everything you read we need to have a capture system that stores what we've read in a knowledge repository. This is what building a second brain is all about.

The problem is that most note systems allow you to capture content but then you need to spend time pulling out the useful information and applying it to your life.

With GPT Vision we can now quickly capture a page from a book or screenshot from an online article and have ChatGPT summarize the key points and also help us to apply those points into our lives.

We can even upload multiple images and summarize multiple pages all at once.

We can use a prompt like:

//Prompt

Summarize this book screenshot and give me actionable steps for apply each of the principles to my life.

Create a Quiz from this Image

Active recall is the most effective way to make sure we are actually learning and that what we are learning is sticking in our brains.

When it comes to images it can be tricky creating recall questions as there's no text to copy and paste.

With ChatGPT we can now upload any image and ask ChatGPT to create recall questions that help us to better remember the image or diagram.

Let's take this incorrectly labeled animal cell from biology and use the following prompt.

//Prompt

Write a multiple choice question with 1 correct answer and 4 incorrect distractor answers from the image.
Answers should be labelled A to E.
Provide an explanation and the correct answer at the end.

Explain Data

Tables, charts and datasets help visually convey information to us quickly but sometimes understanding and interpreting the data can be time-consuming.

Luckily ChatGPT can help us here too. I've been uploading graphs and charts from research papers to save time interpreting what the data actually means.

For example we can upload this series of bar charts from Jeffrey Karpicke's research into effective learning methods use the following prompt to learn more about the data and what it means.

//Prompt

Explain to me the significance of the data shown in these graphs from a study by Karpicke et al into the effectiveness of learning methods

Turn A Design Into Code

If we're learning how to code practical tasks get us to mastery much faster than just reading theory.

Sometimes we have a vision for what we want to code and we're just not sure where to start.

To help short-circuit this I've been using ChatGPT to analyse hand-drawn website wireframes and screenshots of websites and then asking it to breakdown how the code is structured as a coding tutor.

For example we can upload this hand drawn wire frame and then say to ChatGPT:

//Prompt

Take this image of a website landing page wireframe and write the code for the website which I can then use. Provide and explanation for key sections of code so I can learn from the process.

Translate this into English

While deliberate study sessions are necessary for learning sometimes we want to learn something in the moment. This is called just in time learning and it's really effective as we're already curious about a topic and actively want to learn more.

For example if I'm on holiday I'll want to understand what a street sign might say as it helps me to navigate and it also helps me to learn a new language.

With ChatGPT app we can take a picture on our phones and then have GPT Vision translate in real time. And this works great if you like learning a new language from a book too as you can upload and then have ChatGPT act as a language tutor.

For example we can upload a photo of a Japanese street sign and then use the prompt.

//Prompt

Translate this sign into English

Describe this picture in Spanish

One of the best ways to learn a new language quickly is to combine the new language with things you're familiar with.

I like watching a film on Netflix in a different language or reading a book I'm familiar with in a language I'm learning. Our brains then fill in the gaps.

ChatGPT Vision can help here too. We can upload a familiar photograph and then ask ChatGPT to describe the photo. As we sort of know the description already it will challenge us to figure out language we don't know.

We us the prompt:

//Prompt

You are a spanish teacher. Describe this image to me in Spanish so that I can match Spanish words with visual elements I am familiar with in English.

We can then ask ChatGPT to give us the description in our own language to see how we did.

Optimize My Schedule

Creating an effective study schedule helps us to organize how effectively we learn. The problem is organizing learning schedule sessions around a busy life can be really difficult.

ChatGPT Vision can help here. You can upload an image of your hand-drawn time table or grab a screenshot from your computer and then ask ChatGPT to optimize it.

We can use the prompt:

//Prompt

Take this image of my study schedule and optimize it to help me to learn effectively.
Output the final schedule in a table format which I can copy.

Create A Teaching Session With Multiple Images

One cool thing you might have missed with ChatGPT Vision is that you can actually upload multiple images at the same time.

This is great if you want to create a teaching session on a topic from a book where you might want to grab images of multiple pages.

Teaching is a great way to share what you've learned with others while helping you to consolidate your own learning but creating materials takes time.

With ChatGPT Vision we can upload multiple images and then create an interactive teaching session using the prompt:

//Prompt

Summarize the content of these book pages and then design a 20-minute lesson I can use to teach sales people at my company covering the principles in the book pages.
Combine Gagne's 9 event of instruction with immersion learning when creating the lesson.