ChatGPT Plugins | ChatGPT Changes

With it's latest update OpenAI has added internet access inside of ChatGPT, the ability to upload images and video and audio and CSV files and connect it to your website and to do pretty much anything that you could possibly imagine and way more.

I'm going to show you everything about what this means for ChatGPT and the future of the internet. So let's dive into ChatGPT Plugins.

Join AI PRO

AI tools are going to revolutionize how we learn, work and perform everyday tasks but it can be really confusing knowing where to start.

To help you out and get ahead of the 99% I've created a course that covers everything to do with ChatGPT and AI that will take you from beginner to deeply understanding how to integrate AI into your existing productivity workflow and get more from your time.

You can sign-up for early-access via the waitlist below:

7-Day AI Pro Course

Welcome to 7-Day AI PROmpt Engineer the number 1 course for anyone wanting to become an expert in AI.

Alexander Young

Check Out My 7-Day AI-Prompt Course

What Are ChatGPT Plugins

Plugins work a little bit like the app store. You can search for them and add them to your ChatGPT interface and you can even build your own using ChatGPT itself, more on that later.

Plugins help ChatGPT access up-to-date information, run computations and use third-party services.

Plugins are launching with two built by OpenAI which allow ChatGPT to browse the web and interpret python code in a sandboxed environment respectively as well as a host of thrid party plugins which we'll see shortly. OpenAI have also included an open source plugin called retrieval which will enable ChatGPT to access personal or organizational information sources (with permission). So let's look at each in turn.

ChatGPT Web Browsing Plugin

So previously ChatGPT could only return data up to the end of 2021 based on the data set it had been trained on. With the browser plugin enabled ChatGPT can identify if a request requires more up-to-date information and will then search the internet to augment its response. One of the issues with allowing real-time search is that unlike a dataset the information isn't controlled and there is a higher chance of incorrect information and fake news being returned.

To combat this the browse plugin shows where ChatGPT is pulling the information from and also references the sources of the information at the end.

Code Interpreter

The code interpreter plugin is really cool providing a working Python interpreter in a sandboxed, firewalled environment. This basically means that files can be uploaded to this environment and then worked on by ChatGPT. The use cases here are huge.

From uploading a csv or excel data file and having ChatGPT interrogate the data and create graphs to building a working app, testing it and then downloading the results.

One of the coolest features is being able to edit files in real time for example changing the resolution and attributes of an image and then downloading it as a new file type.

Retrieval

The retrieval plugin is more of an opensource tool that you can customise. By using the code you can grant ChatGPT to your own data. A bit like the browse functionality ChatGPT will then be able to search your own data source and return responses.

This means ChatGPT will be able to search your files, notes, emails or public documentation in an instant which will be great for organizations wanting to trawl through loads of their own data where previously they needed cloud-hosted AI systems to find trends and work with that data. And it will also be pretty revolutionary for personal use too if you're looking to organize files or pull out information en-masse from emails.

Third Party Plugins

We've then got a whole host of third-party plugins. This library will continue to grow with the first plugins created by Expedia, FiscalNote, Instacart, KAYAK, Klarna, Milo, OpenTable, Shopify, Slack, Speak, Wolfram, and Zapier to access their data and databases.

What's really cool is that you'll be able to combine these plugins to do things like organize your meal prep for the week by searching for groceries, calculating their calories with Wolfram-Alpha and then ordering them through instacart.

With Zapier there too you'll be able to set up a tonne of custom integrations and workflows on top of these helpful plugins too without needing to leave ChatGPT.

And that's the paradigm shift here. Plugins moves ChatGPT towards being a platform that you won't need to switch out of and from where you can access all your tools without needing to go to google or websites.

Create Your Own ChatGPT Plugin

It's also great for developers as you can actually use ChatGPT to create your own plugin which is just so awesome. Plugins use manifest files and connect to ChatGPT via APIs. This will be a great way to drive usage of your app or service through ChatGPT and power-up ChatGPT beyond it's initial training data which ended at 2021.

This continues to be super exciting and I imagine we'll see some really creative plugins coming out over the next 12-months and possibly some paid plugins as we often see when platforms launch such as the app store.