ChatGPT Can Now Access Internet & Run Code

OpenAI has recently announced that their ChatGPT AI language model has gained new capabilities through the launch of a plugin ecosystem. These new abilities include the ability to access the internet, run its own code, accept and work on uploaded files, and create interfaces to third-party apps. These new features are significant, as ChatGPT is now able to provide users with up-to-date information that is not present in its outdated knowledge base.

ChatGPT can now access the internet to search for relevant information to answer user queries. It uses relevant search strings and sends them to Bing to obtain the necessary information. It can also read and follow links deemed relevant until it decides it has an accurate answer for the user. This feature is read-only, and ChatGPT cannot fill out forms or perform any other online activity. OpenAI ensures that everything that happens within the search API is kept separate from the rest of its infrastructure to avoid any issues.

The AI is also equipped with a working Python interpreter and some disk space to run code and download/upload files. This means that ChatGPT can write and run code to complete user tasks that require significant data crunching. The AI can process data in various formats, perform operations, and return them in the requested format. It can even convert JPGs into annotated graphs or resize them.

OpenAI has also provided access to several initial third-party plugins, with more to follow, which include booking plugins like Expedia, OpenTable, and Kayak. Shopping plugins like Instacart, Klarna, and Shop can compare products and set up orders. A Wolfram|Alpha plugin gives GPT access to math and computing powers, as well as streams of real-time data. Additionally, a Zapier plugin acts as a gateway that allows ChatGPT to access over 5,000 other apps, including Gmail, Google Sheets, Trello, HubSpot, and Salesforce.

Despite the amazing potential of ChatGPT, OpenAI is aware of the dangers and is taking precautions to ensure safety. The AI’s capabilities are currently limited to setting things up rather than making transactions with users’ money. The plugins will gradually become available to paid users and developers through a waitlist. The creation of plugins is expected to proliferate since developers do not need to code them. All that is required is an OpenAPI manifest and human language descriptions for everything.

The pace of progress at OpenAI has been rapid, and the release of the plugin ecosystem represents ChatGPT’s ability to operate in the real world. OpenAI is also taking steps to ensure that the AI is not used for nefarious purposes. However, these steps may not be enough to prevent less principled actors from developing competing AIs with similar capabilities.

The opportunities presented by ChatGPT’s new abilities are immense, but the risks are equally unprecedented. As ChatGPT moves forward with its new capabilities, it enters uncharted territory, and the accelerator pedal is jammed to the floor. The potential for AI to revolutionize the world is enormous, but it is essential to proceed with caution to ensure that these powerful tools are used for good.