OpenAI has introduced significant updates to ChatGPT, allowing the AI chatbot to access and interact with users’ Google Chrome tabs. This development aims to improve the efficiency of task completion directly within the browser. The update was recently rolled out and marks a notable advancement in the capabilities of ChatGPT, making it more versatile for everyday users.

Alongside the browser integration, OpenAI has also enhanced ChatGPT’s voice features, adding support for several new languages, including Hindi. These improvements are designed to make interactions with the AI more seamless and user-friendly, catering to a broader audience.

Functionality of ChatGPT in the Browser

ChatGPT now operates in two distinct modes: Chat mode and Work mode. In Chat mode, the AI can sift through open tabs to gather pertinent information. For instance, if a user is considering purchasing a new sofa and has multiple websites open, they can instruct the AI to compare various options based on criteria such as size, materials, delivery time, and return policies. This functionality allows users to obtain relevant information without the need to switch between different browser windows.

Work mode takes this capability further by enabling ChatGPT to take control of browser tabs to execute tasks. Users can request the AI to fill out lengthy online forms, draft emails, send messages, download files, and even organise tabs into structured groups. Additionally, it can compile information from various websites into a straightforward comparison sheet, streamlining the user’s workflow.

To utilise these new features, users must have the ChatGPT desktop application and the official Chrome extension developed by OpenAI. After enabling the “Computer Use” feature in the app settings, users can install the extension from the Chrome Web Store, which boasts approximately 7 million users. Once installed, users can initiate a new chat in Work mode and issue commands to the AI by using the “@” symbol to select their browser.

Security Considerations for Users

While the prospect of granting AI access to browser tabs is appealing, security experts urge caution. The AI’s ability to read information displayed on the screen necessitates that users avoid keeping sensitive tabs open, such as online banking or private emails, during interactions with ChatGPT. OpenAI has implemented safety protocols, requiring the AI to seek user permission before engaging with new websites or downloading files.

Despite these precautions, there remains a risk of encountering malicious websites that could exploit vulnerabilities, a phenomenon referred to as “prompt injection.” Therefore, it is advisable for users to engage with this feature only on trusted websites to mitigate potential risks.

In addition to the browser capabilities, OpenAI has unveiled an update named GPT-Live-1.1 for ChatGPT, Codex, and Dots. This update introduces 13 new voices and enhances performance across multiple languages, including Hindi, French, German, Mexican Spanish, Korean, and Japanese. These advancements aim to make voice interactions with the AI more natural and accessible for non-English speakers.

OpenAI has indicated that these updated voice features are currently being rolled out to all users, with plans for availability to developers in the near future. This broadens the scope of interaction possibilities, making ChatGPT a more inclusive tool for diverse user needs.

Long or Short, get news the way you like. No ads. No redirections. Download Newspin and Stay Alert, The CSR Journal Mobile app, for fast, crisp, clean updates!

App Store – https://apps.apple.com/in/app/newspin/id6746449540

Google Play Store – https://play.google.com/store/apps/details?id=com.inventifweb.newspin&pcampaignid=web_share