The Belamy | Weekly dose of best Tech stories

Share this post

ChatGPT Threat Alert 🚨

analyticsindiamagazine.substack.com
AIM Daily XO

ChatGPT Threat Alert 🚨

Also in today's edition: Tesla’s Not-So-Mega Event, OpenAI’s Latest API & Benchmark for API

Analytics India Magazine
Mar 3
Share this post

ChatGPT Threat Alert 🚨

analyticsindiamagazine.substack.com

ChatGPT is largely a sane, empathetic and balanced chatbot shy of replying to racist and harmful questions because that’s how it was raised. On the contrary, ChatGPT and other large language model-based platforms can easily be manipulated. With prompt injections, these can turn insane, cruel and unbelievably biased.

In the case of ChatGPT, a prompt injection attack made the chatbot assume the persona of another chatbot named DAN (Do Anything Now) which ignored OpenAI’s content policy and provided information on all sorts of restricted topics. This vulnerability can be exploited for malicious intent, including the theft of personal information.

Keep reading with a 7-day free trial

Subscribe to The Belamy | Weekly dose of best Tech stories to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
Previous
Next
© 2023 Analytics India Magazine
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing