The past 24 hours have been filled with a variety of groundbreaking developments in the world of Machine Learning and Artificial Intelligence. From new vulnerabilities of Large Language Models (LLMs) integrated into various applications to targeted adversarial prompting, such as Prompt Injection (PI) attacks, to the exploration of ChatGPT Jailbreaking and AI Safety Nerfing, the possibilities of AI are growing ever more expansive.
Here are the key takeaways from the highlighted videos from the past 24 hours:
- A new attack vector, Indirect Prompt Injection, enables adversaries to remotely exploit LLM-integrated applications by strategically injecting prompts into data likely to be retrieved.
- A comprehensive taxonomy of the impacts and vulnerabilities of these attacks, including data theft, worming, and information ecosystem contamination, has been developed.
- Practical viability of Indirect Prompt Injection attacks against real-world systems and synthetic applications built on GPT-4 has been demonstrated.
- Solutions, the difficulty of detecting prompt injection attacks, and the need for separating instruction and data channels have been discussed.
Welcome to the latest installment of our series, ChatGPT! In this edition, we explore the new threat of Indirect Prompt Injection Exploits and learn how to stay safe from it. Scroll down to view the highlighted videos to learn more about the implications of this new attack vector, as well as potential solutions for defending against it.
Advertisement
Wed Jun 21 2023 17:51:35 UTC
GPT, Chat GPT, gpt chat,chatgpt,Prompt,ChatGPT,Melhores Prompts,Best prompts,Prompts secretos,Prompts incríveis.
Link para o Prompt: https://github.com/sandeco/prompts/blob/main/18%20-%20PROMPT%20INJECTION%20DETECT.txt
No episódio #018 da nossa série “ChatGPT”! você vai aprender tudo sobre a técnica de Prompt Injection que é um ataque que pode hackear o ChatGPT e aprender um Prompt de defesa contra hackers no GPT.
Os hackers estão cada vez mais sofisticados, e é essencial estarmos preparados para proteger nossos sistemas e informações pessoais. Neste episódio, vamos explorar em detalhes a técnica de Prompt Injection e uma poderosa ferramenta de defesa usando o próprio GPT.
🚀 Ei, vamos nos conectar em outras plataformas? Aqui estão elas:
📸 Instagram: Capture a vida comigo! https://www.instagram.com/sandeco/
🐦 Twitter: Vamos tuitar juntos? https://twitter.com/sandeco
💻 Github: Quer ver os códigos por trás dos vídeos? https://github.com/sandeco
🎥 TikTok: Vamos fazer o tempo parar, junte-se a mim TikTok https://www.tiktok.com/@sandeco
🔗 LinkedIn: Vamos fazer negócios juntos? Conecte-se comigo aqui https://www.linkedin.com/in/sandeco-macedo-8638b429/
Não vejo a hora de nos conectarmos mais!🎉
00:00 Introdução 01:00 Contextualização 03:00 Discussão do Tópico Principal 07:00 Exemplos Práticos 11:00 Conclusão
Advertisement
Sun Jun 18 2023 23:00:25 UTC
Links: – The Asianometry Newsletter: https://asianometry.substack.com – Patreon: https://www.patreon.com/Asianometry – Twitter: https://twitter.com/asianometry
Advertisement
Mon Jun 5 2023 8:52:08 UTC
A paper discusses the vulnerability of Large Language Models (LLMs) integrated into various applications to targeted adversarial prompting, such as Prompt Injection (PI) attacks. The authors introduce a new attack vector, Indirect Prompt Injection, which enables adversaries to remotely exploit LLM-integrated applications by strategically injecting prompts into data likely to be retrieved. The paper provides a comprehensive taxonomy of the impacts and vulnerabilities of these attacks, including data theft, worming, and information ecosystem contamination. The authors demonstrate the practical viability of their attacks against real-world systems and synthetic applications built on GPT-4. The paper aims to raise awareness of these vulnerabilities and promote the safe and responsible deployment of LLMs and the development of robust defenses against potential attacks. Comments discuss potential solutions, the difficulty of detecting prompt injection attacks, and the need for separating instruction and data channels.
🔗 https://arxiv.org/abs/2302.12173
#Prompt #GPT #LLM
Advertisement
Mon May 22 2023 23:36:28 UTC
References: ►Prompt hacking competition: https://www.aicrowd.com/challenges/hackaprompt-2023#introduction ►Learn prompting (everything about prompt hacking and prompt defense): https://learnprompting.org/docs/category/-prompt-hacking ►Prompting exploits: https://github.com/Cranot/chatbot-injections-exploits ►My Newsletter (A new AI application explained weekly to your emails!): https://www.louisbouchard.ai/newsletter/ ►Twitter: https://twitter.com/Whats_AI ►Support me on Patreon: https://www.patreon.com/whatsai ►Support me through wearing Merch: https://whatsai.myshopify.com/ ►Join Our AI Discord: https://discord.gg/learnaitogether
How to start in AI/ML – A Complete Guide: ►https://www.louisbouchard.ai/learnai/
#ai #chatgpt #prompting
Advertisement
Mon May 8 2023 20:12:35 UTC
Many courses teach prompt engineering and currently pretty much all examples are vulnerable to Prompt Injections. Especially Indirect Prompt Injections are dangerous. They allow untrusted data to take control of the LLM (large language model) and give an AI a new instructions, mission and objective.
This video aims to raise awareness of this rising problem.
Injections Lab: https://colab.research.google.com/drive/1qGznuvmUj7dSQwS9A9L-M91jXwws-p7k
Prompt Engineering Overview 0:00 Prompt Injections Explained 2:05 Indirect Prompt Injection and Examples 4:03 GPT 3.5 Turbot vs GPT-4 5:55 Examples of payloads 6:15 Indirect Injections, Plugins and Tools 8:20 Algorithmic Adversarial Prompt Creation 10:35 AI Injections Tutorials + Lab 12:22 Defenses 12:39 Thanks 14:40
Advertisement
Wed May 3 2023 16:09:05 UTC
Full transcript and notes at https://simonwillison.net/2023/May/2/prompt-injection-explained/
Advertisement
