The rapid advancement of Generative Artificial Intelligence (GenAI) has led to its widespread adoption. However, this growth has also introduced new security vulnerabilities, particularly in the realm of prompt hacking. This talk will delve into the evolution of GenAI and the associated risks, followed by a comprehensive exploration of prompt hacking techniques, both direct and indirect, and the potential consequences of prompt injection attacks.
In this session, you will gain insights into the vulnerabilities that can be exploited to manipulate GenAI systems, through real-world examples of prompt hacking, including exploits targeting food delivery services, document editing tools, and even the registration process for highly sought-after AI models. You will also learn to mitigate the risks associated with prompt hacking, as we discuss effective countermeasures such as prompt segmentation and privilege boundaries.
At the end, you will leave with a clear understanding of how your organization can safeguard its GenAI systems and ensure the responsible and secure use of these systems.