Red teaming is the practice of deliberately attacking an AI system to find its weaknesses before real adversaries or accidents do. Testers try jailbreaks, prompt injections, biased outputs, data leaks, and harmful content generation, then report findings so developers can strengthen defenses. Before a Moroccan bank launches a customer chatbot, a red team would probe whether it can be tricked into revealing account data.
Ethics & Safety
Red Teaming
Related terms
Learn to use these concepts in practice.
Join the 212AY Academy →