AI security: secure and test LLM apps and agents

Stage 1 · Lesson 7 of 7

Severity when failures are probabilistic

Security foundations for AI builders

A tester's findings are only useful if they are ranked well. Severity combines likelihood (how easy and how probable is it?) and impact (what does the attacker gain?). , the common 0 to 10 scale, works for classic bugs, and many teams adjust it for AI findings.

Two AI-specific points matter. First, many model failures are probabilistic: an issue that happens one time in fifty can still be serious if an attacker can retry for free, so record the rate. Second, impact depends on what the app can do, not on what the model said: an embarrassing answer is low impact, a tool call that leaks another user's data is high.

Common traprating every as critical, which teaches the team to ignore your reports.

A question to check yourself, an AI practice session and 1 cheat sheet entry come with the full roadmap. Unlock

Resources for this stage

Start with· follow one of these

Practise

  • Free labs on injection, XSS, access control and SSRF, the weaknesses AI apps inherit

  • A deliberately vulnerable web app to run locally and practise finding and fixing classic bugs

Keep handy

  • Short, reliable guides on threat modelling, secrets, output encoding and SSRF prevention

  • Scan your repositories for committed keys before you build anything with a model API

Also worth your time

Mark this stage as not done?