Skip to content

Guide · Agent skill

How to use the AI/LLM App Attack Testing skill (ai-llm-app-attack)

Updated · written with AI from the project's own documentation and checked against our catalogue data

The ai-llm-app-attack skill is a set of notes that tells an AI agent how to probe applications built on large language models for security weaknesses. It is written for penetration testers and red teams working on systems they are authorised to test, and for security students learning where AI application attack surfaces sit. After this guide you will know what the skill covers, how to install it, how to ask an agent to use it, and what limits to respect.

AI/LLM App Attack TestingAIPentest/CyberStrikeAI · Apache-2.0

Quick start

  1. 1Download the ZIP. Get the skill ZIP from the directory page for ai-llm-app-attack.
  2. 2Unzip the folder. Extract the archive so the folder contains SKILL.md.
  3. 3Place it in the skills folder. Move the folder to ~/.claude/skills/ for personal use, or to .claude/skills/ inside a project.
  4. 4Or upload it in the apps. In the Claude apps, go to Settings → Capabilities → Skills and upload the skill.
  5. 5Ask with a clear scope. Describe the target, your written authorisation, and the attack area you want tested.
  6. 6Verify before reporting. Only record a finding after a tool side effect is confirmed, such as a callback or a file read.

What the skill makes the agent do

Agent skills are folders containing a SKILL.md file of instructions that an AI agent can load when a task matches. This skill's SKILL.md covers attack categories against LLM applications, and tells the agent how to approach them.

The categories listed include direct prompt injection, where the user tries to override instructions, and indirect prompt injection, which the source describes as the more dangerous form because instructions can be hidden in RAG documents, web pages, emails, tool return values or image EXIF data. It also covers abuse of agent tools, system prompt leakage, RAG poisoning, excessive authorisation and cross-tenant access, MCP plugin supply-chain risks, resource cost attacks, insecure handling of LLM output, and unsafe loading of PyTorch model files via pickle.

  • Agent tool abuse: code interpreter injection, fetch tools reaching internal networks or cloud metadata (SSRF), file tools reading files such as /etc/passwd, SQL tools dumping tables, and shell tools with command injection.
  • Model files: torch.load defaults to pickle, which the source flags as an RCE risk.
  • Endpoint discovery: capture traffic to find paths such as /chat, /agent or /tool, and ask the agent what tools it has.

Install the skill from the ZIP or the Claude apps

Download the ZIP for this skill from the directory page and unzip it. For a personal install, place the unzipped folder in ~/.claude/skills/. For a single project, place it in that project's .claude/skills/ folder.

If you use the Claude apps instead, upload the skill under Settings → Capabilities → Skills.

  • Personal install: ~/.claude/skills/ai-llm-app-attack/
  • Project install: .claude/skills/ai-llm-app-attack/ inside your project
  • The package contains a single file, SKILL.md.

Trigger the skill with natural requests

You do not need a special command. The skill's description says to use it when testing LLM apps, agents, RAG, MCP plugins, or AI model file risks, so ask in those terms and name the scope you are authorised to test.

Include the target, what you own or have permission to test, and the area you want covered. Vague requests are less useful than specific ones.

  • "I have written permission to test our support chatbot at this staging URL. Check it for indirect prompt injection through uploaded documents."
  • "Review this MCP plugin before we deploy it. Look for supply-chain risks and tool abuse paths."
  • "Our RAG pipeline ingests partner PDFs. Assess whether a poisoned document could change answers."
  • "Check whether this project loads model files with torch.load and where pickle could lead to code execution."

Understand what you need before you start

The source lists no required dependencies, does not say the skill runs scripts, and does not say it uses the network. Its only file is SKILL.md. Whether the agent you use can reach your target is determined by your agent and environment, not by this skill's listed requirements.

Because the skill describes live exploitation techniques, treat any run against a real system as a controlled test. Confirm scope and authorisation first.

  • Requires: nothing listed in the source.
  • Runs scripts: no. Uses network: no (per the listing).
  • Only test systems you own or have written permission to test.

Read the verification rule before you report findings

The skill states that a finding should only be recorded once a tool side effect is actually confirmed, for example an out-of-band callback or a file being read. A suspicion that an injection might work does not count on its own.

Use this rule to keep reports accurate. Record the evidence you captured, such as the callback received or the file content read, rather than the attempted payload alone.

Safety notes and limits

The content is written from an attacker's perspective and gives no mitigations. Developers looking for defensive hardening guidance should use a different resource. Do not use the skill against systems outside your authorised scope, as this could cause harm or legal trouble.

Keep test activity contained, record what you did, and stop when your scope ends.

  • Not for systems you do not own or lack written permission to test.
  • Not a defensive hardening guide; it includes no mitigations.
  • Licence: Apache-2.0.

What people use it for

  • Checking a support chatbot for indirect prompt injection hidden in uploaded documents.
  • Reviewing an MCP plugin for supply-chain risks and tool abuse before deployment.
  • Assessing whether a RAG pipeline could be poisoned by untrusted partner files.
  • Auditing a project for torch.load pickle loading of untrusted model files.
  • Mapping an LLM application's endpoints and tools as a starting point for an authorised test.

Frequently asked questions

Is the ai-llm-app-attack skill free?

The skill is listed under the Apache-2.0 licence. The source does not mention pricing, so check the licence terms in the repository before you use or redistribute it.

What do I need to install the ai-llm-app-attack skill?

The listing states no required dependencies. Download the ZIP, unzip it, and place the folder in ~/.claude/skills/ or a project's .claude/skills/ folder, or upload it under Settings → Capabilities → Skills in the Claude apps.

Does this skill run scripts or use the network?

According to the listing, it runs no scripts and uses no network access. Its only file is SKILL.md, which contains instructions for the agent.

Can I use this skill to test any website?

No. It should only be used on systems you own or have written permission to test. The content describes live exploitation techniques that could cause harm or legal trouble if misused.

What is the difference between direct and indirect prompt injection?

Direct prompt injection is when a user tries to override an application's instructions in their own message, such as asking for the system prompt. Indirect injection hides instructions in content the agent reads, such as documents, web pages, emails or tool outputs, and the source calls this the more dangerous form.

Is this skill useful for defending my LLM application?

Not directly. The file is written from an attacker's perspective and gives no mitigations, so developers wanting hardening guidance will need another resource.

New agent skills, repos and AI tools — every week

The best new skills and open-source projects, the fastest-growing repos, and one free prompt. Five minutes to read. Unsubscribe anytime.

Our verdict

This skill suits penetration testers, red teams and security students who are authorised to test LLM applications, agents, RAG pipelines or MCP plugins and want a structured set of attack categories. It is a poor fit for developers seeking defensive guidance, and anyone without written permission for the target should not use it.

Download the skill