Skip to content

Custom Tasks and Pipelines

Lets the agent write and run its own cognee processing pipelines with custom tasks and graph nodes.

Stars
33,002
Licence
Apache-2.0
Files
1 file

What it does

This skill teaches the agent how to build custom processing steps for cognee, an open-source memory and knowledge-graph tool. Cognee processes data as a pipeline of small Python functions called tasks; with this skill the agent can write its own tasks, chain them together, store custom node types in the graph, run enrichment over an existing graph, and check run status or debug how data moves between steps. For ordinary document ingestion the skill says to use the simpler remember() call instead.

Great for

  • Developers building custom extraction or post-processing on top of cognee
  • Data engineers who need custom node types stored in a cognee knowledge graph
  • Anyone debugging why data is not flowing correctly between cognee pipeline tasks

Skip it if

  • Simple document ingestion, where the skill itself recommends remember() instead, because custom pipelines add complexity
  • Users without a configured cognee installation, since the code depends on cognee's graph and vector databases and any LLM it calls needs credentials
  • Production data without testing, since pipelines write to the graph and vector stores and the skill notes some APIs are deprecated and being removed

Try asking

  • “Write a custom task that extracts people's names from my documents and stores them as Person nodes in cognee”
  • “Set up a pipeline that tags every chunk with a label and then saves it to the graph”
  • “Check the status of my custom_pipeline run on the people dataset”
  • “Debug why my task receives a list instead of a single document item”
Step-by-step guide: how to use Custom Tasks and PipelinesInstall, first run, examples, tips and FAQs

Install in 3 steps

  1. 1

    Download the skill

    The ZIP contains the 1 original files, the Apache-2.0 licence and an attribution note.

    cognee-custom-pipelines.zip
  2. 2

    Add it to your agent

    Claude Code (all projects)

    mkdir -p ~/.claude/skills && unzip cognee-custom-pipelines.zip -d ~/.claude/skills/

    Claude Code / Agent SDK (this project only)

    mkdir -p .claude/skills && unzip cognee-custom-pipelines.zip -d .claude/skills/

    Claude apps (web/desktop): Settings → Capabilities → Skills → Upload skill, and choose the ZIP.

  3. 3

    Ask for the task

    No special command needed — the agent reads the skill's description and loads it when your request matches. Try one of the prompts above.

Get better results

  • Start with needs_llm=False on tasks that do not call a model, and test on a small dataset first
  • Give every custom DataPoint identity_fields so repeated runs merge instead of duplicating nodes
  • Remember that the first task receives a one-element list per document when using run_custom_pipeline

What's inside

  • SKILL.md

Redistributed unmodified from topoteretes/cognee under the Apache-2.0 licence. The assessment was drafted with AI from the skill's files on 2026-10-29. Skills can instruct your agent to run code — read SKILL.md and any scripts before installing.