Please πŸ–±οΈ here for Github Blogs

AI Skills and Tools by Phase

  • August 25, 2026
Table of Contents

Introduction

This post is part five of a series on software engineering in Telly’s fintech domain. It collects the AI capability stack a team needs, maps each skill to the lifecycle phase where it earns its keep and shows two open-source implementations of the ideas.

AI Skills and Tools by Phase

Note: The placement of AI skills and tools across the SDLC is a work in progress. A dedicated matrix mapping each skill and tool to its optimal lifecycle phase is planned.

The AI Execution Stack

To do work across the SDLC phases, a team needs a stack of AI capabilities. Context engineering is the foundation β€” it is what makes all other skills grounded rather than guessing β€” but it is not sufficient on its own. The full stack:

AI SkillWhat It DoesPrimary Phases
Context engineeringWhat the model sees β€” memory, scoping, compression, selective loadingAll phases (the backbone)
Prompt engineeringHow you ask β€” wording, examples, instruction hierarchy, formattingAll phases
Spec-driven developmentStructured specs in β†’ implementation, tests and docs out1 (Requirements), 2 (Architecture)
Code and test generationCreating artifacts β€” code, tests, infrastructure as code, pipelines3 (Development), 4 (Testing), 5 (Build & Release)
Evaluation (evals)Verifying non-deterministic output β€” golden datasets, model-graded metrics, CI gates4 (Testing), 6 (Production)
Adversarial analysis (grill me)Challenging assumptions, attacking edge cases, defending the business case0 (Discovery), 2 (Architecture review)
Retrieval and groundingPulling external knowledge into the context window β€” chunking, embeddings, re-rankingAll phases (feeds context engineering)
Observability and analysisMonitoring, anomaly detection, summarisation, cost governance6 (Production), 7 (Maintenance)
Guardrails and safetyPrompt injection defence, hallucination mitigation, secrets handling, supply-chain scanningAll phases (cross-cutting)

The context engineering repo feeds spec-driven development and retrieval directly. Those two are what make the other skills work β€” without structured specs, code generation is guessing; without retrieval, context engineering has nothing to load.

Preliminary Skill-to-Phase Mapping

  • Grill Me (adversarial interrogation) β€” Phase 0: Discovery. The highest value of challenging assumptions and defending the business case is before a single requirement is written. By Phase 1 you have already decided the problem is worth solving. Also applies during architecture review (Phase 2) and later review cycles.
  • Spec-driven development β€” Phase 1: Requirements and Phase 2: Architecture. Agents derive user stories, acceptance criteria, solution designs and test cases from structured specifications stored in the context engineering repo.
  • Code and test generation β€” Phase 3: Development. The most natural fit for autonomous and observed operating modes. Grounded by ADRs, design specs and domain knowledge from the context engineering repo.
  • Evals and quality gates β€” Phase 4: Testing. Non-deterministic output needs non-deterministic testing: golden datasets, model-graded metrics, invariant checks and CI gates.
  • Retrieval and grounding β€” All phases. The mechanism that pulls the right documents from the context engineering repo into the model’s window for the current task.
  • Observability and cost governance β€” Phase 6: Production. Monitoring model behaviour, prompt drift, evaluation regression and token spend.

The 3D Matrix

The full framework is a three-dimensional matrix:

  1. SDLC Phases (0–8) β€” when the work happens
  2. Personas (29 roles) β€” who does it, with O/R/C/A involvement
  3. AI Skills β€” how it gets done, with operating mode (HITL/OHOTL/AHOTL)

Each cell defines the persona’s involvement, the AI skill applied, the document produced or consumed, and the quality gates that must pass before advancing. The context engineering repo is the physical manifestation of this matrix β€” organised by phase, owned by personas, populated by AI skills, validated by gates.

Practical Implementations

Two open-source projects demonstrate what the third axis (AI Skills) looks like in practice:

obra/superpowers (82K+ stars) β€” a composable skills framework where skills trigger automatically based on context. Key skills map directly to our execution stack:

Superpowers SkillMaps To
brainstormingAdversarial analysis (grill me) β€” explores intent and requirements before implementation
writing-plansSpec-driven development β€” creates implementation plans before touching code
verification-before-completionEvals / quality gates β€” requires running verification commands before claiming work is done
dispatching-parallel-agentsAgent orchestration β€” subagent-driven development
writing-skillsSkill authoring β€” creating new reusable skills

addyosmani/agent-skills (87K+ stars) β€” production-grade engineering skills organised into a lifecycle: Plan β†’ Build β†’ Verify β†’ Review β†’ Ship. Encodes Google’s engineering practices (Hyrum’s Law, test pyramid, trunk-based development) as step-by-step agent workflows. Includes references (definition of done, testing patterns, security checklist, performance checklist, accessibility checklist, observability checklist) that function as quality gates, and a built-in evals framework.

Both frameworks treat skills as markdown-based process documentation β€” exactly the kind of content that would live in the context engineering repo. The difference is that superpowers emphasises automatic skill discovery and composition, while agent-skills emphasises structured lifecycle stages with verifiable exit criteria.

References

Online references:

  • obra (2025). Superpowers: agentic skills framework and software development methodology. github.com/obra/superpowers.
  • Osmani, A. (2026). Agent Skills: production-grade engineering skills for AI coding agents. github.com/addyosmani/agent-skills.
Share :
comments powered by Disqus

Related Posts

GitHub Copilot Notes.

GitHub Copilot and customization instructions together unlocks a structured, repeatable way to guide AI assistance across your codebaseβ€”covering custom instructions, reusable prompt files, agent mode and extensible skills for end-to-end AI-driven workflows.

Read More

Testing LLM Outputs: Evals for Models, Agents, and Skills

LLM outputs are non-deterministic, which breaks the assumptions most of our testing tooling is built on. This document covers how to actually test model outputs, agent trajectories, and Claude Code-style skills β€” the layers of evaluation, the current 2026 tool landscape, and a working CI harness you can copy.

Read More

DeepEval: CI-Gated Typed Metrics for LLM Outputs

DeepEval is an open-source Python framework with 50+ ready-made metrics for LLM outputs: faithfulness, hallucination, toxicity, bias, G-Eval rubrics, agent and conversation metrics, plus deterministic checks. You build test cases, score them with metrics, and fail CI when a score drops below its threshold. This is the complete reference.

Read More