close
Skip to content

cisco-open/ai-harness-toolkit

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

AI Harness Toolkit

Stop stitching AI workflows together with ad-hoc prompts. Give your repository the structure it needs to make agent-assisted engineering repeatable, reliable, and high-quality at scale.

AI Harness Toolkit: from ad hoc prompting to structured, high-quality agent-driven engineering


Table of Contents


At a Glance

If you want to… Start here
Bootstrap high-quality agent-driven development with deterministic checks, specs, and clear guardrails ai-harness-setup
Score your repository's AI-native maturity and get prioritized next steps ai-native-assessment

Why This Exists

If you are adopting AI tooling in a real repository, you usually need the same foundations: clear repository guidance, deterministic checks, spec-driven change management, and a practical way to measure maturity. This toolkit packages those patterns into reusable skills so you can standardize your workflow instead of rebuilding it from scratch.

This approach is inspired by the principles described in OpenAI's Harness Engineering post, where repository legibility, enforced architecture, and structured knowledge become the leverage that makes agent-driven development produce high-quality results at scale.

Ad hoc prompting can be useful for quick exploration, but it breaks down when you need reliable, high-quality output and shared standards. This toolkit helps you turn AI assistance into work that is easier to validate, maintain, and improve over time.

Unstructured vibe coding Using this toolkit
Workflow Relies on individual prompting style and memory Uses reusable skills and documented workflows you can apply consistently
Validation Produces uneven validation and review practices Encourages deterministic checks, repository guidance, and explicit workflow structure
Scale Works for isolated experiments but is hard to scale Helps you standardize setup, measure maturity, and improve your repository systematically

Who This Is For

Audience How it helps you
Engineering teams Bring structure to agent-assisted development in your repository so it becomes more reliable, consistent, and high-quality without reinventing the workflow
Platform and developer tooling teams Standardize repository setup, documentation, and validation patterns across your projects
Repository owners evaluating readiness Measure AI-native maturity and turn the results into a concrete improvement backlog

Core Workflows

Workflow Primary skill What it helps you do
Bootstrap your repository ai-harness-setup Add repository guidance, deterministic checks, skill wiring, and supporting documentation for agent-driven workflows
Assess AI-native maturity ai-native-assessment Produce a scored view of your repository's readiness with prioritized next steps

Supporting Skills

These supporting skills are bundled so the primary workflows can build on a consistent set of capabilities.

Skill Purpose
create-pull-request-with-reviewers Open pull requests with reviewer recommendations based on your repository history
gh-pr-comment-resolution Fetch and resolve GitHub pull request review threads
reflect-on-changes Review recent changes and update related guidance or conventions
python-best-practices Improve Python code quality across anti-patterns, testing, error handling, and performance

Quick Start

Choose the workflow you want to start with, copy the command you need, and then follow the linked skill documentation for prerequisites, targets, and detailed usage.

Bootstrap your repository

Install option Command
APM apm install cisco-open/ai-harness-toolkit/skills/ai-harness-setup -t opencode -t cursor -t copilot
npx skills npx skills add https://github.com/cisco-open/ai-harness-toolkit --skill ai-harness-setup

Assess AI-native maturity

Install option Command
APM apm install cisco-open/ai-harness-toolkit/skills/ai-native-assessment -t opencode -t cursor -t copilot
npx skills npx skills add https://github.com/cisco-open/ai-harness-toolkit --skill ai-native-assessment

Learn More

Topic Link
AI Harness Setup skills/ai-harness-setup/README.md
AI-Native Assessment skills/ai-native-assessment/README.md
Contributing guide CONTRIBUTING.md
Security policy SECURITY.md
License LICENSE

Contributing

Contributions are welcome. See CONTRIBUTING.md for repository conventions, submission guidance, and review expectations.

Security

If you discover a security issue, follow the reporting guidance in SECURITY.md.

License

Licensed under Apache 2.0. Copyright 2025 Cisco Systems, Inc.


About

Agent skills for bootstrapping and assessing AI-native engineering workflows in repositories. These skills help teams adopt structured, agent-driven development practices with deterministic checks, spec-driven development, and comprehensive documentation.

Resources

License

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors