Human-Guided Agentic Test Engineering Pipeline
From Jira ticket to reviewed test scenarios, TestRail coverage, and Playwright tests.
Jira MCP · TestRail MCP · Playwright MCP · TypeScript · AWS · Git · POM
On my team, test planning, case design, and automation were three separate activities, usually picked up by different people at different times. Each hand-off started by rebuilding the same context: the feature, its epic, the repository, and the shape of the existing test suite. Coverage drifted in TestRail as similar cases got written twice, and automation built without that context turned brittle.
The workflow I built carries one Jira ticket through scenario design, TestRail coverage, and Playwright automation as a single reviewed path. It stops for a person before it changes coverage, writes code, or opens a pull request.
The workflow opens with /start-planning. Before it proposes anything, it reads the ticket in full: acceptance criteria, technical notes, attachments, linked references, the parent epic, and any sibling tickets already done or in review. From that context it drafts risk-tiered scenarios and returns them for review.
Once the scenarios are approved, /test-cases maps them onto the existing TestRail project. It updates the cases that already match, creates the folders and cases that are missing, and returns every affected link so the coverage can be checked before the feature ships.
After deployment, /automate takes the approved cases together with the repository context and writes POM-based tests, each routed to the UI, API, visual, or component suite that fits. It builds on the page objects and fixtures already in the codebase rather than adding parallel ones.
Each step produces an artifact that someone can review before the next step begins.
From sprint-ready ticket to final verdict
- Jira ticket
/start-planning - Context + scenarios
- Human review
/test-cases - TestRail coverage
- Deploy + approve
/automate - Playwright implementation
- Review + PR
- 01 · Request ticket plan
-
scenarios.md - 02 · scenarios.md
- 03 · Send approved scenarios
-
testrail-cases.md - 04 · testrail-cases.md
- 05 · Send approved test cases
-
changes.md - 06 · changes.md
- 07 · Send approved changes
-
test-results.md - 08 · test-results.md
- 09 · Request final review
-
review.md - 10 · review.md
A thin or ambiguous ticket leaves the planning stage with little to work from. Before it drafts a single scenario, the workflow gathers the acceptance criteria, the technical notes and attachments, the parent epic, and any sibling tickets that are done or in review, so the plan starts from the full picture.
TestRail often already holds similar coverage, and the right folder may not exist yet. The coverage stage walks the project and folder hierarchy first, compares against similar functionality, and returns every case it touched for review before it counts.
Automation that ignores a repository’s conventions ages badly. The automation stage reads the repository structure, routes each test into the suite that fits, and reuses the existing page objects, fixtures, and user-facing locators.
Scenario depth scales with risk: a floor of 5+ scenarios for low-criticality tickets, 6-8+ for medium, and 10-15+ for critical work.
Three points in the path need a person’s decision: creating the TestRail cases, starting the automation, and delivering the pull request.
A change stays traceable from its planning evidence through the TestRail cases, the test code, and the review that approved it.