Start Your Search Here

push notification bell

Would you like to receive notifications about Computer and Mathematical Occupations jobs in Mclean?

push notification bell

You have blocked notifications

Oops! You have blocked notifications. Click here for more info

You have blocked notifications, please check your browser settings.

push notification bell

You're currently subscribed to job notifications

Want to change your notifications for job alerts?

push notification bell

Subscribe to notifications

You will no longer receive notifications

Job Search

eSolutionsFirst

Mclean / Global

Developer-Full Stack Senior

Job Description

Job TitleAgentic Test Automation Foundation (Reusable Patterns + Reference Implementations)Design and implement agentic testing patterns that can be adopted by multiple Underwriting teams (and later other domains). Create reference implementations (sample repos / templates) demonstrating:Test generation assistance (from requirements, APIs, contracts, schemas)Test maintenance assistance (auto-updating selectors/contracts, flaky test triage)Failure analysis assistance (root cause suggestions, log correlation, defect drafting)Establish a standard architecture for test code organization, tagging, data management, and execution across UI + API + service layers.Coverage Standards, Templates, and GovernanceDefine and publish coverage standards (what "good" looks like) including:Minimum coverage expectations by service/componentTest type mix (unit vs API vs UI vs contract vs integration)Risk-based prioritization and traceability to requirementsProvide templates usable across teams:Test plan templatesTest case/spec templates (Gherkin-style or equivalent)Definition of Ready / Definition of Done quality checklistsCreate a scalable tagging/metadata strategy (e.g., feature, service, risk, priority, data sensitivity) to support reporting and quality gates.GenAI-Assisted Reporting and Quality Insights Across MicroservicesBuild automated reporting that aggregates test + service data across multiple microservices, such as:Test execution results (Karate/Playwright + CI runs)Service health signals (logs/metrics/traces if available)Defect signals (issue tracker metadata if available)Generate GenAI-driven summaries:Release readiness narrativesFailure clustering and trend analysis“What changed?” insights (commit/PR correlation)Produce outputs consumable by engineering leadership and teams (dashboards, markdown summaries in PRs, artifacts in CI).Quality Gates via AgentsBuild automated review agents that evaluate user stories/requirements for minimum required clarity and data before development/testing starts:Required fields present (acceptance criteria, testable outcomes, data needs, dependencies)Ambiguity detection and missing edge casesData/privacy considerations and environment needsIntegrate gates into workflow (PR checks, issue templates, GitHub Actions) to reduce churn and rework.Required Technical Skills (Must-Have)GenAI / LLM + Agentic DevelopmentHands-on experience building LLM-powered agents (tool-using, multi-step reasoning, guardrails)Experience with prompting patterns, structured outputs (JSON schemas), evaluation, and reducing hallucinationsAbility to design agent workflows for:Test generation/augmentationRequirements review and completeness validationReport generation and summarizationGitHub Platform + GHCP (Copilot) for Engineering WorkflowsStrong proficiency with GitHub Copilot in day-to-day development.Deep experience with GitHub platform capabilities:GitHub Actions (CI/CD pipelines, reusable workflows, composite actions)PR checks, branch protections, CODEOWNERS, templatesAutomation via GitHub APIs/webhooks (as needed)Test Automation Engineering (Framework Expertise)Advanced experience designing and implementing automation with:Karate (API testing, contract-like checks, data-driven testing, mocks)Playwright (UI automation, selectors strategy, parallelization, trace/video artifacts)Strong understanding of test design and coverage:Happy path scenariosNegative/validation scenariosEdge/boundary scenariosData setup/teardown strategies and test isolationCross-Service Reporting and Data AggregationProven ability to aggregate and normalize results from multiple microservices and multiple pipelines.Experience producing actionable automated reports (trend analysis, failure clustering, service correlation).Automated Requirements Review AgentsExperience implementing automated checks that validate:Acceptance criteria completenessRequired test data and environment dependenciesNon-functional requirements (performance, security, observability) when applicableDeliverables / What Success Looks Like (For the Posting)A reusable agentic testing automation kit adopted by multiple teams.Published coverage standards + templates and onboarding documentation.A working GenAI-assisted reporting pipeline aggregating results across microservices.Automated quality gates integrated into GitHub workflows that measurably reduce story churn.

Apply Now

Similar Opportunities

View all jobs

Get Job Alerts

Don't miss the perfect fit. Get Daily curated job alerts.

Job Title or Keyword(s)
Location