Company DescriptionInfotech.Works (ITW) specializes in building innovative digital products and services for startups and leading brands. Leveraging a unique prototyping framework, APIs, and open-source software, ITW delivers high-quality and efficient solutions . The company serves diverse industries, including healthcare, education, gaming, startups, and enterprise businesses, offering services such as rapid prototyping, product design and development, and digital marketing strategy. Known for its focus on speed, affordability, and innovation, ITW has successfully collaborated with over 20 startups in the past year.About the RoleWe are helping build an AI-powered application generation platform similar to Lovable, where users can create full applications using natural language prompts.We are looking for a highly skilled Automation Test Engineer with deep expertise in Playwright and strong understanding of Agentic AI systems to design robust testing frameworks for AI-generated applications, prompt-driven workflows, and autonomous agents.This role sits at the intersection of QA automation, AI systems, and modern web application testing.Key ResponsibilitiesBuild Advanced Playwright AutomationDevelop scalable end-to-end automation frameworks using PlaywrightTest dynamic UIs generated by AIAutomate browser flows, API validation, and integration testsImplement parallel test execution and CI/CD integrationTest AI-Generated ApplicationsDesign tests that validate:Prompt → Generated UIPrompt → Generated backend APIsPrompt → Database schema generationPrompt → code updates or fixesEnsure that AI-generated outputs behave as expected.Test Agentic AI WorkflowsValidate multi-step AI systems including:agent orchestrationtool invocationAI reasoning flowsgenerated application behaviorCreate test scenarios for complex agent workflows.Validate LLM OutputsDevelop strategies to test:structured LLM responsesJSON output validationhallucination handlingprompt injection vulnerabilitiesCollaborate with Engineering & AI TeamsWork closely with product and AI teamsDefine testing strategies for AI systemsImprove reliability of AI-generated featuresRequired SkillsPlaywright ExpertiseStrong experience with:Playwright automation frameworkbrowser automationparallel test executionAPI mockingdynamic selector handlingTypeScript or JavaScriptAI System UnderstandingHands-on knowledge of:LLM workflowsprompt engineeringagentic AI architecturesAI output validationExperience working with tools such as:OpenAI APILangChainCrewAIAPI and Backend TestingExperience with:REST API testingGraphQLJSON schema validationdatabase validationExperience Required3–7 years in QA automation or test engineering2+ years working with Playwright or similar frameworksLocationPune- In officeWhy Join UsYou will work on cutting-edge AI systems where applications are generated through natural language. This role offers the opportunity to build next-generation QA frameworks for AI-native products.Looking for a Playwright expert who understands AI systems and agentic workflows. If you’ve tested AI-generated apps or worked with LLM-based systems, we’d love to talk.