Quality Assurance Engineer

QAE / SDET - Python - NYC 2-3 days per week Role Summary We are seeking an experienced Quality Assurance Engineer to join our Personalization team as a contractor. This role will focus on device testing for mobile app initiatives and developing comprehensive testing strategies for LLM-powered features. Key Responsibilities Device Testing Leadership Own end-to-end testing for Prime Video mobile app Search CX revamp Develop and execute comprehensive test plans for living room devices and customer experience features Utilize on-site device lab for hands-on testing across multiple platforms and form factors Collaborate with general QA teams while maintaining dedicated focus on search functionality LLM Testing Framework Development Evaluate and enhance existing automation frameworks built by engineering teams Design and implement structured test plans for large language model features Create regression testing suites for AI-powered personalization and search algorithms Build automated test cases for LLM performance validation and quality assurance Test Strategy & Execution Gather product requirements and translate them into comprehensive testing strategies Create detailed test plans that cover functional, performance, and edge case scenarios Execute testing independently and provide clear reporting on results and quality metrics Identify testing gaps and recommend improvements to existing processes Stakeholder Collaboration Work directly with Product/Program Managers to understand feature requirements and success criteria Collaborate with Engineering teams to understand technical implementation and constraints Partner with TPMs on project timelines and deliverable coordination Provide regular updates on testing progress and quality status Required Qualifications Experience 5+ years of quality assurance engineering experience Proven experience creating test plans from product requirements Experience with both manual and automated testing methodologies Technical Skills Python programming (primary requirement for LLM testing work) Experience with test automation frameworks and tools Knowledge of mobile device testing across iOS and Android platforms Familiarity with living room device testing (Fire TV, gaming consoles, smart TVs) API testing and backend validation capabilities Preferred Qualifications Experience testing AI/ML features, recommendation systems, or personalization algorithms Experience with large language model testing or AI model validation or Python Video streaming or entertainment industry experience (nice to have, not required) Experience with Kotlin, Java, or other programming languages Familiarity with A/B testing frameworks and experimentation platforms Skills Quality assurance, Automation, Selenium, Quality assurance testing, Test case, Test plan, Java, Test script, Python, Test automation, Automation testing, Automated testing, Javascript, Mobile Additional Skills & Qualifications Expert Level