Lead Quality Assurance Engineer

Phyllo is a data gateway that allows social data to be accessed from source platforms (e.g. YouTube, Twitch, Upwork, Shopify, etc.). We build the underlying infrastructure that connects with every creator platform, maintain a live data feed to the systems used by these platforms to manage creators’ data, and provide a normalized data set so that businesses can use creators’ data in a simple yet impactful way. More info at: Our website: https://www.getphyllo.com/

AI coding tools now let our engineers ship more code, faster. Your job is to make sure we can prove it works just as fast. As Lead QA Engineer, you will own test automation for Phyllo’s APIs, SDKs and web apps, and lead a small team of QA engineers.

This is an automation-first, hands-on role. You will build test suites that run on every code change, use AI tools to write and maintain tests faster, and review that AI output with a critical eye. You will work side by side with product managers and engineers to agree on what “working” means before code is written, and coach your team to grow from testers into automation engineers.

• Set the test automation strategy: what to automate, at which level (API, contract, UI), and what to keep for exploratory testing.
• Design and maintain API test automation in code, covering functional, schema/contract, negative, authentication and data-accuracy checks against our OpenAPI specs.
• Build reliable end-to-end UI test suites using sound design patterns (page objects, stable locators, isolated test data) so tests stay fast and trustworthy.
• Run automated tests in CI/CD on every pull request and release, with clear quality gates and fast feedback to engineers.
• Use AI coding assistants and agents to draft test plans, generate scripts and test data, and triage failures, and review every AI-generated test as carefully as human-written code.
• Verify that data flowing through our APIs is complete, correct and consistent across platforms, including pagination, webhooks and rate limits.
• Track and reduce flaky tests, and report quality metrics (coverage, escaped defects, flake rate, pipeline time) that the team acts on.

• Lead and mentor a small team of junior QA engineers: set priorities, assign work, review their test code, and run regular 1:1s and feedback.
• Help your team move from manual testing to automation through pairing, code reviews and clear learning goals.
• Define QA standards: coding conventions for tests, review checklists, defect triage and release sign-off.
• Own release readiness and make the go/no-go call together with engineering leads.
• Take part in hiring and onboarding new QA engineers.

• Work with product managers early to turn requirements into clear acceptance criteria and test scenarios before development starts.
• Partner with engineers on testability, test data and shared ownership of quality.
• Reproduce and debug issues using logs, network traces and API responses, and give engineers precise, actionable bug reports.
• Explain quality risks and release status in plain language to product, engineering and leadership.

• Have 5+ years in quality engineering, including at least 3 years building test automation (not only running manual tests).
• Have led or mentored QA engineers: assigning work, reviewing code and coaching people to grow.
• Write solid code in at least one language used for test automation: TypeScript/JavaScript, Python or Java.
• Have deep hands-on experience automating REST API tests in code (e.g. Playwright, REST Assured, pytest, SuperTest), with a solid grasp of HTTP, OAuth/API-key authentication, JSON schemas and OpenAPI. Postman experience is welcome, but API tests must live in code and CI.
• Have built a UI automation framework with a modern tool such as Playwright (preferred), Cypress or Selenium.
• Run tests in CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins or similar) and work daily with Git, pull requests and code reviews.
• Use AI coding assistants regularly in your testing work, and can tell when an AI-generated test is wrong, shallow or passing for the wrong reason.
• Are comfortable debugging with logs, browser dev tools and SQL.
• Communicate and collaborate clearly, with the confidence to challenge unclear requirements with product managers and engineers.
• Hold a BS in Computer Science or have an equivalent combination of technical education and work experience.

• AI-driven UI testing: Playwright Test Agents (planner, generator, healer) or Playwright MCP used with coding agents such as Claude Code, Cursor or GitHub Copilot.
• AI-assisted API testing: Postman Agent Mode, KushoAI, or Keploy (regression tests generated from recorded API traffic).
• Agentic testing platforms: AI-native platforms such as testRigor, mabl, Katalon or QA.tech.
• Contract and schema testing: Pact, Specmatic, or Schemathesis (property-based and fuzz testing from OpenAPI specs).
• Testing AI features: Evaluating LLM-powered features with tools such as Promptfoo, DeepEval, LangSmith or Langfuse, including golden datasets and LLM-as-judge scoring.
• Performance testing: k6, JMeter or Gatling.
• Mobile testing: Appium or similar, for testing SDKs on Android and iOS.
• Accessibility: Automated checks with axe or similar, and familiarity with WCAG.
• API security: OWASP API Security Top 10 and basic API security testing.
• Infrastructure and reporting: Docker, cloud test environments (we run on Google Cloud), and reporting tools such as Allure, TestRail or Xray.
• Domain: Familiarity with social and creator platform APIs (YouTube, Instagram, TikTok and similar).

We invest in our people and believe in hiring for high-potential and humble individuals who can rapidly grow their responsibilities as the company scales. You will infuse insights and ideas into business decision-making, solutions strategy, and the innovation roadmap for each product.

Do you truly want to make a difference and revolutionize the creator economy through data? If yes, Phyllo is the perfect place for you.