TransPerfect helps organizations navigate the integral marketplace. Founded in an NYU dorm room in 1992 and still founder-led TransPerfect has grown into the worlds largest translation and language services company with thousands of employees across more than 160 offices worldwide and over $1.3 billion in annual revenue.
The TransPerfect TechOps team builds and supports the technology behind that success from workflow improvements and core GlobalLink platform services to AI-powered language solutions and scalable client-facing applications.
As a QA Engineer you will help ensure the quality reliability security and performance of our web applications APIs and AI-enabled products. You will design and maintain automated tests perform hands-on exploratory and regression testing and work closely with engineering and product teams to identify risks early. You will also use AI-assisted development and testing tools responsibly and contribute to validating AI/LLM features including translation and other generated language outputs.
This position offers:
- A significant role in a dynamic QA team part of a technology division within the worlds largest provider of language services and technology solutions
- Ownership of test automation and opportunities to influence product quality and release readiness
- Collaboration with distributed product development and release teams
- Hands-on exposure to AI-enabled products LLM evaluation and modern AI-assisted testing workflows
- Opportunities to expand skills in automation frameworks API testing CI/CD and responsible AI quality practices
Job requirements
Your responsibilities will include:
- Design implement execute and maintain automated functional integration regression and API tests for web and mobile-enabled applications
- Build and improve scalable maintainable test automation frameworks using Playwright Selenium or comparable tools with appropriate code reviews and quality checks
- Integrate automated tests into CI/CD pipelines analyze failures reduce flaky tests and provide timely feedback on release quality
- Create risk-based test strategies test plans test scenarios and traceable test cases aligned with user stories and acceptance criteria
- Perform hands-on exploratory cross-browser system end-to-end database and RESTful API testing as needed
- Validate data integrity access control error handling usability and compatibility across supported environments
- Identify document prioritize and track defects in Azure DevOps or comparable tools supplying clear steps evidence impact and technical findings
- Work with developers product managers QA leads and release managers to assess risks investigate defects and support release-readiness decisions
- Test AI-powered features and LLM-based workflows for functional correctness output quality reliability and alignment with requirements
- Evaluate AI-generated language and translation outputs using defined criteria such as meaning preservation terminology fluency formatting and locale conventions; collaborate with language specialists when subject-matter review is needed
- Design repeatable AI test scenarios and evaluation datasets covering normal edge ambiguous multilingual and adversarial inputs
- Identify and document AI-specific failures including hallucinations omissions inconsistent responses bias unsafe outputs and failures to follow instructions or required formats
- Account for non-deterministic AI behavior by using appropriate evaluation rubrics comparative baselines sampling and repeat testing rather than relying on exact-text assertions alone
- Use approved AI assistants to accelerate test-case design test-data preparation automation scripting coverage analysis debugging and defect reporting; independently verify all AI-generated artifacts
- Assess the risks of AI-assisted testing workflows including sensitive-data exposure unsupported assumptions fabricated test evidence and weak assertions; follow company security and data-handling policies
- Maintain test assets and technical documentation and proactively recommend improvements to test coverage effectiveness and execution efficiency
Communication:
- Communicate test progress quality risks defects and release blockers clearly to QA development and product stakeholders
- Collaborate effectively with cross-functional teams across locations and time zones; participate in Agile planning refinement and daily standups
Required skills and experience:
- Bachelors degree in Computer Science Engineering a related discipline or equivalent relevant experience
- Professional experience in software quality engineering with both manual and automated testing
- Hands-on experience developing and maintaining UI or API automation using Playwright Selenium or similar frameworks
- Programming proficiency in C# Java or a comparable language used for test automation
- Experience with RESTful API testing debugging test-data management and validation of backend behavior
- Experience working with CI/CD platforms and defect/test management tools such as Azure DevOps TeamCity or Jira
- Ability to analyze requirements develop risk-based coverage and maintain traceability from acceptance criteria to test results
- Familiarity with AI-assisted coding or testing tools plus the judgment to review and validate generated code test cases and results
- Foundational understanding of LLM capabilities and limitations including hallucinations variable outputs and the need for structured evaluation
- Strong analytical troubleshooting documentation and communication skills; ability to work independently and collaboratively
Desired skills and experience:
- Experience testing AI/LLM applications machine translation retrieval-augmented generation (RAG) or other generative AI features
- Experience creating automated AI evaluations quality rubrics curated datasets or regression benchmarks for model-generated outputs
- Knowledge of AI security and safety test scenarios including prompt injection data leakage and inappropriate output handling
- Experience development SQL/database validation performance or load testing and service virtualization
- Experience with AI coding assistants or agent-based QA workflows including tool integrations and human-in-the-loop validation
- Professional working knowledge of an additional language especially for multilingual product testing
- Ability to work across time zones and understand complex business workflows
By applying I confirm I have read and accept TransPerfects Privacy Policy: Catalunya Cataluña Spain
QA Testing
Full-time Permanent
All done!
Your application has been successfully submitted!
Other jobs
Youve already applied for this job
Thank you for your interest - weve already received your application so this new submission cant be accepted. Your previous application is on file.
Required Experience:
IC
📌 QA Engineer | Barcelona
🏢 Transperfect
📍 Barcelona
Postulate a este anuncio
Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.