QA Engineer | (Barcelona)

QA Engineer | (Barcelona)

18 nov
|
Transperfect
|
Barcelona

18 nov

Transperfect

Barcelona

TransPerfect helps organizations navigate the integral marketplace. Founded in an NYU dorm room in 1992 and still founder-led, TransPerfect has grown into the world’s largest translation and language services company, with thousands of employees across more than 160 offices worldwide and over $1.3 billion in annual revenue.

The TransPerfect TechOps team builds and supports the technology behind that success – from workflow improvements and core GlobalLink platform services to AI-powered language solutions and scalable client-facing applications.

As a QA Engineer, you will help ensure the quality, reliability, security, and performance of our web applications, APIs, and AI-enabled products. You will design and maintain automated tests, perform hands-on exploratory and regression testing, and work closely with engineering and product teams to identify risks early. You will also use AI-assisted development and testing tools responsibly and contribute to validating AI/LLM features, including translation and other generated language outputs.

This position offers:

- A significant role in a dynamic QA team, part of a technology division within the world's largest provider of language services and technology solutions

- Ownership of test automation and opportunities to influence product quality and release readiness

- Collaboration with distributed product, development, and release teams

- Hands-on exposure to AI-enabled products, LLM evaluation, and modern AI-assisted testing workflows

- Opportunities to expand skills in automation frameworks, API testing, CI/CD, and responsible AI quality practices

Your responsibilities will include:

- Design, implement, execute, and maintain automated functional, integration, regression, and API tests for web and mobile-enabled applications

- Build and improve scalable, maintainable test automation frameworks using Playwright, Selenium, or comparable tools, with appropriate code reviews and quality checks

- Integrate automated tests into CI/CD pipelines, analyze failures, reduce flaky tests, and provide timely feedback on release quality

- Create risk-based test strategies, test plans, test scenarios, and traceable test cases aligned with user stories and acceptance criteria

- Perform hands-on exploratory, cross-browser, system, end-to-end, database, and RESTful API testing as needed

- Validate data integrity, access control, error handling,



usability, and compatibility across supported environments

- Identify, document, prioritize, and track defects in Azure DevOps or comparable tools, supplying clear steps, evidence, impact, and technical findings

- Work with developers, product managers, QA leads, and release managers to assess risks, investigate defects, and support release-readiness decisions

- Test AI-powered features and LLM-based workflows for functional correctness, output quality, reliability, and alignment with requirements

- Evaluate AI-generated language and translation outputs using defined criteria such as meaning preservation, terminology, fluency, formatting, and locale conventions; collaborate with language specialists when subject-matter review is needed

- Design repeatable AI test scenarios and evaluation datasets covering normal, edge, ambiguous, multilingual, and adversarial inputs

- Identify and document AI-specific failures, including hallucinations, omissions, inconsistent responses, bias, unsafe outputs, and failures to follow instructions or required formats

- Account for non-deterministic AI behavior by using appropriate evaluation rubrics, comparative baselines, sampling, and repeat testing rather than relying on exact-text assertions alone

- Use approved AI assistants to accelerate test-case design, test-data preparation, automation scripting, coverage analysis, debugging, and defect reporting; independently verify all AI-generated artifacts

- Assess the risks of AI-assisted testing workflows, including sensitive-data exposure, unsupported assumptions, fabricated test evidence, and weak assertions; follow company security and data-handling policies

- Maintain test assets and technical documentation, and proactively recommend improvements to test coverage, effectiveness, and execution efficiency

Communication:

- Communicate test progress, quality risks, defects, and release blockers clearly to QA, development, and product stakeholders





- Collaborate effectively with cross-functional teams across locations and time zones; participate in Agile planning, refinement, and daily standups

Required skills and experience:

- Bachelor’s degree in Computer Science, Engineering, a related discipline, or equivalent relevant experience

- Professional experience in software quality engineering with both manual and automated testing

- Hands-on experience developing and maintaining UI or API automation using Playwright, Selenium, or similar frameworks

- Programming proficiency in C#, Java, or a comparable language used for test automation

- Experience with RESTful API testing, debugging, test-data management, and validation of backend behavior

- Experience working with CI/CD platforms and defect/test management tools such as Azure DevOps, TeamCity, or Jira

- Ability to analyze requirements, develop risk-based coverage, and maintain traceability from acceptance criteria to test results

- Familiarity with AI-assisted coding or testing tools, plus the judgment to review and validate generated code, test cases, and results

- Foundational understanding of LLM capabilities and limitations, including hallucinations, variable outputs, and the need for structured evaluation

- Strong analytical, troubleshooting, documentation, and communication skills; ability to work independently and collaboratively

Desired skills and experience:

- Experience testing AI/LLM applications, machine translation, retrieval-augmented generation (RAG), or other generative AI features

- Experience creating automated AI evaluations, quality rubrics, curated datasets, or regression benchmarks for model-generated outputs

- Knowledge of AI security and safety test scenarios, including prompt injection, data leakage, and inappropriate output handling

- Experience with .NET development, SQL/database validation, performance or load testing, and service virtualization

- Experience with AI coding assistants or agent-based QA workflows, including tool integrations and human-in-the-loop validation

- Professional working knowledge of an additional language, especially for multilingual product testing

- Ability to work across time zones and understand complex business workflows

By applying, I confirm I have read and accept TransPerfect's Privacy Policy: https://www.transperfect.com/about/data-privacy-recruiting

📌 QA Engineer | (Barcelona)
🏢 Transperfect
📍 Barcelona

Postulate a este anuncio

Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: qa engineer | (barcelona) / barcelona

Suscribete a esta alerta:

Recibe por email las nuevas ofertas de trabajo para: qa engineer | (barcelona) / barcelona