QA Engineer | Barcelona
- Market p25–p75
- €52k–€54k
- Opened · 30d
- +49
- Closed · 30d
- −19
- Opened · 7d
- +30810% of open
- All qa / test
- 5,586open
TransPerfect helps organizations navigate the global marketplace. Founded in an NYU dorm room in 1992 and still founder-led, TransPerfect has grown into the world’s largest translation and language services company, with thousands of employees across more than 160 offices worldwide and over $1.3 billion in annual revenue.
The TransPerfect TechOps team builds and supports the technology behind that success – from workflow improvements and core GlobalLink platform services to AI-powered language solutions and scalable client-facing applications.
As a QA Engineer, you will help ensure the quality, reliability, security, and performance of our web applications, APIs, and AI-enabled products. You will design and maintain automated tests, perform hands-on exploratory and regression testing, and work closely with engineering and product teams to identify risks early. You will also use AI-assisted development and testing tools responsibly and contribute to validating AI/LLM features, including translation and other generated language outputs.
This position offers
A significant role in a dynamic QA team, part of a technology division within the world's largest provider of language services and technology solutions
Ownership of test automation and opportunities to influence product quality and release readiness
Collaboration with distributed product, development, and release teams
Hands-on exposure to AI-enabled products, LLM evaluation, and modern AI-assisted testing workflows
Opportunities to expand skills in automation frameworks, API testing, CI/CD, and responsible AI quality practices
Requirements
Your responsibilities will include
Design, implement, execute, and maintain automated functional, integration, regression, and API tests for web and mobile-enabled applications
Build and improve scalable, maintainable test automation frameworks using Playwright, Selenium, or comparable tools, with appropriate code reviews and quality checks
Integrate automated tests into CI/CD pipelines, analyze failures, reduce flaky tests, and provide timely feedback on release quality
Create risk-based test strategies, test plans, test scenarios, and traceable test cases aligned with user stories and acceptance criteria
Perform hands-on exploratory, cross-browser, system, end-to-end, database, and RESTful API testing as needed
Validate data integrity, access control, error handling, usability, and compatibility across supported environments
Identify, document, prioritize, and track defects in Azure DevOps or comparable tools, supplying clear steps, evidence, impact, and technical findings
Work with developers, product managers, QA leads, and release managers to assess risks, investigate defects, and support release-readiness decisions
Test AI-powered features and LLM-based workflows for functional correctness, output quality, reliability, and alignment with requirements
Evaluate AI-generated language and translation outputs using defined criteria such as meaning preservation, terminology, fluency, formatting, and locale conventions; collaborate with language specialists when subject-matter review is needed
Design repeatable AI test scenarios and evaluation datasets covering normal, edge, ambiguous, multilingual, and adversarial inputs
Identify and document AI-specific failures, including hallucinations, omissions, inconsistent responses, bias, unsafe outputs, and failures to follow instructions or required formats
Account for non-deterministic AI behavior by using appropriate evaluation rubrics, comparative baselines, sampling, and repeat testing rather than relying on exact-text assertions alone
Use approved AI assistants to accelerate test-case design, test-data preparation, automation scripting, coverage analysis, debugging, and defect reporting; independently verify all AI-generated artifacts
Assess the risks of AI-assisted testing workflows, including sensitive-data exposure, unsupported assumptions, fabricated test evidence, and weak assertions; follow company security and data-handling policies
Maintain test assets and technical documentation, and proactively recommend improvements to test coverage, effectiveness, and execution efficiency
Communication
Communicate test progress, quality risks, defects, and release blockers clearly to QA, development, and product stakeholders
Collaborate effectively with cross-functional teams across locations and time zones; participate in Agile planning, refinement, and daily standups
Required skills and experience
Bachelor’s degree in Computer Science, Engineering, a related discipline, or equivalent relevant experience
Professional experience in software quality engineering with both manual and automated testing
Hands-on experience developing and maintaining UI or API automation using Playwright, Selenium, or similar frameworks
Programming proficiency in C#, Java, or a comparable language used for test automation
Experience with RESTful API testing, debugging, test-data management, and validation of backend behavior
Experience working with CI/CD platforms and defect/test management tools such as Azure DevOps, TeamCity, or Jira
Ability to analyze requirements, develop risk-based coverage, and maintain traceability from acceptance criteria to test results
Familiarity with AI-assisted coding or testing tools, plus the judgment to review and validate generated code, test cases, and results
Foundational understanding of LLM capabilities and limitations, including hallucinations, variable outputs, and the need for structured evaluation
Strong analytical, troubleshooting, documentation, and communication skills; ability to work independently and collaboratively
Desired skills and experience
Experience testing AI/LLM applications, machine translation, retrieval-augmented generation (RAG), or other generative AI features
Experience creating automated AI evaluations, quality rubrics, curated datasets, or regression benchmarks for model-generated outputs
Knowledge of AI security and safety test scenarios, including prompt injection, data leakage, and inappropriate output handling
Experience with .NET development, SQL/database validation, performance or load testing, and service virtualization
Experience with AI coding assistants or agent-based QA workflows, including tool integrations and human-in-the-loop validation
Professional working knowledge of an additional language, especially for multilingual product testing
Ability to work across time zones and understand complex business workflows
By applying, I confirm I have read and accept TransPerfect's Privacy Policy: https://www.transperfect.com/about/data-privacy-recruiting