04 nov
|
Virtusa
|
Valencia
Experteer Overview
In this role you will design and implement end-to-end testing for data pipelines, APIs, and backend services to ensure data quality at scale. You will collaborate with data engineers, platform teams, and architects to embed quality early, drive reliability, and reduce flaky tests. You’ll build and maintain frameworks for data testing, observability, and DataOps, enabling safe releases and rapid validation of complex data products. This position offers impact across batch and streaming data, governance, and security in a modern cloud environment.
Compensaciones / Ventajas
• Design and implement test automation architecture for data pipelines, APIs, and backend services
• Develop data testing framework with SQL-based assertions, reconciliation, and schema validation
• Proactively break systems with destructive testing, drift detection, and handling late-arriving data
• Validate ETL and streaming data at scale using row, aggregate, and hash-based checks
• Integrate data quality and observability tools (Great Expectations, Soda) to ensure accuracy, completeness, and timeliness
• Enforce CI/CD/DataOps gates, optimize test execution (pre-merge,
selective/parallel)
• Manage test data through synthetic data generation and masking/anonymization
• Conduct performance and reliability validation including benchmarks, concurrency, and stress tests
• Perform security and compliance validation for PII/PHI exposure and access control
• Lead cross-functional quality efforts with data engineers, platform teams, and architects
• Analyze production data issues and failure patterns to reduce flaky tests and false alarms
Responsabilidades
• 9+ years in automation or quality engineering
• 5+ years building frameworks for data platforms at scale
• Experience with API contract testing and tools like PACT
• Basic UI automation for end-to-end validation
• Exposure to data mesh or data product architectures
• Programming u0026 Framework Development
• Data Engineering Ecosystem
• Data Quality u0026 Observability
• Streaming Systems
• CI/CD u0026 DevOps
• Cloud u0026 Infrastructure
Requisitos principales
•
📌 Senior Software Engineer (Valencia)
🏢 Virtusa
📍 Valencia