24 sep
|
Talent Search Technology
|
Barcelona
24 sep
Talent Search Technology
Barcelona
We are looking for a
Data Engineer to build and maintain scalable data pipelines and integrations supporting CRM operations, data matching, and reporting. You’ll work closely with Full Stack Engineers and internal data teams.
Key Requirements
- Strong hands-on experience with
AWS
: S3, RDS/PostgreSQL, IAM, EMR, Glue, Athena, and Redshift.
- Strong
Apache Spark experience for transformations, joins, calculations, and batch processing.
- Solid expertise in
ETL/ELT, data modeling, schema design, data quality, reconciliation, metadata, and data lineage
.
- Advanced
SQL skills, including complex transformations, validation, and performance optimization.
- Experience with
Git, CI/CD, automated data testing, parameterization, monitoring, logging, and production support
.
- Strong understanding of data security
, including IAM, least privilege, encryption, and secrets management.
- Experience building scalable, reliable,
and production-ready data pipelines
.
- Exposure to near-real-time processing is a plus.
What You’ll Do
- Design and maintain data ingestion, transformation, and publishing pipelines.
- Analyze source systems and define data contracts and integration requirements.
- Develop data models for customer profiles, opportunities, matching, tracking, and reporting.
- Implement data quality checks, reconciliation, error handling, monitoring, and traceability.
- Optimize data workloads for performance, scalability, and cost efficiency
.
- Partner with Full Stack teams to enable effective application data consumption.
- Maintain documentation for data lineage, dependencies, business rules, and recovery procedures.
📌 Data Engineer (Barcelona)
🏢 Talent Search Technology
📍 Barcelona