Job Description We’re looking for a Senior Data Engineer with strong hands-on expertise in building scalable data pipelines and cloud-native data solutions on Azure. This role focuses on designing and implementing real production systems using Azure Data Factory, Azure Databricks, and modern big data technologies.
You will work across distributed data platforms, integrating cloud and on-premises environments, and delivering robust, enterprise-grade data solutions aligned with industry best practices. Qualifications Skills & Experience Strong experience building data pipelines with Azure Data Factory and Azure Databricks
Hands-on expertise in PySpark for distributed data processing
Advanced knowledge of SQL, including complex joins and performance optimization
Experience working with Cosmos DB and Snowflake
Solid programming skills in Python, Scala, or Java
Experience with Kafka or event-driven architectures

Strong understanding of data architecture and distributed systems





Proven ability to deliver production-grade data solutions in complex environments Technical Requirements Candidates must demonstrate solid, hands-on knowledge across the following three areas: PySpark (Production-Level Coding)

Data Frame transformations: select, filter, group By, agg, with Column
Window functions: rank, row_number, lag, lead
Joins: inner, left, broadcast joins and usage scenarios
Reading/writing data: Parquet, Delta, CSV

UDFs: syntax, registration, and performance tradeoffs

Ability to produce production-ready code without pseudo-code
Azure Databricks (Architecture & Platform Expertise)
Cluster types, auto-scaling, and cluster policies
Notebook orchestration, workflows, and job scheduling
Delta Lake: ACID, schema evolution, time travel, OPTIMIZE, VACUUM

Unity Catalog: governance, lineage, and access control

Integration with Azure Data Factory
Hybrid Data Architecture (On-Prem to Cloud Integration)
JDBC/ODBC connectivity from Databricks

Secure credential management with Azure Key Vau...

📌 Senior Data Engineer (Azure Data Factory/Databricks/PySpark) (Buenos Aires)
🏢 Publicis Sapient
📍 Buenos Aires