27 ago
|
Contollo
|
Argentina
27 ago
Contollo
Argentina
? We're looking for a Senior Data Engineer to join a high-impact healthcare data modernization initiative focused on building scalable, reliable, and production-grade data solutions on Databricks.
Our client is modernizing existing SQL Server data workloads as part of a broader cloud and data platform transformation, migrating legacy pipelines, stored procedures, and SSIS packages into a modern Databricks/Spark ecosystem.
This is a hands-on individual contributor role for a senior engineer who is comfortable working deeply with Python, SQL, PySpark, Apache Spark, Databricks, Delta Lake, and dbt. You’ll work closely with the Principal Data Engineer and broader engineering organization across data ingestion, transformation, orchestration, and serving layers.
? Key Responsibilities
- Design, build, and maintain production-grade data pipelines using PySpark and Apache Spark on Databricks.
- Develop modular, tested, and well-documented dbt transformation models for the analytics engineering layer.
- Build and maintain pipelines using Spark Declarative Pipelines / Delta Live Tables.
- Contribute to the migration of SQL Server data pipelines, T-SQL, stored procedures, and SSIS packages to Databricks while ensuring data fidelity and integrity.
- Implement Bronze/Silver/Gold and Medallion Architecture principles across data processing layers.
- Build robust data-quality checks, error handling, monitoring, and SLA-aligned alerting to ensure pipeline reliability.
- Manage Databricks compute resources, cluster configurations, and job scheduling using Databricks Workflows.
- Apply data security and governance controls using Unity Catalog.
- Write clean, maintainable Python and SQL using version control, testing, code review, and CI/CD best practices.
- Participate in technical discussions and code reviews while contributing to engineering standards and best practices.
- Partner with engineering stakeholders to modernize SQL-based healthcare data workloads and support the evol
📌 ? Senior Data Engineer (Argentina)
🏢 Contollo
📍 Argentina