We are seeking a Senior Data Software Engineer to build reusable, governed data-sharing adapters that connect a cloud lakehouse and analytics warehouse to external data platforms while meeting strict access controls and SLAs. You will design lakehouse patterns, implement integrations, and strengthen lineage and governance.
Responsibilities
- Design a UniForm write layer with one physical dataset and dual-format metadata for Delta and Iceberg consumers
- Build and validate GCS-to-BigQuery ingestion pipeline patterns for structured operational data
- Implement Kafka-based CDC patterns for real-time and near-real-time movement into the lakehouse
- Develop dependency-aware bookkeeping and data lineage tracking patterns across pipelines
- Engineer modular, version-controlled adapter code designed for reuse across new integrations
- Configure Iceberg external table definitions in Snowflake using Horizon Catalog governance features
- Validate zero-copy read access from Snowflake to Iceberg and Delta tables without data movement
- Implement tenant-scoped access controls aligned with Snowflake metadata governance requirements
- Implement and certify a Delta Sharing adapter for live, zero-copy sharing from Delta Lake to Databricks consumers
- Configure Delta Sharing endpoints and manage sharing agreements for Databricks access
- Validate Databricks read access via Delta Sharing for Spark, Pandas, and compatible consumers
- Test end-to-end freshness and sharing latency to meet agreed SLA targets
- Register connector types and implement RBAC plus tenant-scoped authorization for all data-out paths
- Implement metering hooks compatible with billing requirements for governed data-out flows
Requirements
- 3+ years of data engineering experience with Python and cloud data platforms
- Experience with Google Cloud BigQuery in advanced analytics and data modeling
- Experience with lakehouse table formats including Apache Iceberg and Delta Lake
- Strong leadership skills to drive integ
📌 Senior Data Software Engineer (Argentina)
🏢 EPAM Systems
📍 Argentina
Postulate a este anuncio
Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.