31 jul
|
AgileEngine
|
Argentina
31 jul
AgileEngine
Argentina
Agile
Engine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries.
We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE
We are looking for a Lead Data Engineer to own the data pipeline and analytical architecture layer for a large-volume marketing analytics platform.
You will make architectural decisions around partitioning strategy, file formats, schema design, and near-real-time processing for OLAP-oriented workloads built on an S3-backed data lake.
You will design and govern ETL pipelines, define DAG-based orchestration strategies using Airflow, drive the AWS data stack including Athena and EKS, and lead a team of senior developers while enforcing code quality standards. WHAT YOU WILL DO
- Design and own ETL pipelines that extract, transform,
and validate data from internal databases and external APIs at scale.
- Make architectural decisions around partitioning, file formats, schema and data-type strategy, and near-real-time processing for large-volume, OLAP-oriented data systems built on an object-storage data lake.
- Own the design of scheduled batch workflows (DAGs) on the client's Airflow setup, defining pipeline structure, dependencies, and triggering strategies, and driving architectural discussions around them.
- Drive the use of the client's AWS data stack, including an S3-backed data lake, Athena, and EKS/Kubernetes.
- Partner directly with the client's Dev
Ops team to clarify functional and non-functional requirements.
- Review pull requests and enforce code quality standards.
- Guide senior developers and ensure alignment with the client's engineering practices. MUST HAVES
- 7+ years of engineering experience, with a proven track record desig...
📌 Lead Data Engineer (Argentina)
🏢 AgileEngine
📍 Argentina