17 nov
|
Avantpage
|
Rosario
Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling.
As a Data Engineer at Endava you will:
Data Engineering & Architecture
- Design, develop, and maintain scalable ETL/ELT pipelines for data ingestion, transformation, validation, and delivery.
- Develop reusable, modular, and configuration-driven data processing solutions.
- Contribute to technical architecture and evaluate solutions based on scalability, performance, reliability, and maintainability.
- Design and optimize data models, SQL queries, stored procedures, and data processing workflows.
Workflow Orchestration & Data Quality
- Design and maintain Apache Airflow workflows, including scheduling, dependencies, retries, monitoring, and error handling.
- Develop automated data validation and quality checks using DBT and SQL .
- Implement appropriate monitoring, alerting, and observability for critical data pipelines.
- Troubleshoot and resolve complex data processing and quality issues.
- Develop data solutions using AWS and cloud-based data warehouse technologies such as Snowflake.
- Work with cloud services for data storage, processing, compute, messaging, and serverless workloads.
- Support data platforms across development, QA, staging, and production environments.
- Optimize data workloads for performance, scalability, reliability, and cost.
CI/CD & Production Support
- Develop and maintain CI/CD pipelines for data engineering applications and infrastructure.
- Apply Infrastructure-as-Code practices using Terraform or equivalent technologies.
- Support production deployments, incident resolution, root cause analysis, and continuous improvement.
- Maintain technical documentation, operational runbooks, and troubleshooting guides.
Technical Leadership
- Take ownership of complex engineering initiatives from design through production.
- Conduct code reviews and promote engineering best practices.
- Mentor junior and mid-level engineers and provide technical guidance.
- Collaborate with architecture, DevOps, product, and other technology teams.
Job Description
Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling.
As a Data Engineer at Endava you will:
- Data Engineering & Architecture
- Design, develop, and maintain scalable ETL/ELT pipelines for data ingestion, transformation, validation, and delivery.
- Develop reusable, modular, and configuration-driven data processing solutions.
- Contribute to technical architecture and evaluate solutions based on scalability, performance, reliability, and maintainability.
- Design and optimize data models, SQL queries, stored procedures, and data processing workflows.
- Workflow Orchestration & Data Quality
- Design and maintain Apache Airflow workflows, including scheduling, dependencies, retries, monitoring, and error handling.
- Develop automated data validation and quality checks using DBT and SQL .
- Implement appropriate monitoring, alerting, and observability for critical data pipelines.
- Troubleshoot and resolve complex data processing and quality issues.
- Cloud & Platform Engineering
- Develop data solutions using AWS and cloud-based data warehouse technologies such as Snowflake.
- Work with cloud services for data storage, processing, compute, messaging, and serverless workloads.
- Support data platforms across development, QA, staging, and production environments.
- Optimize data workloads for performance, scalability, reliability, and cost.
- CI/CD & Production Support
- Develop and maintain CI/CD pipelines for data engineering applications and infrastructure.
- Apply Infrastructure-as-Code practices using Terraform or equivalent technologies.
- Support production deployments, incident resolution, root cause analysis, and continuous improvement.
- Maintain technical documentation, operational runbooks, and troubleshooting guides.
- Technical Leadership
- Take ownership of complex engineering initiatives from design through production.
- Conduct code reviews and promote engineering best practices.
- Mentor junior and mid-level engineers and provide technical guidance.
- Collaborate with architecture, DevOps, product, and other technology teams.
Qualifications
- Programming: Python, SQL
- Orchestration: Apache Airflow or equivalent
- Data Transformation: DBT, SQL, PySpark
- Data Warehouse: Snowflake or equivalent cloud data warehouse
- Cloud: AWS or equivalent cloud platform
- AWS Services: S3, EMR, Lambda, SNS/SQS or equivalent
- CI/CD: Jenkins, GitHub, GitHub Actions, or equivalent
Mandatory Qualifications
- 5+ years of professional experience in data engineering or a related software engineering role.
- Strong hands-on experience building and supporting production-grade data pipelines.
- Strong knowledge of Apache Airflow, including DAG development, scheduling, dependencies, retries, and monitoring.
- Strong experience with Snowflake or equivalent cloud data warehouse technologies.
- Proven experience with DBT.
- Solid experience with AWS or another major cloud platform.
- Experience with CI/CD and Infrastructure-as-Code practices.
- Strong programming skills in Python and SQL.
- Demonstrated experience troubleshooting complex production issues and performing root cause analysis.
- Ability to independently own complex technical initiatives from design through implementation and production.
- Strong communication, problem-solving, and technical documentation skills.
Preferred Qualifications
- Experience with large-scale data processing.
- Experience with PySpark and EMR.
- Experience mentoring engineers and contributing to technical standards and architecture.
Additional Information
Discover some of the global benefits that empower our people to become the best version of themselves:
- Finance: Competitive salary package, value-based recognition awards, referral bonus;
- Career Development : Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
- Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
- Work-Life Balance: Hybrid work and versátil working hours, employee assistance programme;
- Health: Global internal wellbeing programme, access to wellbeing apps;
- Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.
At Endava, we’re committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives—because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for a Mid-level Data Engineer to build and maintain dbt pipelines and Snowflake data marts behind customer-facing reporting, spend analytics, and AI features.
The mandatory requirements are solid dbt experience (modeling, tests, macros, and incremental models), ingestion and orchestration tools such as Airbyte or Prefect, 3+ years in data or analytics engineering on production pipelines, strong SQL and Python, dimensional modeling, Snowflake or a similar cloud warehouse, and an upper-intermediate English level.
WHAT YOU WILL DO
- Build and maintain the dbt pipelines, data marts, and warehouse models that serve in-app reporting, spend analytics, AI features, and internal analytics, treating them as production systems.
- Translate complicated procurement business logic into maintainable, well-tested pipeline code, and notice when a model is valid-looking but wrong.
- Build models within our data mart architecture, following the chapter's conventions for grain, conformed dimensions, and incremental patterns, and propose improvements when you find them.
- Contribute to and help buildout the semantic layer that our internal MCP servers and AI agents query, so that metrics and dimensions are defined once and answered consistently.
- Maintain the boundary between PII and agent/reporting-safe data.
- Build and maintain the FastAPI services that expose reporting marts to customers.
- Build and maintain ingestion pipelines (Airbyte, OneSchema, S3) into the warehouse, and support our Forward Deployed Engineering function in bringing customer data into our systems.
- Implement data quality checks: freshness, schema and reconciliation tests, and alerting, so problems surface before customers find them.
- Implement metric definitions faithfully, and flag conflicting or ambiguous definitions to the chapter rather than guessing.
- Keep documentation and lineage current so that humans and AI agents can both find and trust what's in the warehouse.
- Tune Snowflake performance and cost within the models you build.
- Use agentic coding tools in your daily work, within the guardrails (tests, conventions, review patterns) the team maintains, and understand why those guardrails exist.
- Share what you learn through code review and team discussion.
- Communicate clearly with engineering, product, and customer-facing teams about what the data means and what it can and can't do.
MUST HAVES
- 3+ years in analytics engineering, data engineering, or a closely related role, including hands-on work on production data pipelines that other systems or customers depended on.
- Solid dbt experience: modeling, tests, macros, and incremental models.
- Strong SQL and working Python.
- Data modeling fundamentals: dimensional modeling, data marts, grain and conformance.
- Experience with a modern cloud warehouse (Snowflake preferred).
- Experience with ingestion tooling and orchestration (Airbyte, Prefect, or equivalents).
- Familiarity with agentic coding tools and an understanding of why guardrails around their output matter.
- Deep curiosity about the business: you want to understand what the data means and how customers use it, not just how it flows.
- Software engineering discipline for analytics code: Git, code review, CI/CD.
- Can take a multi-sprint piece of work from spec to production with normal oversight, and can explain tradeoffs to technical and non-technical stakeholders.
NICE TO HAVES
- Experience building or maintaining API services on top of warehouse data (FastAPI or similar).
- Experience with a semantic layer or governed metric definitions that multiple consumers rely on, including for LLM-driven or agent-driven querying.
- Experience exposing warehouse data to customers through embedded analytics or customer-facing APIs.
- Experience with data observability tooling.
- Experience supporting customer data onboarding or implementation teams.
- Experience deploying data pipelines across multiple regions and managing PII or sensitive data.
- Knowledge of procurement and/or supply chain data models.
- Prior experience in enterprise software and startups.
PERKS AND BENEFITS
- Professional growth : Mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation : USD-based pay with education, fitness, and team activity budgets.
- Exciting projects : Modern solutions with Fortune 500 and top product companies.
- Flextime : Flexible schedule with remote and office options.
Job Description AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Mid-level Data Engineer to build and maintain dbt pipelines and Snowflake data marts behind customer-facing reporting, spend analytics, and AI features. The mandatory requirements are solid dbt experience (modeling, tests, macros, and incremental models), ingestion and orchestration tools such as Airbyte or Prefect, 3+ years in data or analytics engineering on production pipelines, strong SQL and Python, dimensional modeling, Snowflake or a similar cloud warehouse, and an upper-intermediate English level. WHAT YOU WILL DO - Build and maintain the dbt pipelines, data marts, and warehouse models that serve in-app reporting, spend analytics, AI features, and internal analytics, treating them as production systems. - Translate complicated procurement business logic into maintainable, well-tested pipeline code, and notice when a model is valid-looking but wrong. - Build models within our data mart architecture, following the chapter's conventions for grain, conformed dimensions, and incremental patterns, and propose improvements when you find them. - Contribute to and help buildout the semantic layer that our internal MCP servers and AI agents query, so that metrics and dimensions are defined once and answered consistently. - Maintain the boundary between PII and agent/reporting-safe data. - Build and maintain the FastAPI services that expose reporting marts to customers. - Build and maintain ingestion pipelines (Airbyte, OneSchema, S3) into the warehouse, and support our Forward Deployed Engineering function in bringing customer data into our systems. - Implement data quality checks: freshness, schema and reconciliation tests, and alerting, so problems surface before customers find them. - Implement metric definitions faithfully, and flag conflicting or ambiguous definitions to the chapter rather than guessing. - Keep documentation and lineage current so that humans and AI agents can both find and trust what's in the warehouse. - Tune Snowflake performance and cost within the models you build. - Use agentic coding tools in your daily work, within the guardrails (tests, conventions, review patterns) the team maintains, and understand why those guardrails exist. - Share what you learn through code review and team discussion. - Communicate clearly with engineering, product, and customer-facing teams about what the data means and what it can and can't do. MUST HAVES - 3+ years in analytics engineering, data engineering, or a closely related role, including hands-on work on production data pipelines that other systems or customers depended on. - Solid dbt experience: modeling, tests, macros, and incremental models. - Strong SQL and working Python. - Data modeling fundamentals: dimensional modeling, data marts, grain and conformance. - Experience with a modern cloud warehouse (Snowflake preferred). - Experience with ingestion tooling and orchestration (Airbyte, Prefect, or equivalents). - Familiarity with agentic coding tools and an understanding of why guardrails around their output matter. - Deep curiosity about the business: you want to understand what the data means and how customers use it, not just how it flows. - Software engineering discipline for analytics code: Git, code review, CI/CD. - Can take a multi-sprint piece of work from spec to production with normal oversight, and can explain tradeoffs to technical and non-technical stakeholders. NICE TO HAVES - Experience building or maintaining API services on top of warehouse data (FastAPI or similar). - Experience with a semantic layer or governed metric definitions that multiple consumers rely on, including for LLM-driven or agent-driven querying. - Experience exposing warehouse data to customers through embedded analytics or customer-facing APIs. - Experience with data observability tooling. - Experience supporting customer data onboarding or implementation teams. - Experience deploying data pipelines across multiple regions and managing PII or sensitive data. - Knowledge of procurement and/or supply chain data models. - Prior experience in enterprise software and startups. PERKS AND BENEFITS - Professional growth : Mentorship, TechTalks, and personalized growth roadmaps. - Competitive compensation : USD-based pay with education, fitness, and team activity budgets. - Exciting projects : Modern solutions with Fortune 500 and top product companies. - Flextime : Flexible schedule with remote and office options.
#J-18808-Ljbffr
📌 Strategic Cloud Data Engineer (Rosario)
🏢 Avantpage
📍 Rosario