Proven experience as a Data Engineer or similar role, building and operating production data pipelinesStrong hands-on production experience with Databricks, including notebooks and repos (Git folders), job clusters, and SQL warehousesStrong hands-on experience with Python and PySpark for data ingestion and transformation, and with Apache Spark fundamentals (partitioning, shuffles, joins, performance tuning)Production experience with Delta Lake andthe medallion (bronze/silver/gold)architecture, including MERGE/upserts, timetravel, and schema enforcementProduction experience with DatabricksWorkflows / Lakeflow Jobs for pipelineorchestration, including task design,scheduling, monitoring, and troubleshootingExperience with Unity Catalog forgovernance, lineage, and access controlProduction experience with dbt for datamodeling and transformation, ideally onDatabricksStrong SQL skills (Spark SQL / Databricks SQL)and experience with Postgres or similarrelational databasesFamiliarity with the underlying cloud (AWSpreferred: S3, IAM; Azure or GCP Databricksexperience is also welcome)Understanding of data ingestion patterns,including file-based, streaming, andAPI/system-to-system integrationExperience maintaining data lineage,traceability, and auditability across a pipelineComfort working within a regulated orcompliance-driven environment (e.g., SOC-2,HIPAA, or similar)Experience working in a sprint-based agiledelivery model,



coordinating with cross-functional engineering teamsStrong documentation and communicationskills; able to work effectively with bothtechnical and non-technical stakeholdersMany of our projects involve business-critical data governed by regulatory requirements, so comfort operating in a regulated environment matters as much as pipeline engineering skillAdvanced EnglishWe are looking for someone able toDevelop, test, and maintain PySpark, SparkSQL, and dbt (dbt-databricks) models fordata transformation and business logicacross bronze, silver, and gold layersBuild, monitor, and troubleshoot DatabricksWorkflows / Lakeflow Jobs and LakeflowDeclarative Pipelines supporting scheduledand event-driven data ingestion, includingdata quality expectationsBuild and maintain ingestion pipelinespulling data from source systems, includingfile-based (Auto Loader over Amazon S3) andsystem-to-system integration patterns,using Structured Streaming where near-real-time delivery is neededMaintain and optimize Delta Lake tablesand gold-layer marts that feed productionapplications (e.g., partitioning/liquidclustering, OPTIMIZE and VACUUM, schemaevolution)Right-size and tune job clusters, serverlesscompute, and SQL warehouses to balanceperformance and cost, monitoring usagethrough system tablesManage catalogs, schemas, permissions,and lineage in Unity Catalog, applying least-privilege access and controls for sensitive(PHI/PII) dataValidate data accuracy, completeness,



andtraceability across the ingestion-to-application data flowDocument pipeline architecture, datalineage, and model logicTrack and manage pipeline work using theproject's tooling (e.g., Clickup and JIRA);contribute code following the team's CI/CDand branching standards (e.g., Github orGitLab), deploying with Databricks AssetBundlesSupport incident response and root-causeanalysis for data pipeline issues affectingproductionParticipate in knowledge transferactivities, including documentation review,pairing, and onboarding support, as projectsrequireOther valuable skillsDatabricks certifications: Data EngineerAssociate and/or Data Engineer ProfessionalExperience with Databricks Asset Bundlesand CI/CD for Databricks (e.g., GitLab CI/CDor GitHub Actions), and Terraform (Databricksprovider) for workspace and Unity Cataloginfrastructure-as-codeExperience with Apache Airflow or otherexternal orchestrators triggering DatabricksjobsExposure to Snowflake or other cloud datawarehouses (e.g., Amazon Redshift)Familiarity with Databricks AI/BI dashboardsand Genie, or MLflowExperience with AWS Secrets Manager /Databricks secret scopes and AWSCloudWatch or similar monitoringExperience with drug supply chain, pharmacylicensing, or similar healthcare regulatoryframeworksExperience with state-level or federalregulatory and compliance systemsPrior work with not-for-profit orgovernmental organizationsFamiliarity with C#By applying for this position, you acknowledge that Light-it will process your information in accordance with our Privacy Policy.
#J-*****-Ljbffr

📌 Data Engineer (Buenos Aires)
🏢 Light-it
📍 Buenos Aires