30 sep
|
GyanSys
|
Argentina
Summary / Primary Role:
We are seeking a Data Platform Lead / Cloud Systems Architect to own Odyssey’s enterprise analytics ecosystem. You will manage everything from terraform deployments to our emerging GenAI infrastructure. Beyond technical execution, you will serve as a strategic guardian against engineering inertia, enforcing a discipline of rational adaptability to ensure investments are driven by objective future value rather than past expenditures.
Principal Duties and Responsibilities:
• Architect and maintain a multi-region Databricks on AWS environment, enforcing "secure by default" networking via customer-managed VPCs, PrivateLink, Transit Gateway, and strict IAM cross-account roles.
• Design the underlying infrastructure for Generative AI, including configuring MLflow for model governance, Databricks Vector Search for RAG applications, and GPU-optimized compute clusters for inference.
• Enforce reproducibility by managing all platform resources (workspaces, clusters, jobs) via Terraform and Databricks Asset Bundles (DAB),
ensuring no manual changes exist in Production.
• Systematically audit legacy technical choices with a "clean slate" perspective. You are expected to seek disconfirming evidence that contradicts the status quo to prevent confirmation bias and the escalation of commitment to outdated strategies.
• Lead monthly FinOps reviews using AWS Cost Explorer and Databricks system tables to differentiate between necessary investment and "sunk costs," ensuring we do not irrationally commit resources to failing projects simply because they are already underway.
• Own strategic vendor relationships (Databricks, AWS, Fivetran, Sigma), holding partners accountable for successful outcomes and resolving support blockers aggressively rather than passively accepting roadmap delays.
• Drive a Data Mesh culture by treating data assets as "Data Products." Define clear contracts, SLOs (Service Level Objectives), and publication standards to decouple produce
📌 Data Platform Lead (Argentina)
🏢 GyanSys
📍 Argentina