10 sep
|
Techunting
|
Mendoza
10 sep
Techunting
Mendoza
Description
1. Data Acquisition and Integration:
- Source, gather, and integrate data from various internal and external platforms and databases.
- Collaborate with data providers and stakeholders to understand and ensure data availability and quality.
2. Data Cleaning:
- Identify, diagnose, and resolve any data inconsistencies, anomalies, and missing data.
- Design and implement data cleaning procedures to enhance data quality and reliability.
- Document any data transformations, anomalies, and resolutions to maintain data integrity.
3. Database Management:
- Design and maintain scalable and optimized database schemas for storing and retrieving machine learning datasets.
4. Creation of Queries:
- Develop complex SQL queries to extract, transform, and load (ETL) data tailored to specific machine learning tasks.
- Create data views and aggregations to simplify data access and usage by machine learning teams.
- Optimize query performance to ensure swift data retrieval.
5. Process Optimization & Data Pipelines:
- Design, implement,
and maintain ETL pipelines for seamless data flow across systems.
- Optimize existing data processes for speed, cost-efficiency, and reliability.
- Automate recurring tasks and jobs to ensure timely data availability for machine learning projects.
- Monitor and ensure the smooth running of data pipelines, troubleshoot any issues, and provide quick resolutions.
6. Support for Machine Learning Testing:
- Work with the team to understand data needs for model development and testing.
- Assist in debugging data-related issues in machine learning pipelines, such as data leakage, imbalances, or missing values.
Requirements:
Qualifications:
Bachelor's or higher degree in a related field (e.g., Data Science, Computer Science, Statistics).
Knowledge of ETL tools (e.g., Apache Nifi, Talend, Informatica) for data acquisition and transformation.
Experience using APIs and connectors for data extraction from various sources.
Proficiency in database
📌 Data Science (Mendoza)
🏢 Techunting
📍 Mendoza