Data Engineer en Barcelona o en remoto

We are seeking a skilled Data Engineer to join our Vector team. The ideal candidate will be responsible for building, maintaining, and optimizing our data infrastructure, ensuring seamless data flow and accessibility for ML, analytical and business needs.

Key Responsibilities:

• Oversee the in-house ML data platform, managing tasks such as collecting, storing, and transforming data to support machine learning models.
• Design, develop, test, and orchestrate data workflows to streamline pipelines.
• Establish and promote best practices for data handling and processing within the ML context.
• Contribute to the development of internal tools for automating data processes and business workflows, enhancing efficiency and scalability.
• Collaborate closely with product, MLOps and data science teams to ensure an optimal data experience for all ML practitioners and data consumers.

Requirements:

• 3+ years of professional work experience in data engineering.
• Strong expertise in Python 3 and common data frameworks (Pandas, PySpark).
• Experience with modern data storage solutions: AWS S3, data lakes, and data warehouses.
• Experience with data orchestration tools (Dagster, Airflow).
• Experience with streaming technologies (Kafka, Spark).
• Basic knowledge of machine learning and data analytics.
• Basic knowledge of data visualization and BI tools.
  
  

Nice to have:

• Experience with Databricks platform.
• Experience with Druid or other OLAP systems.
• Experience in building ML data platforms.