Filled
This offer is not available anymore

Data Engineer in Barcelona

Netquest

Workplace
Onsite
Hours
Full-Time
Internship
No
Share offer

Job Description

Netquest is among the most advanced and innovative digital data collection specialists worldwide in the market research and analytics industry. We currently have more than 2,000,000 consumers willing to share their behavioral data and give us their opinion in 27 countries.

Our ambition is to be the most reliable, flexible and powerful data source in the market, and contribute to the future of market research through automation and innovation.

Job description

Next time you go shopping, think about this: What if brands asked for your opinion on their products before they put them on the shelf? Wouldn’t that be nice? At Netquest we give voice to the consumers enabling them to shape the products and services of tomorrow. How? We deliver consumers’ genuine opinions and data to help companies create better products for you.

 

We are currently looking for a talented Data Engineer to join our team. As part of a growing Data & Analytics team you will work to grow and expand our data platform to solve our current and future challenges. You will be working with multiple data sources contributing to transform the data into a business knowledge.

 

The main responsibilities of this team are:

 

  • Design, evolve and maintain the data platform that ingests, stores, processes and exploits data from disparate data sources
  • Design, build, and maintain processes and components of a streaming data/ETL pipeline to support both real-time&batch analytics.
  • Govern all data ingested by the platform and define and implement the data models that support the different analytics needs.

 

Your main responsibilities will be (in this order):

 

  • Design complex queries in MySQL or PostgreSQL, in order to optimize performance of extraction and analysis of big datasets.
  • Design and implement multi-dimensional model in a distributed database like AWS Redshift.
  • Develop transformation jobs with an ETL tool like Talend or a distributed computing framework like Apache Spark.
  • Automation: use of tools like Apache Airflow, AWS Batch or AWS Lambda and bash scripts for the automated management of the data pipeline.
  • Data governance: be able to organize and maintain a data lake (AWS S3) so that it does not become a data swamp
  • Analyze the data requirements and define the needed data sources, formats, extraction frequency.
  • Develop extraction components from different data sources (databases, api, files, etc) with programming languages such as Java, Scala or Python.

Requirements

You´re a great candidate if…

  • You have a Bachelor's Degree in Computer Science or a related technical field.
  • You have at least 2 to 5 years of experience as a back-end developer (Java or Scala or Python)
  • You’re an ace at data modeling, able to keep into account the needs of multiple users and can code SQL in your sleep, optimizing queries for performance and maintainability
  • You are knowledgeable with various ETL techniques and frameworks.
  • You have been using Amazon WebServices, Azure or similar platforms.
  • You are able to work-out effective solutions under uncertain or ambiguous circumstances
  • You’re always willing to learn something new and embrace a healthy debate.

 

About Netquest

Netquest is among the most advanced and innovative digital data collection specialists worldwide in the market research and analytics industry. We currently have more than 2,000,000 consumers willing to share their behavioral data and give us their opinion in 27 countries.

Our ambition is to be the most reliable, flexible and powerful data source in the market, and contribute to the future of market research through automation and innovation.

Other data engineer jobs that might interest you...