This position allows you to join a fast-growing technology organisation redefining productivity paradigms in the software engineering industry. If you are passionate about technology and want to learn about new trends shaping human behaviour, this opportunity is for you.
At our company, optimising technology costs and maintaining efficiency are core principles. As part of this ongoing initiative, we focus on optimising our data usage, particularly our reliance on Snowflake. As our data grows, so does the need to adopt a "run lean" approach. Additionally, we are embarking on a key project to migrate our data infrastructure from Snowflake to Google BigQuery to enhance scalability and integration with our broader ecosystem.
We seek talented engineers to review, optimise, and lead the migration of specific workloads within our organisation. Candidates should have a solid understanding of Snowflake, Google BigQuery, and SQL and be able to assess, suggest, and implement improvements while ensuring a seamless migration process.
The Impact You'll Make:
- Lead the migration of data and workflows from Snowflake to Google BigQuery.
- Identify and implement strategies to reduce technology costs associated with Snowflake usage.
- Optimise data workflows to ensure cost efficiency and compatibility with BigQuery.
- Translate Snowflake schemas and queries into BigQuery formats, ensuring functional equivalence.
- Propose and execute infrastructure tweaks to improve data handling and processing times.
- Provide both advisory and hands-on support to ensure departments achieve optimal data efficiency during and after migration.
- Educate and mentor team members and departments on best practices for data optimisation and BigQuery utilisation.
- Develop and implement monitoring tools to track performance improvements and cost savings.
Technology Stack (Main Technologies):
- Google BigQuery (mandatory)
- Snowflake
- SQL
- DBT
- AWS
- Apache Airflow
- Python
- Datadog / Monte Carlo
What You'll Bring To Us:
- Proven Snowflake and Google BigQuery expertise, with a strong track record of leading data migrations and implementing cost optimisation strategies.
- Proficiency in Python and Airflow for automating and orchestrating data workflows.
- Ability to leverage DBT for data transformations, ensuring robust and optimised data pipelines.
- Working knowledge of Monte Carlo (SQL) and Streaming and Open Table formats
- Strong ability to work with cross-functional teams, providing advisory and hands-on support.
- Effective communication skills to share knowledge and best practices across the organisation.
- Keen analytical skills to identify inefficiencies and propose actionable improvements.
- Creative problem-solving to implement innovative solutions.
- Dedication to monitoring performance and making iterative improvements to maintain optimal operations.
- Excellent problem-solving skills and attention to detail.
- Excellent written and verbal English communication skills.
- Proactivity and capacity to bring well-thought-out solutions.
What We'll Offer You In Return:
- The chance to join an organisation with triple-digit growth that is changing the paradigm of how software products are built.
- The opportunity to form part of an amazing, multicultural community of tech experts.
- A highly competitive compensation package.
- Medical insurance.
Come and join our #ParserCommunity.
