Data Engineer - Dwh

Data Engineer DWH

The Data Engineer will help build, scale and maintain the entire business intelligence platform. The ideal candidate will have a deep technical understanding and hands-on experience in big data and distributed computing, data pipelines, dimensional modeling, columnar and row based databases and data visualization. The Data Engineer will scale our cloud infrastructure, improve tools used by our analysts and scientists developers, and streamline data feeds processes. The ideal candidate should feed on challenges and love to be hands-on and keep up to date with recent technologies that maximize the speed, performance and access to data for analytics and machine learning while reducing costs.

This job plays a key role in elevating the business intelligence delivery by building reliable pipelines and infrastructure to help the team improve modeling efficiency and consistency of data. You should be passionate for continuous learning, experimenting, applying and contributing towards cutting edge open source data technologies and software.

Responsibilities:

· Performing all of the necessary data transformations to populate data-lake and downstream data marts.

· Identify technical requirements and deliver solutions establishing efficient design and programming patterns that beat SLAs and help easily manage the data platform.

· Designing, integrating and documenting technical components for seamless data extraction and analysis.

· Support the company's broader technical and operational requirements adopting best practices in our data systems.

· Working in a team environment, interacting with multiple groups on a daily basis (very strong communication skills).

· This role will report into the Analytics team, but will have to interact with the rest of the data organization to maximize the value of our infrastructure.

Skills and Abilities:

· Degree in Computer Science, related technical field or equivalent practical experience.

· Familiarity with Business Intelligence, Data Science and Machine Learning.

· Exceptional Problem solving and analytical skills.

· Ability to write, analyze, and debug SQL queries (MS SQL, Sybase, PostgreSQL).

· Experience architecting efficient framework and optimization designs for analytics platforms, data warehouse design, pipelines, ELT, ETL. Experience with big data and data layer design is preferred.

· Hands-on experience in Python, experience designing and working with Hadoop, Hive, Sqoop is preferred and/or Apache Spark.

· Experience working with DevOps, DataOps, Git is preferred.

· Experience with cloud platforms, GCP is preferred.

· Experience supporting Tableau, PowerBI or similar BI tools is preferred.

· Technical leadership and strong independent problem-solving skills

· Experience handling log or event streaming data sources is nice to have.