Data Engineer Jobs

Role: Data Integration Engineer with Python

Location: Kanata ON, Canada (Hybrid)

Experience: 8 Years

Skills: Python, ETL processing, Production, High visibility, 8/10 in Python, SQL, Snowflake

Data Integration Engineer

·Responsible for extracting and copying business data and loading it into a data warehousing environment that they have designed.

·Need to have both design and programming skills as they are also responsible for testing the performance of the system and troubleshooting any problems before it goes live

·Must have extensive knowledge of coding languages, especially python and warehouse architecture and be able to clearly communicate your ideas to the company.

·Must have experience creating highly efficient and customized warehouse environments that perfectly suits the data storage needs of the company.

Essential Responsibilities/Duties:

·Leads the design of the logical data model and implements the physical database structure and constructs and implements operational data stores and data marts.

·Consulting with data management teams to get a big-picture idea of the company’s data storage needs.

·Presenting the company with warehousing options based on their storage needs.

·Designing and coding the data warehousing system to desired company specifications.

·Develop/Maintain confluence pages to track all data warehouse implementations and specifications

·Conducting preliminary testing of the warehousing environment before data is extracted.

·Develops logical and physical data flow models for ETL applications.

·Translates data access, transformation, and movement requirements into functional requirements and mapping designs.

·Extracting company data and transferring it into the new warehousing environment.

·Testing the new storage system once all the data has been transferred.

·Develop/Maintain data mapping confluence pages based on data hosted by company warehouse

·Troubleshooting any issues that may arise.

·Providing maintenance support.

Skills:

·5+ years - Enterprise Data Management

·5+ years -SQL Server based development of large datasets

·4+ years with Data Warehouse Architecture, Snowflake experience preferred

·3+ years’ experience in Finance / Banking industry – some understanding of Securities and Banking products and their data footprints

·5+ yearsPython coding experience

·PL/SQL Server developmentexperience

·Experience withAzure Data Factory and Azure Databricks

·Dimensional modeling experience

·ETL tools experience, such as SSIS

·Extensive knowledge of coding languages, includingPython, Java, XML, and SQL.

·Proficiency in warehousing architecture techniques, including MOLAP, ROLAP, ODS, DM, OLTP, OLAP, Dimensions, Facts, Data modeling and EDW.

·Proven work experience as an ETL developer.

·Strong project management skills.

·Ability to analyze a company’s big-picture data needs.

·Clear communication skills.

·Ability to troubleshoot and solve complex technical problems.

·Modeling tools experience, such as Toad Data Modeler, Erwin, and Embarcadero

·Hands-on experience with Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing

·Any experience with Regulatory Reporting is a Plus

Education

·Minimally a BA degree within an engineering and/or computer science discipline

·Master’s degree strongly preferred