Business Intelligence Specialist - Etl Developer

JOB DETAILS

Job Title: Business Intelligence Specialist - ETL Developer

Location: 315 Front St. West, Toronto, ON (3 days onsite, 2 days remote - hybrid role)

Duration: 8 – 12 Months

JOB DETAILS

General Responsibilities

Design, develop and implement ingestion framework from Oracle source to Azure Data Lake - initial load and incremental ETL.

Used tools are:

-Oracle Golden Gate (knowledge and experience are an asset but not required) for data ingestion and change data capture (currently in final stages of proof of concept)

-Azure Data Factory (expert knowledge) to maintain pipeline from Oracle to Azure Data Lake

-Azure Databricks/PySpark (good Python knowledge required) to build transformations of raw data into curated zone in the data lake

-Azure Databricks/Python/SQL (good SQL knowledge required) to develop and/or troubleshoot transformations of curated data into datamart model

Review the requirements, database tables, and database relationships - Identify gaps and inefficiencies in current production reporting environment and provide recommendations to address them in the new platform.

Design ingestion framework and CDC - preferred tools are Oracle Golden Gate and Azure Data Factory

Prepare design artifacts

Work with IT partner on configuration of Golden Gate - responsible to provide direction and "how to".

Maintain dynamic pipeline for ETL ingestion to add new tables and data elements

Data design - physical model mapping from data source to reporting destination.

Understand the requirements. Recommend changes to the physical model.

Assist with data modelling and updates of source-to-target mapping documentation

Develop scripts for the physical model, and update database and/or data lake structure.

Experience:

Experience of 7+ years of working with SQL Server, SSIS, and T-SQL development or similar

Experience of 2+ years of working with Azure SQL Database, Azure Data Factory, Databricks and Python development

Experience building data ingestion and change data capture using Oracle Golden Gate

Experience working with building databases, data warehouses and dimensional data marts and working with delta and full loads

Experience with any ETL tools such as SSIS, ADF, Databricks, other cloud tools

Experience working with MS SQL Sever on premise and within Azure Environment

Experience on Data modeling, and tools – e.g. SAP Power Designer, Visio

Experience with snowflake and star schema model. Experience in designing data warehouse solutions using slowly changing dimensions.

Experience working with SQL Server SSIS and other ETL tools, solid knowledge and experience with SQL, other RDBMS (Oracle, PL/SQL)

Understanding data warehouse architecture with a delta lake, dimensional model.

Analyze, design, develop, test and document ETL programs from detailed and high-level specifications, and assist in troubleshooting.

Utilize SQL to perform tasks other than data transformation (DDL, complex queries)

Good knowledge of database performance optimization techniques

Ability to assist in the requirements analysis and subsequent developments

Ability to conduct unit tests and assist in test preparations to ensure data integrity

Work closely with Designers, Business Analysts and other Developers

Liaise with Project Managers, Quality Assurance Analysts and Business Intelligence Consultants

Design and implement technical enhancements of Data Warehouse as required.