Data Engineer Jobs

No Other Bank Is Doing What We Do.

At BDC, we help Canada and its entrepreneurs create a prosperous, inclusive and green economy. Our mission is to help Canadian businesses thrive by providing financing, capital and advisory services. We’re devoted to Canadian entrepreneurs. We’re also dedicated to our employees. Adaptable. Inspiring. Different. There’s a reason we like to work here, and we think you’ll like it too. Join BDC and help make a difference!

Diversity. Equity. Inclusion. They’re more than just words for BDC. These concepts are foundational to our success and to our ability to attract, retain, mobilize and develop the right talent, as well as to offer a healthy, professional and collaborative environment. We are committed to cultivating and preserving an environment where all employees can thrive, and, for over a decade, we have been recognized as one of Canada's Top 100 Employers and one of Canada's Best Diversity Employers. In recruiting for our team, we welcome the unique contributions that you can bring in terms of your education, opinions, culture, ethnicity, race, sex, gender identity and expression, nation of origin, age, languages spoken, veteran’s status, color, religion, disability, sexual orientation, beliefs, experiences, and more.

Position Overview

As a Data Engineer, you will be working within the data platform team and contribute to enterprise-wide best practices, processes, and platforms for BDC's strategy. The bulk of the work will be in data exploration, data ingestion, data transformation, data preparation, designing, building, and developing pipelines consolidating streaming and batch data sources into the Enterprise Data Lake. You will work on the frameworks and libraries that the data platform team creates and maintains to progress from data to value.

CHALLENGES TO BE MET

• Design, build and develop ELT pipelines consolidating streaming and batch data sources into the Data Lake zones
• Collaborate with the Data Governance Office and participate in data governance practices (data lifecycle management, data quality management, data cataloging, and metadata management)
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, performance, and availability
• Develop clean and maintainable code with continuous integration / continuous deployment (CI/CD) best practices to prevent integration problems and ensure the code is releasable at any point in time
• Ingest, curate, wrangle, and prepare data for use in AAAI models and other systems
• Participate in the estimation of the stories based on the defined Acceptance Criteria, Definition of Ready, and Definition of Done
• Participate in scrum meetings and update stories on Azure DevOps
• Collaborate with data analysts to map data fields
• Develop data ingestion, transformation, and preparation with Scala/Python and Apache Spark
• Contribute to designing and building the infrastructure required for optimal ingestion, transformation, and loading of data from a wide variety of data sources using Azure big data technologies (ADLS, ADF, Databricks, and Azure Functions) and Power BI technologies
• Design, code, unit test, and integrate new features and functionality to BDC’s data engineering libraries
• Create and maintain datasets on Azure Data Lake (ADLS) utilizing Azure Data Factory (ADF) and Azure Databricks

What We Are Looking For

• Strong interpersonal, strong communication and documentation
• Experience with Azure data factory
• 3+ years of industry experience as a Data Engineer
• A bachelor’s degree in IT, Computer Science, Statistics, Mathematics, or related fields
• Experience with MS SQL Server and other relational database management systems
• 2+ years of experience with Python programming language
• Experience with Agile processes
• Experience with the Azure DevOps pipelines
• 2+ years of experience with Databricks platform
• Bilingual (French & English)
• Experience with Scala programming language

With us, you'll be able to achieve the work/life balance you're looking for, with competitive working conditions and above-market flexible benefits. This includes modern workspaces to work from when you are in our offices, and, for some specific positions, the ability to work remotely, on reserve, and/or within your community.

While we appreciate all applications, we advise that only the candidates selected to participate in the recruitment process will be contacted. If you are a candidate with a disability and need an accommodation to complete the application process, please email us at [email protected], and include your full name, the best way to reach you, and the accommodation needed to assist you with the application process.