Data Engineer - 2 (Contract)

Story Behind the Need

Business group: Corporate Functions Analytics – responsible for building AI/ML solutions and any data analytic solutions for different groups in the bank

Project: Reset enhancement project – to enhance the authorization flow within Digital platforms

Candidate Value Proposition

The successful candidate will have the opportunity to gain exposure to advanced technologies in big data analytics, such as Spark, GCP, Kafka; work in a top 5 Canadian Bank.

Typical Day In Role

• Build and maintain batch data pipeline for the projects (Airflow, Spark, Docker, Kafka, GCP, Kubernetes)
• Prepare detailed documentation to outline data sources, models, and algorithms used and developed.?
• Collaborate with operation, and other analytics teams to deploy models and algorithms in production across different channels and platforms?
• Work with the team to design the project architecture and road map.
• Present results to business line stakeholders and help implement real world data-driven changes.??
• Efficiently handle large volumes of structured and unstructured data through ingestion, modeling, transformation, and storage across diverse data stores. Leverage distributed computing tools (e.g., Spark, Cloud) for analysis, data mining, and modeling
• Collaborate with business lines and other stakeholders and identify opportunities to drive business value by leveraging data engineering and data ops solutions
• Create and apply model and algorithm testing strategies to measure the effectiveness of models, and make ongoing changes

Candidate Requirements/Must Have Skills

• 3+ years of proven experience as a Data Engineer, Machine Learning Engineer, or similar role
• 2+ years of industry experience with test driven development methodology
• 2+ years’ hands-on experience with distributed computing systems and data ops (Apache Spark, Airflow, GCP)
• 3+ years of working experience with SQL and relational databases technologies/concepts for both querying/manipulating datasets and managing /controlling databases
• 2+ years of experience programming in Python or equivalent languages (eg. Java)

Nice-To-Have Skills

• DevOps and/or MLOps experience
• Experience/familiarity with Source Code Management Tools: Git, GitFlow, Bitbucket,
• Experience in technical integration
• Experience with PM/Visualization tools: PowerBI, JIRA, Confluence
• Experience with UNIX tools and shell scripting

Soft Skills Required

• Excellent written, verbal, and interpersonal skills for executive level communication and collaboration
• Able to work in a fast-paced, constantly evolving environment and manage multiple priorities.??
• Pragmatic and capable of solving complex issues.

Education

Bachelor’s Degree or equivalent in Computer Science, Engineering, or relevant field.?

Best VS. Average Candidate

Ideal candidate has strong coding skills and strong data engineering skills, can help the team to execute productionize data pipelines, and can help resolve production issues quickly; experience from tech industry / fintech/ FI ideal but not required.

Candidate Review & Selection

3 rounds – MS Teams Video Interview

1st – behavioral + coding – live coding – 1 hour

2nd – team panel interview (with data engineer and architect) – 2 hours

3rd – leadership – 30 mins

Job 66130