Data Engineer Jobs

POSITION PURPOSE
Reporting to the Manager, Technology Transformation is responsible for  full lifecycle design and development, implementation of new data platforms/solutions, production support, performance tuning of reporting environments including Extract Transform Load (ETL) batch and streaming data processes and for supporting the integration of those systems with other applications; works with internal and external stakeholders, Corporate IT and Data Analytics and Visualization Branch, to provide technical leadership in the analysis, design, implementation, management and support of data-driven business systems following various departmental technology plans and utilizing approved IT solutions; designs and builds end-to-end solutions that enable business stakeholders to self-serve their business intelligence needs; consults with stakeholders to steer any new or enhancement related requirements to ensure stakeholder business needs are met; develops solution alternatives used to ingest and process data; works with multiple cross functional teams within IT and the business on developing solutions.
CORPORATE INFORMATION TECHNOLOGY GOVERNANCE

Departmental information technology functions work in close collaboration with Corporate Information Technology Services (ITS); consistent with the Information Technology vision and strategy; supporting the development and implementation of Information Technology initiatives, programs, processes, policies, and protocols. Corporate ITS provides strategic ITS planning, direction and leadership across the Region.

 

MAJOR RESPONSIBILITIES

• Liaises with internal staff, providing systems expertise and support; share information regarding initiatives and other best practices with Branch, Department and Corporate staff;
• Works as part of a multi-disciplinary customer support team contributing to strategic plans, implementation plans, and ongoing support of continuous improvement initiatives within Department.
• Manages complex data management and reporting projects and leads project teams, ensuring timely delivery of products and services; tracks project activities, timelines and project deliverables.
• Works with ITS and vendors to design, develop and provide solutions to support the data needs of applications, analysis and support of the department’s data management initiatives and related Master Data Management (MDM) processes.
• Analyzes business requirements, suggests alternative approaches to reporting systems design working in collaboration with data and information architects, and prepares a proof of concept for user consultation.
• Assists management in developing RFP, RFQ, and handling departmental purchasing process.
• Develops department business cases and cost benefit analysis to obtain senior management approval on managing structured, unstructured and disparate source data into target data store(s)/Enterprise Data and Analytics platform.
• Assists in developing data centric strategy and department roadmap and obtains stakeholders approval.
• Performs backup duties of other staff, as assigned.
• Designs and builds data ingestion and integration pipelines for large volumes of operations and infrastructure asset temporal data from different sources. 
• Translates complex functional and technical requirements into detailed architecture, designs logical data models, physical databases, and high performing software solutions.

QUALIFICATIONS

• Minimum five (5) years demonstrated experience as a technology solutions architect/developer/ specialist or similar position/capacity.
• Must have experience in working with data modeling and analyzing large volume of data. Fluent in relational database, streaming data processing concepts, knowledge of current data management practices.
• Demonstrated experience in writing complex, highly-optimized SQL queries across large datasets. 
• Experience providing project implementation analysis and support in data management systems, data integrity and security as it relates to environmental business systems.
• Demonstrated knowledge and experience of software solutions development lifecycles/methodologies i.e. agile or other rapid application development methods.
• Web-based user interface design and development experience using advanced DHTML, CSS, JavaScript, AJAX, JQuery and Bootstrap; knowledge of ETL and visualization tools; Machine Learning concepts and tools (R, Python and JavaScript, FME and SSIS).   
• Experience in unified data modelling for relational and NOSQL database and physical database design; programming languages (e.g.  PL/SQL, Visual Basic, SQL, JavaScript, PHP, Node.JS and other open source languages).
• Successful completion of a University Degree in Computer Science, Computer Engineering, Information Technology, or approved equivalent combination of education and experience.