Data Engineer (Large Language Models)

You can be part of an inclusive team of diverse talent and character. In this diversity lies our greatest strength.

Description

Create Your Own Chemistry: What We Offer You

At BASF, we create chemistry through the power of connected minds. By balancing economic success with environmental protection and social responsibility, we are building a more sustainable future through chemistry. As the world’s leading chemical company, we help our customers in nearly every industry meet the current and future needs of society through science and innovation.

We provide a fulfilling work environment with a strong emphasis on the physical and psychological safety of our employees and the communities we operate in. We are always working to form the best team with an emphasis on diversity, equity, and inclusion and through lifelong learning and development.

At BASF, we constantly strive to become an even better workplace. As a result of our commitment to our employees, BASF has earned various awards, including being recognized by Mediacorp as a Top Employer in Canada and the GTA in 2023, and for many consecutive years prior. We are also thrilled that, for the first time ever in 2023, we have been further recognized by Mediacorp as one of Canada’s Top Employers for Diversity, as well as for Young People.

We invite you to join our best team on our journey to create solutions for a sustainable future!

Data Engineer (Large Language Models) (2300959)

Working Model: Hybrid

Location: Mississauga, ON

Where the Chemistry Happens…

BASF is a leader in the chemical industry, driving innovation and sustainability through cutting-edge technology. We are currently seeking an experienced Data Engineer with a strong background in setting up scalable data pipelines to process large volumes of data and handle data preparation, including labeling, for fine-tuning and (re)training large language models. In this role, you will be instrumental in advancing our AI initiatives by creating and maintaining a robust, scalable, and efficient data infrastructure, preferably using Microsoft Azure Cloud services. If you are passionate about Large Language Models and AI in general, have a strong background in Data Engineering and enjoy working on cutting-edge topics, we would love to hear from you!

Formula for Success: You Will…

• Continuously monitor and optimize data infrastructure to support the development and deployment of state-of-the-art AI models.
• Continuously learn to keep up with the rapid technological developments.
• Design, implement, and maintain data pipelines for structured and unstructured data.
• Collaborate with AI researchers, data scientists, and other stakeholders to independently gather requirements.
• Leverage Microsoft Azure Cloud services for data storage, processing, and management, ensuring seamless integration with our AI infrastructure.
• Share your knowledge and expertise with colleagues and promote a culture of innovation and excellence within the organization.
• Automate and streamline data preparation processes, including data cleaning, transformation, and labeling for fine-tuning and (re)training large language models.

Qualifications

Ingredients for Success: What We Look for in You…

• Familiarity with workflow tools for data pipelines (like Airflow).
• Strong experience using relational and NoSQL databases (like Elasticsearch).
• Familiarity with cloud platforms, preferably Microsoft Azure and experience in deploying and managing data solutions in a cloud environment.
• Solid programming skills in Python and experience with data manipulation libraries such as Pandas or NumPy.
• Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or a related field.
• Strong experience building (parallel) data processing pipelines, using Apache NiFi, Spark/Databricks, Azure Data Factory, or similar technologies.
• Excellent problem-solving, critical thinking, and communication skills.

Nice-to-have:

• Experience with data labeling tools and platforms, such as Azure Machine Learning Data Labeling or Amazon SageMaker Ground Truth.
• Proven track record of successful large scale data engineering projects, preferably in an industrial or corporate research setting.
• Familiarity with AI ethics and responsible AI practices.
• Knowledge of data engineering best practices, including data quality, data governance, and data security.
• Relevant certifications, such as Microsoft Certified: Azure Data Engineer Associate.
• Prior experience working with AI infrastructure (ideally related to large language models).

Create Your Own Chemistry: What We Offer You

Adding value to our customers begins with adding value to you. You@BASF is the suite of benefits, perks, programs and unique opportunities we offer to support you – the whole you – in all stages of your life and career. With you@BASF, you create your own chemistry.

The total rewards that you receive as a BASF employee go way beyond a paycheck. From competitive health and insurance plans to robust retirement benefits that include company-matching contributions, to making sure you never stop learning, we believe investing in you is investing in our success. Working for a large, global organization, you’ll have a chance to grow professionally and personally, expand your network and build a rewarding and dynamic career. We also provide engaging learning and development opportunities to help you make the most of your talents and your role.

Inclusion and Equal Opportunity Employment

BASF is dedicated to creating a diverse and inclusive workplace where our employees can be their authentic selves. We are an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, age, citizenship, place of origin, ethnic origin, colour, religion/creed, sex/pregnancy, marital status, family status, disability status, sexual orientation, gender identity or expression, or any other characteristic protected by law.

We seek to make our recruitment process accessible for applicants with disabilities. If you require accommodations or support throughout the recruitment process, please contact [email protected] with the subject line “Recruitment Accommodation Request”.

Privacy Statement

BASF takes security & data privacy very seriously. We will never request personal or financial information of any kind via either text message or direct message on any social media platform or job board. Furthermore, we will never offer a candidate a position and request a cheque for equipment or any other type of payment during the job application process. If you have experienced any of the above, please contact [email protected] to report fraud.