Manager, Data Engineering Jobs

Data Axle provides data, applications, and services that help organizations make and save money. Our commitment to accuracy, service and innovation drive customer acquisition, retention, and product enhancement. We are currently seeking a Manager, Data Engineering.

We are looking for a Manager, Data Engineering who will be responsible for Leading engineering team resources across the Data Axle organization. This person will be a hands-on manager and work with a number of applications, development languages and operating systems.

Responsibilities:

• Creation and support of real-time data pipelines built on AWS technologies including Glue, Redshift/Spectrum, Kinesis, EMR and Athena
• Identify and direct opportunities for improvement to the overall development process
• Responsible for the overall solution architecture and tech design, keeping it at its best shape, working closely with developers and engineers
• Ensure development team members complete projects in accordance with quality standards and deadlines.
• Other projects and responsibilities as assigned by executive leadership.
• Collaborate with other tech teams to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering and machine learning. Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customer
• Partner with product owners/BSAs and developers to implement strategies to meet the objectives set by senior executives.
• Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency
• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies.
• Perform other duties as assigned by management.
• Design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.

Knowledge, Skill, and Abilities:

• Skilled at optimizing large, complicated SQL statements.
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
• Awareness of Apache Hadoop, HDFS, Hive
• Proficient in at least one and experience with modern programming languages (Java, Python) and open-source technologies.
• Strong proficiency with SQL and its variation among popular databases
• Demonstrated strength in data modeling, ETL/ELT development, and data warehousing
• Knowledge of data management fundamentals and data storage principles

Education, Experience, and Certification:

• 8+ years of industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets
• Degree/Diploma in computer science, engineering, mathematics, or a related technical discipline
• Experience using big data processing technology using PySpark
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
• Experience with Customer Data Platform
• Experience with some of the modern relational cloud databases.
• Experience using business intelligence reporting tools (Quicksight, Tableau, Business Objects, Cognos, Power BI etc.)
• Experience with data pipeline and workflow management tools: Airflow
• Experience working with distributed systems as it pertains to data storage and computing
• Experience working with AWS big data technologies (Redshift, S3, EMR, Spark, EKS, Glue, Kafka, SQS, SNS, Lambda)

If you are a resident of California, Colorado, Washington, or New York City, please contact us or email us at [email protected] to receive compensation and benefits information for this role. Please include the job title and/or job ID of the role you are interested in.

Affirmative Action/EEO Statement:

At Data Axle, we are committed to attracting, retaining, and engaging employees from all walks of life. Diversity is an important part of our values and business operations. We are dedicated to creating an inclusive environment that promotes professional development for everyone. As part of that commitment, Data Axle does not discriminate on the basis of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, marital status, status with regard to public assistance, status as a disabled veteran and or Vietnam Era or any other characteristic protected by federal, state, or local law. All qualified applicants will receive consideration for employment. In addition, Data Axle will provide reasonable accommodation for otherwise qualified disabled individuals.