Big Data Engineer (Flink)

We are seeking a highly skilled and experienced Big Data Engineer with a strong focus on Apache Flink and graph processing to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and optimizing data pipelines and analytics solutions that leverage Apache Flink for large-scale data processing and graph analytics. You will work closely with data scientists, software engineers, and other stakeholders to deliver robust and scalable solutions that meet our data processing and graph analytics needs.

Responsibilities:

• Design and develop graph analytics solutions using Apache Flink's Gelly library or other graph processing frameworks.
• Optimize data processing performance and scalability by tuning Flink jobs, configuring parallelism, and leveraging Flink's advanced features.
• Ensure data quality, data governance, and data security standards are implemented throughout the data pipeline.
• Stay up-to-date with the latest advancements in Apache Flink, graph processing techniques, and big data technologies, and recommend innovative solutions to improve our data processing capabilities.
• Implement and optimize data pipelines for processing and analyzing big data sets in real-time and batch modes.
• Design, develop, and deploy large-scale data processing and analytics solutions using Apache Flink as the core framework.
• Work with cross-functional teams to integrate Flink-based solutions with other components of our data ecosystem, such as data storage, messaging systems, and visualization tools.
• Collaborate with data scientists and domain experts to understand requirements and translate them into technical solutions.
• Troubleshoot and debug issues related to data processing, performance, and system failures.

Requirements:

• Solid understanding of distributed systems, data modeling, data structures, and algorithms.
• Experience with big data technologies such as Hadoop, Spark, Kafka, or related frameworks.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Strong problem-solving skills and the ability to analyze complex data processing requirements.
• Strong attention to detail and commitment to delivering high-quality solutions.
• Proven experience as a Big Data Engineer with a focus on Apache Flink and graph processing.
• Excellent communication skills and the ability to work collaboratively in a team environment.
• Familiarity with data visualization tools and techniques is a plus.
• Strong expertise in Apache Flink, including Flink's streaming and batch processing APIs, state management, fault tolerance, and performance optimization techniques.
• Experience in designing and developing graph analytics solutions using Apache Flink's Gelly library or other graph processing frameworks.
• Proficiency in programming languages like Java, Scala, or Python for developing Flink applications.

If you are a passionate Big Data Engineer with expertise in Apache Flink and graph processing, and you thrive in a fast-paced, collaborative environment, we would love to hear from you. Join our team and contribute to building innovative and scalable data processing solutions using Apache Flink and graph analytics to unlock insights from our big data sets.

Please submit your resume, highlighting your relevant experience and projects related to Apache Flink and graph processing, along with a cover letter explaining your interest in the position and why you believe you are a strong fit for the role.