072732-Big Data Engineer Jobs

Life at Capgemini
Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

• Paid time off and paid holidays
• Paid parental leave
• Healthcare including dental, vision, mental health, and well-being programs
• Disaster Relief
• Mentoring, coaching and learning programs
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Employee Resource Groups
• Flexible work
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan
• Family building benefits like adoption assistance, surrogacy, and cryopreservation

About Capgemini Engineering
World leader in engineering and R&D services, Capgemini Engineering combines its broad industry knowledge and innovative technologies in digital and software to support the convergence of the physical and digital worlds. Coupled with the capabilities of the rest of the Group, it helps clients to accelerate their journey towards Intelligent Industry. Capgemini Engineering has more than 55,000 engineer and scientist team members in over 30 countries across sectors including Aeronautics, Space, Defense, Naval, Automotive, Rail, Infrastructure & Transportation, Energy, Utilities & Chemicals, Life Sciences, Communications, Semiconductor & Electronics, Industrial & Consumer, Software & Internet.
Capgemini Engineering is an integral part of the Capgemini Group, a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided every day by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 360,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group reported in 2022 global revenues of €22 billion.
Get the Future You Want | www.capgemini.com
Disclaimer
Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please get in touch with your recruiting contact.
Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law
Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.
Job description:
Name of the position: Bigdata Engineer
Reports to: Team Lead/Delivery Manager
Department/Project: Engineering
Purpose of the job
As a Bigdata Engineer, you will work on one of the world's largest social media platforms which deals with a few petabytes of data coming to the system daily. You will chip in as part of an R&D self-organized team working in an adventurous, innovative environment for our client.
Investigate, build, and implement the solutions for many technical challenges using innovative technologies, including building/improving Bigdata processing platform enabling work of software used by hundreds of millions of users.
Key responsibilities:

• You will acquire tasks from the project lead or Team Lead (TL), prepares functional and design specifications, and approves them with all team members.
• Evaluating implemented data systems for variances, discrepancies, and efficiency.
• Ensures that assigned area/areas are delivered within set deadlines and required quality objectives.
• Responsible for resolving crisis situations within responsibilities.
• Addresses area-level risks, provides and implements mitigation plans.
• Initiates and conducts code reviews, and builds code standards, conventions, and guidelines.
• Updating and optimizing local and metadata models.
• Suggests technical and functional improvements to contribute to the product;
• Provides estimations, and agreed task duration with the manage chips in to project plan of an assigned area.
• Design, implement, and maintain pipelines that produce business-critical data optimally and efficiently using cloud technology
• Developing standard methodologies for data coding to ensure consistency within the system.
• Evaluating existing data systems.

Required Skills

• Established big-data systems experience in Hadoop, Spark/SparkSQL, HiveSQL
• Proven experience as a Bigdata Engineer.
• Strong OOP skills
• Experience with large-scale graph data storage
• Proven Python and Java coding skills with 5+Years of experience.

Would be a plus:

• Experience with AWS.
• Experience with JavaScript and Go
• Experience with Kafka.
• Experience with Airflow, Apache Atlas