Big Data Engineer

Job Location - Cary NC, Bridgewater NJ, Chicago IL, Atlanta GA (hybrid) Key Responsibilities Design, develop, and maintain scalable and reliable data pipelines for the extraction, transformation, and loading (ETL) of data from various sources. Develop, optimize, and maintain complex data processing jobs, leveraging distributed computing frameworks such as Apache Spark, Flink, or similar. Monitor, troubleshoot, and improve the performance of data systems, ensuring minimal latency and optimal throughput for data processing Required Skills 6- 8 years of experience on Big Data Strong hands-on experience as a hadoop developer /big data engineer. Advanced knowledge of the hadoop ecosystem and its components In-depth knowledge of Scala, Spark, and similar frameworks. In-depth knowledge of HBase, SOLR, Hive, Gremlin and Pig Nice to have : Knowledge / experience on Spark and Flume/NiFi Nice to have : Experience on Azure stack as data engineer working on Synapse analytics or ADF or Azure Databricks Life At Capgemini Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer: Flexible work Healthcare including dental, vision, mental health, and well-being programs Financial well-being programs such as 401(k) and Employee Share Ownership Plan Paid time off and paid holidays Paid parental leave Family building benefits like adoption assistance, surrogacy, and cryopreservation Social well-being benefits like subsidized back-up child/elder care and tutoring Mentoring, coaching and learning programs Employee Resource Groups Disaster Relief About Capgemini Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion. Get The Future You Want | www.capgemini.com