{"schemaVersion":"jobsearcher.job.v1","id":"0bca5fb3c228daa9796ef6f5","url":"https://jobsearcher.com/jobs/0bca5fb3c228daa9796ef6f5","canonicalUrl":"https://jobsearcher.com/jobs/0bca5fb3c228daa9796ef6f5","title":"Bigdata/Spark Engineer","description":"Understand Platform of Client and perform Platform Design, Development, support and maintenance of client involving various services of Bigdata such as Hadoop, HDFS, MapReduce, Yarn, Hive, HBase etc.\r\nProvide support and leadership from projects definition to project closure, including interpreting business requirements and drafting them into technical specifications\r\nDesign and development of frameworks for data ingestion, transformation and reporting services.\r\nprocesses and methodologies.\r\nDesign and Maintain the Oozie tool to automate the production jobs of Platform.\r\nDesign and develop data analytics products using big data technologies such as Hadoop, Spark, Kafka, Hive.\r\nResponsible to code medium and complex applications to deploy into Hadoop and Spark clusters of Platform.\r\nResponsible for data ingestion from multiple data sources, maintaining and scaling the big data platform infrastructure that supports client's business use cases.\r\nResponsible to implement the solutions in Object oriented and functional languages such as Java, Scala and Python with best design patterns and data structures.\r\nIdentify and recommend new ways to streamline the data centric applications and optimize the performance.\r\nInvolve in migration of the clusters to AWS cloud.\r\nLoad the data assets subscription model data flow with the help of Hortonworks NIFi\r\nDeliver and deploy applications in Cloud environment.\r\nData consumption patterns by integrating EDP with BI tools such as Tableau etc.\r\nDesign and Implement Real-time/Near-Realtime data streaming patterns using Kafka & Spark-Streaming.\r\nIntegrate Customer Master C360 with Platform.\r\nTroubleshooting and resolving software issues occurring in the development of the process and documenting test cases to ensure quality.\r\nSupport Bigdata services of EIM Platform that support architecture and engineering frameworks such as Batch ingestion and processing patterns using Hive, Pig, MapReduce & Spark\r\nDocument the functional and technical requirements by following client defined\r\nRequired Skills: A minimum of bachelor's degree in computer science or equivalent.\r\nMust have strong problem-solving and analytical skills\r\nMust have the ability to identify complex problems and review related information to develop and evaluate options and implement solutions.\r\nJ-18808-Ljbffr","company":"Hs Technologies Defunct","rawCompany":"hs technologies defunct","city":"McLean","state":"VA","isRemote":false,"isActive":false,"createdAt":"2026-07-16T01:29:31.321Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Bigdata/Spark Engineer","description":"Understand Platform of Client and perform Platform Design, Development, support and maintenance of client involving various services of Bigdata such as Hadoop, HDFS, MapReduce, Yarn, Hive, HBase etc.\r\nProvide support and leadership from projects definition to project closure, including interpreting business requirements and drafting them into technical specifications\r\nDesign and development of frameworks for data ingestion, transformation and reporting services.\r\nprocesses and methodologies.\r\nDesign and Maintain the Oozie tool to automate the production jobs of Platform.\r\nDesign and develop data analytics products using big data technologies such as Hadoop, Spark, Kafka, Hive.\r\nResponsible to code medium and complex applications to deploy into Hadoop and Spark clusters of Platform.\r\nResponsible for data ingestion from multiple data sources, maintaining and scaling the big data platform infrastructure that supports client's business use cases.\r\nResponsible to implement the solutions in Object oriented and functional languages such as Java, Scala and Python with best design patterns and data structures.\r\nIdentify and recommend new ways to streamline the data centric applications and optimize the performance.\r\nInvolve in migration of the clusters to AWS cloud.\r\nLoad the data assets subscription model data flow with the help of Hortonworks NIFi\r\nDeliver and deploy applications in Cloud environment.\r\nData consumption patterns by integrating EDP with BI tools such as Tableau etc.\r\nDesign and Implement Real-time/Near-Realtime data streaming patterns using Kafka & Spark-Streaming.\r\nIntegrate Customer Master C360 with Platform.\r\nTroubleshooting and resolving software issues occurring in the development of the process and documenting test cases to ensure quality.\r\nSupport Bigdata services of EIM Platform that support architecture and engineering frameworks such as Batch ingestion and processing patterns using Hive, Pig, MapReduce & Spark\r\nDocument the functional and technical requirements by following client defined\r\nRequired Skills: A minimum of bachelor's degree in computer science or equivalent.\r\nMust have strong problem-solving and analytical skills\r\nMust have the ability to identify complex problems and review related information to develop and evaluate options and implement solutions.\r\nJ-18808-Ljbffr","datePosted":"2026-07-16T01:29:31.321Z","dateModified":"2026-07-16T01:29:31.321Z","hiringOrganization":{"@type":"Organization","name":"Hs Technologies Defunct","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"McLean","addressRegion":"VA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"0bca5fb3c228daa9796ef6f5"},"url":"https://jobsearcher.com/jobs/0bca5fb3c228daa9796ef6f5"}}