{"schemaVersion":"jobsearcher.job.v1","id":"2dcaf6cd8f8498f618ec27ae","url":"https://jobsearcher.com/jobs/2dcaf6cd8f8498f618ec27ae","canonicalUrl":"https://jobsearcher.com/jobs/2dcaf6cd8f8498f618ec27ae","title":"Bigdata/Spark Engineer","description":"Job Description\nUnderstand Platform of Client and perform Platform Design, Development, support and maintenance of client involving various services of Bigdata such as Hadoop, HDFS, MapReduce, Yarn, Hive, HBase etc.\nProvide support and leadership from projects definition to project closure, including interpreting business requirements and drafting them into technical specifications\nDesign and development of frameworks for data ingestion, transformation and reporting services.\nprocesses and methodologies.\nDesign and Maintain the Oozie tool to automate the production jobs of Platform.\nDesign and develop data analytics products using big data technologies such as Hadoop, Spark, Kafka, Hive.\nResponsible to code medium and complex applications to deploy into Hadoop and Spark clusters of Platform.\nResponsible for data ingestion from multiple data sources, maintaining and scaling the big data platform infrastructure that supports client’s business use cases.\nResponsible to implement the solutions in Object oriented and functional languages such as Java, Scala and Python with best design patterns and data structures.\nIdentify and recommend new ways to streamline the data centric applications and optimize the performance.\nInvolve in migration of the clusters to AWS cloud.\nLoad the data assets subscription model data flow with the help of Hortonworks NIFi\nDeliver and deploy applications in Cloud environment.\nData consumption patterns by integrating EDP with BI tools such as Tableau etc.\nAutomation & job scheduling using Oozie & Unix Shell Scripts\nDesign and Implement Real-time/Near-Realtime data streaming patterns using Kafka & Spark-Streaming.\nIntegrate Customer Master C360 with Platform.\nTroubleshooting and resolving software issues occurring in the development of the process and documenting test cases to ensure quality.\nSupport Bigdata services of EIM Platform that support architecture and engineering frameworks such as Batch ingestion and processing patterns using Hive, Pig, MapReduce & Spark\nDocument the functional and technical requirements by following client defined\nRequired Skills:\nA minimum of bachelor's degree in computer science or equivalent.\nCloudrea Hadoop(CDH), Cloudera Manager, Informatica Bigdata Edition(BDM), HDFS, Yarn, MapReduce, Hive, Impala, KUDU, Sqoop, Spark, Kafka, HBase, Teradata Studio Express, Teradata, Tableau, Kerberos, Active Directory, Sentry, TLS/SSL, Linux/RHEL, Unix Windows, SBT, Maven, Jenkins, Oracle, MS SQL Server, Shell Scripting, Eclipse IDE, Git, SVN\nMust have strong problem-solving and analytical skills\nMust have the ability to identify complex problems and review related information to develop and evaluate options and implement solutions.\nIf you are interested in working in a fast-paced, challenging, fun, entrepreneurial environment and would like to have the opportunity of being a part of this fascinating industry, Send resumes. to HSTechnologies LLC, 2801 W Parker Road, Suite #5 Plano, TX - 75023 or email your resume to hr@sbhstech.com.","company":"Hstechnologies","rawCompany":"hstechnologies","city":"McLean","state":"VA","isRemote":false,"isActive":false,"createdAt":"2026-08-04T13:44:19.566Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Bigdata/Spark Engineer","description":"Job Description\nUnderstand Platform of Client and perform Platform Design, Development, support and maintenance of client involving various services of Bigdata such as Hadoop, HDFS, MapReduce, Yarn, Hive, HBase etc.\nProvide support and leadership from projects definition to project closure, including interpreting business requirements and drafting them into technical specifications\nDesign and development of frameworks for data ingestion, transformation and reporting services.\nprocesses and methodologies.\nDesign and Maintain the Oozie tool to automate the production jobs of Platform.\nDesign and develop data analytics products using big data technologies such as Hadoop, Spark, Kafka, Hive.\nResponsible to code medium and complex applications to deploy into Hadoop and Spark clusters of Platform.\nResponsible for data ingestion from multiple data sources, maintaining and scaling the big data platform infrastructure that supports client’s business use cases.\nResponsible to implement the solutions in Object oriented and functional languages such as Java, Scala and Python with best design patterns and data structures.\nIdentify and recommend new ways to streamline the data centric applications and optimize the performance.\nInvolve in migration of the clusters to AWS cloud.\nLoad the data assets subscription model data flow with the help of Hortonworks NIFi\nDeliver and deploy applications in Cloud environment.\nData consumption patterns by integrating EDP with BI tools such as Tableau etc.\nAutomation & job scheduling using Oozie & Unix Shell Scripts\nDesign and Implement Real-time/Near-Realtime data streaming patterns using Kafka & Spark-Streaming.\nIntegrate Customer Master C360 with Platform.\nTroubleshooting and resolving software issues occurring in the development of the process and documenting test cases to ensure quality.\nSupport Bigdata services of EIM Platform that support architecture and engineering frameworks such as Batch ingestion and processing patterns using Hive, Pig, MapReduce & Spark\nDocument the functional and technical requirements by following client defined\nRequired Skills:\nA minimum of bachelor's degree in computer science or equivalent.\nCloudrea Hadoop(CDH), Cloudera Manager, Informatica Bigdata Edition(BDM), HDFS, Yarn, MapReduce, Hive, Impala, KUDU, Sqoop, Spark, Kafka, HBase, Teradata Studio Express, Teradata, Tableau, Kerberos, Active Directory, Sentry, TLS/SSL, Linux/RHEL, Unix Windows, SBT, Maven, Jenkins, Oracle, MS SQL Server, Shell Scripting, Eclipse IDE, Git, SVN\nMust have strong problem-solving and analytical skills\nMust have the ability to identify complex problems and review related information to develop and evaluate options and implement solutions.\nIf you are interested in working in a fast-paced, challenging, fun, entrepreneurial environment and would like to have the opportunity of being a part of this fascinating industry, Send resumes. to HSTechnologies LLC, 2801 W Parker Road, Suite #5 Plano, TX - 75023 or email your resume to hr@sbhstech.com.","datePosted":"2026-08-04T13:44:19.566Z","dateModified":"2026-08-04T13:44:19.566Z","hiringOrganization":{"@type":"Organization","name":"Hstechnologies","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"McLean","addressRegion":"VA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"2dcaf6cd8f8498f618ec27ae"},"url":"https://jobsearcher.com/jobs/2dcaf6cd8f8498f618ec27ae"}}