{"schemaVersion":"jobsearcher.job.v1","id":"77d37e0d36d7273a631c9d78","url":"https://jobsearcher.com/jobs/77d37e0d36d7273a631c9d78","canonicalUrl":"https://jobsearcher.com/jobs/77d37e0d36d7273a631c9d78","title":"Senior Big Data Engineer (Java, Kafka, Spark, ETL)","description":"Senior Big Data Engineer (Java, Kafka, Spark, ETL)\nLocation: Ashburn, VA (Hybrid/Remote)\nEmployment Type: Full-Time\nCitizenship: U.S. Citizenship Required\nClearance: Ability to obtain and maintain a CBP Background Investigation (BI)\nAbout the Opportunity\nSDA is seeking a Senior Big Data Engineer / Java Data Integration Engineer to support the development and modernization of enterprise data ingestion, integration, search, and analytics platforms. This role is responsible for building scalable solutions that collect, normalize, enrich, transform, and distribute large volumes of data across enterprise systems, analytics platforms, and operational environments.\nThe ideal candidate combines strong Java development and data integration expertise with hands-on experience building modern Big Data solutions using technologies such as Kafka, Spark, Elasticsearch, and cloud-based platforms. This position is ideal for engineers who enjoy solving complex data challenges and working across the full data lifecycle—from ingestion and transformation to search, analytics, and operational support.\nCore Technologies\nJava | Kafka | Spark | Elasticsearch | Oracle | SQL | ETL | Data Integration | Data Mapping | REST APIs | MongoDB | AWS | Linux\nWhat You'll Do\nDesign, develop, and maintain enterprise data ingestion, ETL, and data transformation solutions supporting both batch and real-time processing.\nBuild and support scalable Kafka-based streaming architectures for processing and distributing high-volume data.\nDevelop Java-based applications and services supporting enterprise data integration and transformation workflows.\nCreate Spark and Spark Streaming solutions to process, enrich, and analyze large datasets.\nDesign and support enterprise search capabilities using Elasticsearch to enable data discovery, investigative workflows, analytics, and operational decision-making.\nAnalyze source and target data structures and develop source-to-target mapping specifications.\nIntegrate data from multiple structured and semi-structured sources while ensuring data integrity, consistency, traceability, and performance.\nDevelop REST APIs and system integration services that enable data exchange across enterprise platforms.\nSupport data migration, modernization, and cloud transformation initiatives.\nPerform data validation, reconciliation, profiling, and quality assurance activities.\nImplement and support data quality, governance, lineage, and validation processes across ingestion and transformation pipelines.\nOptimize SQL queries, database processes, and distributed data pipelines.\nTroubleshoot production issues and improve platform reliability, scalability, and performance.\nCollaborate with architects, developers, analysts, and stakeholders to design and implement technical solutions.\nSupport onboarding efforts for data consumers and integration partners.\nEvaluate emerging technologies and develop proof-of-concept solutions.\nMentor junior engineers and contribute to technical leadership initiatives.\nRequired Qualifications\nU.S. Citizen.\nBachelor's degree in Computer Science, Information Systems, Engineering, or related field (or equivalent experience).\n5-10+ years of experience in Data Engineering, Software Engineering, ETL Development, or Enterprise Data Integration.\nStrong hands-on Java development experience.\nExperience designing and implementing ETL and data integration solutions.\nExperience building and supporting Apache Kafka producers, consumers, and streaming applications.\nExperience developing applications using Apache Spark and/or Spark Streaming.\nStrong SQL and relational database experience, including Oracle.\nExperience creating and maintaining source-to-target data mappings.\nExperience with data transformation, data migration, and data validation activities.\nExperience developing REST APIs and integration services.\nExperience working with XML, JSON, CSV, and other structured or semi-structured data formats.\nExperience supporting Linux/Unix environments.\nStrong analytical, troubleshooting, and problem-solving skills.\nPreferred Qualifications\nExperience with Elasticsearch and enterprise search platforms.\nExperience with Hadoop ecosystem technologies.\nExperience with Scala development.\nExperience with MongoDB, DocumentDB, HBase, Delta Lake, Redshift, or other Big Data technologies.\nExperience with ETL tools such as Apache NiFi, AWS Glue, Talend, Informatica, Pentaho, or SSIS.\nExperience with event-driven architectures and enterprise messaging technologies.\nExperience with Docker and Kubernetes.\nExperience supporting AWS, Azure, or Google Cloud Platform environments.\nExperience supporting enterprise data migration or modernization initiatives.\nExperience working in Agile software development environments.\nExperience supporting large-scale analytics, risk assessment, investigative, intelligence, law enforcement, or operational decision-support systems.\nTechnologies You'll Work With\nProgramming & Development\nJava\nScala\nSQL\nSpring Framework\nSpring Boot\nREST APIs\nData Integration & ETL\nETL Development\nData Mapping & Transformation\nData Migration\nApache NiFi\nAWS Glue\nInformatica\nTalend\nBig Data & Streaming\nApache Kafka\nApache Spark\nSpark Streaming\nHadoop\nHBase\nDelta Lake\nSearch & Analytics\nElasticsearch\nDatabases\nOracle\nPostgreSQL\nMongoDB\nDocumentDB\nRedshift\nRelational & NoSQL Databases\nCloud & DevOps\nAWS\nAzure\nGoogle Cloud Platform\nDocker\nKubernetes\nCI/CD Pipelines\nWhy Join SDA?\nWork with modern Big Data, cloud, and enterprise integration technologies.\nDesign and build large-scale data platforms supporting mission-critical operations.\nCollaborate with highly skilled engineers, architects, and data professionals.\nInfluence technical direction and solution architecture.\nCompetitive compensation and benefits package.\nFlexible hybrid work environment.\nOpportunities for professional growth and technical leadership.\nIf you're passionate about building scalable data platforms, solving complex integration challenges, and working with modern Big Data technologies, we'd love to hear from you.\nAbout SDA\nSystems Development and Analysis, Inc. (SDA) has decades of success making system concepts an operational reality for agencies on the front lines of homeland security, law enforcement and national defense.\nWe are focused on our clients’ missions and hold ourselves accountable for their operational success. We operate with independence and integrity so that we can provide unfettered advice. By understanding and appreciating their world, we earn the trust to innovate and apply leading edge technology on behalf of our clients.\nSDA is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. SDA is also committed to compliance with all fair employment practices regarding citizenship and immigration status.\nDesigns and builds software services and integrations; mentors developers.","company":"Systems Development Analysis","rawCompany":"systems development analysis","city":"Arlington","state":"VA","isRemote":false,"isActive":false,"createdAt":"2026-06-17T03:57:31.647Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Big Data Engineer (Java, Kafka, Spark, ETL)","description":"Senior Big Data Engineer (Java, Kafka, Spark, ETL)\nLocation: Ashburn, VA (Hybrid/Remote)\nEmployment Type: Full-Time\nCitizenship: U.S. Citizenship Required\nClearance: Ability to obtain and maintain a CBP Background Investigation (BI)\nAbout the Opportunity\nSDA is seeking a Senior Big Data Engineer / Java Data Integration Engineer to support the development and modernization of enterprise data ingestion, integration, search, and analytics platforms. This role is responsible for building scalable solutions that collect, normalize, enrich, transform, and distribute large volumes of data across enterprise systems, analytics platforms, and operational environments.\nThe ideal candidate combines strong Java development and data integration expertise with hands-on experience building modern Big Data solutions using technologies such as Kafka, Spark, Elasticsearch, and cloud-based platforms. This position is ideal for engineers who enjoy solving complex data challenges and working across the full data lifecycle—from ingestion and transformation to search, analytics, and operational support.\nCore Technologies\nJava | Kafka | Spark | Elasticsearch | Oracle | SQL | ETL | Data Integration | Data Mapping | REST APIs | MongoDB | AWS | Linux\nWhat You'll Do\nDesign, develop, and maintain enterprise data ingestion, ETL, and data transformation solutions supporting both batch and real-time processing.\nBuild and support scalable Kafka-based streaming architectures for processing and distributing high-volume data.\nDevelop Java-based applications and services supporting enterprise data integration and transformation workflows.\nCreate Spark and Spark Streaming solutions to process, enrich, and analyze large datasets.\nDesign and support enterprise search capabilities using Elasticsearch to enable data discovery, investigative workflows, analytics, and operational decision-making.\nAnalyze source and target data structures and develop source-to-target mapping specifications.\nIntegrate data from multiple structured and semi-structured sources while ensuring data integrity, consistency, traceability, and performance.\nDevelop REST APIs and system integration services that enable data exchange across enterprise platforms.\nSupport data migration, modernization, and cloud transformation initiatives.\nPerform data validation, reconciliation, profiling, and quality assurance activities.\nImplement and support data quality, governance, lineage, and validation processes across ingestion and transformation pipelines.\nOptimize SQL queries, database processes, and distributed data pipelines.\nTroubleshoot production issues and improve platform reliability, scalability, and performance.\nCollaborate with architects, developers, analysts, and stakeholders to design and implement technical solutions.\nSupport onboarding efforts for data consumers and integration partners.\nEvaluate emerging technologies and develop proof-of-concept solutions.\nMentor junior engineers and contribute to technical leadership initiatives.\nRequired Qualifications\nU.S. Citizen.\nBachelor's degree in Computer Science, Information Systems, Engineering, or related field (or equivalent experience).\n5-10+ years of experience in Data Engineering, Software Engineering, ETL Development, or Enterprise Data Integration.\nStrong hands-on Java development experience.\nExperience designing and implementing ETL and data integration solutions.\nExperience building and supporting Apache Kafka producers, consumers, and streaming applications.\nExperience developing applications using Apache Spark and/or Spark Streaming.\nStrong SQL and relational database experience, including Oracle.\nExperience creating and maintaining source-to-target data mappings.\nExperience with data transformation, data migration, and data validation activities.\nExperience developing REST APIs and integration services.\nExperience working with XML, JSON, CSV, and other structured or semi-structured data formats.\nExperience supporting Linux/Unix environments.\nStrong analytical, troubleshooting, and problem-solving skills.\nPreferred Qualifications\nExperience with Elasticsearch and enterprise search platforms.\nExperience with Hadoop ecosystem technologies.\nExperience with Scala development.\nExperience with MongoDB, DocumentDB, HBase, Delta Lake, Redshift, or other Big Data technologies.\nExperience with ETL tools such as Apache NiFi, AWS Glue, Talend, Informatica, Pentaho, or SSIS.\nExperience with event-driven architectures and enterprise messaging technologies.\nExperience with Docker and Kubernetes.\nExperience supporting AWS, Azure, or Google Cloud Platform environments.\nExperience supporting enterprise data migration or modernization initiatives.\nExperience working in Agile software development environments.\nExperience supporting large-scale analytics, risk assessment, investigative, intelligence, law enforcement, or operational decision-support systems.\nTechnologies You'll Work With\nProgramming & Development\nJava\nScala\nSQL\nSpring Framework\nSpring Boot\nREST APIs\nData Integration & ETL\nETL Development\nData Mapping & Transformation\nData Migration\nApache NiFi\nAWS Glue\nInformatica\nTalend\nBig Data & Streaming\nApache Kafka\nApache Spark\nSpark Streaming\nHadoop\nHBase\nDelta Lake\nSearch & Analytics\nElasticsearch\nDatabases\nOracle\nPostgreSQL\nMongoDB\nDocumentDB\nRedshift\nRelational & NoSQL Databases\nCloud & DevOps\nAWS\nAzure\nGoogle Cloud Platform\nDocker\nKubernetes\nCI/CD Pipelines\nWhy Join SDA?\nWork with modern Big Data, cloud, and enterprise integration technologies.\nDesign and build large-scale data platforms supporting mission-critical operations.\nCollaborate with highly skilled engineers, architects, and data professionals.\nInfluence technical direction and solution architecture.\nCompetitive compensation and benefits package.\nFlexible hybrid work environment.\nOpportunities for professional growth and technical leadership.\nIf you're passionate about building scalable data platforms, solving complex integration challenges, and working with modern Big Data technologies, we'd love to hear from you.\nAbout SDA\nSystems Development and Analysis, Inc. (SDA) has decades of success making system concepts an operational reality for agencies on the front lines of homeland security, law enforcement and national defense.\nWe are focused on our clients’ missions and hold ourselves accountable for their operational success. We operate with independence and integrity so that we can provide unfettered advice. By understanding and appreciating their world, we earn the trust to innovate and apply leading edge technology on behalf of our clients.\nSDA is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. SDA is also committed to compliance with all fair employment practices regarding citizenship and immigration status.\nDesigns and builds software services and integrations; mentors developers.","datePosted":"2026-06-17T03:57:31.647Z","dateModified":"2026-06-17T03:57:31.647Z","hiringOrganization":{"@type":"Organization","name":"Systems Development Analysis","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Arlington","addressRegion":"VA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"77d37e0d36d7273a631c9d78"},"url":"https://jobsearcher.com/jobs/77d37e0d36d7273a631c9d78"}}