4417 ETL Engineer
4417 ETL Engineer4417 | Top SecretJob Description:OVERVIEW:We are seeking a highly skilled Senior-level ETL Engineer to join our team delivering engineering tasks to advanced analytic applications across classified environments. You will develop sophisticated data pipelines and ETL processes for desktop and web-based analytic software, facilitate the bulk analysis of relational information, and enable applications that deliver data from diverse data sources.GENERAL DUTIES:Design and implement complex data pipelines and ETL processes to support cyber investigative capabilities across multi-classification domainsArchitect and develop ETL workflows for highly sensitive data in classified environmentsSupport IC Data Services requirements by integrating various intelligence data sources and systemsDevelop and maintain data analytics solutions for desktop and web-based visual analytic applicationsEstablish applications that produce manageable, actionable intelligence from streams of structured and semi-structured dataDesign strategies for enterprise database systems and set standards for operations, programming, and securityConstruct and optimize large relational databases across multi-enclave environments (Unclassified, Secret, and Top Secret)Tune performance of large-scale data workflows, ensuring cost efficiency, low latency, and high availabilityDesign and manage Elasticsearch/Opensearch clusters for fast search, indexing, and retrieval of large-scale datasetsIntegrate new systems with existing warehouse structures and refine system performance and functionalityImplement CI/CD pipelines for data systems, automate monitoring/alerting, and enforce infrastructure-as-code practicesProvide technical leadership and mentorship to other team membersParticipate in Program Increments (PIs) and Agile Release Train (ART) activitiesREQUIRED QUALIFICATIONS:Bachelor's degree in Computer Science, Data Science, Engineering, or related fieldMinimum of 10 years of experience in data engineering or related fieldExperience with Agile methodologiesUnderstanding of data warehousing and business intelligence conceptData analysis, query, aggregation, and visualization techniquesETL processes and data transformationSQL and database technologies (MySQL, PostgreSQL, Microsoft SQL)Software development fundamentalsData management and big data technologiesVersion control systems (Git)Python for data processing, automation and ETL workflow orchestrationElasticsearch or Opensearch (design, scaling, query optimization, cluster management)Data pipeline technologies (Apache Nifi, Cribl)Cross-domain ETL solutions for secure data transfer between classification levelsCloud platforms (AWS GovCloud, SC2S, C2S)May require occasional travel for Program Increment planning sessionsMay require flexible scheduling to support critical operationsDESIRED QUALIFICATIONS:Containerization and orchestration technologies (Docker, Kubernetes)GraphQL: schema design, API development, and query optimizationDevSecOps practices and tools in classified environmentsExperience with RabbitMQ and RedisKnowledge of IC specific data formats, schemas and transfer protocolsPrior work integrating intelligence data across multiple enclavesCloud certificationCLEARANCE:Active Top Secret clearance minimumJob DetailsCity : ChantillyState : Virginia