Principal ETL Developer
Job SummaryLeidos seeks an experienced Principal ETL Developer to lead the design, development, implementation, and testing of data flow solutions centered around Apache NiFi. The role focuses on delivering robust, scalable, and secure ETL pipelines for customer data lake ingestion and processing. The position is hybrid, requiring periodic commutes to Bethesda, MD for team meetings.Key requirements include a TS/SCI clearance with Poly, U.S. citizenship, and willingness to pursue additional clearances.Primary ResponsibilitiesArchitect complex NiFi data pipeline designs and develop enterprise-level ETL architectures for large-scale data ingestion, transformation, and processing.Optimize NiFi data flows through processor tuning, memory management, and load balancing for optimal batch and real-time performance.Diagnose and resolve complex NiFi data flow issues, including performance bottlenecks and integration failures.Integrate NiFi with databases, big data ecosystems, and cloud platforms such as AWS, OCI, Azure, Kafka, Elasticsearch, S3, SQS/SNS.Define best practices, standards, and governance for NiFi development, deployment, security, and overarching data management policies.Create and maintain comprehensive documentation for NiFi data flows, mapping, architecture, and standard operating procedures to facilitate knowledge transfer.Collaborate with data architects, engineers, and stakeholders to translate business requirements into robust technical solutions and effectively communicate complex concepts.Mentor junior developers, conduct code reviews, and foster a collaborative learning environment.Basic QualificationsIn-depth experience building NiFi data flow solutions in large-scale enterprise environments.Expertise in NiFi architecture, processors, clustering, NiFi Registry, and high-availability configurations.Proficiency in Java and Python for custom NiFi processors and automation scripting.Strong skills in writing and optimizing complex queries and managing relational and NoSQL databases (e.g., PostgreSQL, Elasticsearch, DynamoDB).Experience with real-time streaming, REST API integration, and cloud data services (AWS, Azure, OCI).Ability to analyze complex data challenges, root-cause identify, and implement effective solutions.Excellent collaboration, communication, and mentorship capabilities.Bachelor's degree with 12+ years of relevant experience or Master's degree with 10+ years of relevant experience.Preferred QualificationsExperience deploying ETL solutions in an AWS environment.Commitment to Non-DiscriminationAll qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, disability, medical condition, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law. Leidos will also consider applicants with criminal histories consistent with relevant laws.J-18808-Ljbffr