Data Engineer
We’re working with a global technology leader serving government and commercial customers with smarter, more efficient digital and mission innovations. This is an opportunity to contribute to critical projects within a fast-paced and impactful environment.The Role Design, build, and maintain scalable, reliable data systems and pipelines for ingestion, processing, and transformation of large, complex, and disparate data sources. Unify and integrate data from multiple network operations systems, ensuring data quality, accuracy, security, and compliance with DoD and DISA requirements. Implement solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift, including creating Kafka, Elastic, and Logstash pipelines. Develop and manage data warehouses and data lakes, optimizing infrastructure for performance, scalability, and cost-effectiveness through automation. Automate data-related tasks such as ETL/ELT processes, data validation, cleansing, and monitoring, supporting CI/CD pipelines. Collaborate with data analysts, visualization engineers, and other stakeholders to deliver integrated, actionable data solutions.What You'll Need Bachelor’s degree in Computer Science, Engineering, or a related technical discipline and 4+ years of relevant experience. Hands-on experience designing, building, and maintaining data pipelines (ETL/ELT) and integrating multiple, disparate data sources. Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar). Proficiency with data engineering tools and languages such as Python, Java, SQL, and shell scripting. Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing. Ability to obtain interim Secret DoD Security clearance prior to start date and Security+ certification within 14 days of start date.What's On Offer The opportunity to work on mission-critical projects for a leading government contractor. A collaborative and fast-paced Agile development environment. Exposure to cutting-edge technologies like Elastic Stack, Confluent Kafka, AWS, and OpenShift. Comprehensive benefits package and competitive salary.Apply via Haystack today!