JOBSEARCHER

Big Data Developer

Hiring: Data Engineer/ Big Data Developer
Location: Chantilly, VA (100% Onsite)
Employment Type: Full-Time
Security Clearance: Active CI Polygraph Required
Working Hours: 9:00 AM – 3:00 PM EST
Bonus: Performance-Based
Job Summary: We are seeking an experienced Data Engineer with 10+ years of software development/programming experience to design, develop, and optimize large-scale data ingestion, ETL, data transformation, and processing solutions in a Big Data environment. Key Responsibilities & Required Skills: Design and optimize large-scale data ingestion, ETL, data extraction, cleansing, transformation, and data loading pipelines. Strong programming experience in Python and/or Java, with advanced SQL and database knowledge. Hands-on experience with Python technologies, including environment management, asynchronous development, FastAPI, and REST APIs. Experience with Big Data environments and the complete data lifecycle, from data ingestion to visualization. Strong experience with Apache Airflow, ETL development, and Linux-based environments. Develop data profiling, deduplication, matching logic, and custom data integration solutions. Leverage Big Data for AI/ML-based analytics and collaborate with Data Scientists to support AI/ML workflows. Maintain data layer documentation and perform basic Linux server administration.
Preferred Skills: Experience deploying AI/ML-enabled solutions. Experience creating and publishing BI dashboards. Minimum Qualification: High School Diploma/GED with 10+ years of relevant software development experience