Senior Data Engineer (Databricks / PySpark)

Location: Washington, DC Metro Area / Northern VirginiaWork Schedule: Hybrid; candidates should be available to support onsite in the DC Metro Area 2–3 days per week or on an as-needed basisClearance: Active DoD Secret clearance required; Top Secret / SCI eligibility preferredCitizenship: U.S. Citizenship requiredPosition OverviewIntelliTech is seeking a Senior Data Engineer to support a large-scale DoD data platform and analytics environment. In this role, you will design, build, maintain, and optimize scalable data pipelines and data products that enable mission-critical analytics, reporting, and downstream data use cases in a complex enterprise setting.The ideal candidate brings strong hands-on experience with Databricks, PySpark, Python, SQL, and cloud-based data engineering, along with a proven ability to work across large data environments, integrate disparate data sources, and deliver reliable, secure, and high-performing data solutions.Key ResponsibilitiesDesign, develop, and maintain scalable batch and streaming data pipelines supporting enterprise analytics and data operationsBuild and optimize Databricks and PySpark workflows for ingestion, transformation, validation, and processing of large datasetsDevelop robust ETL/ELT solutions across structured and unstructured data sources, including APIs, relational databases, NoSQL databases, and cloud storageSupport data modeling, pipeline orchestration, data quality, lineage, and performance tuning across the data lifecycleImplement and maintain cloud-native data engineering solutions in environments such as AWS, Azure, or GCPCollaborate with engineers, analysts, data scientists, and other stakeholders to support reporting, analytics, and AI/ML data preparation workflowsIntegrate data pipelines into DevSecOps / CI/CD workflows and support secure, repeatable deployment practicesTroubleshoot pipeline failures, improve observability, and optimize the performance and reliability of enterprise data servicesContribute to technical documentation, engineering standards, and best practices for enterprise-scale data developmentOperate effectively within Agile / SAFe delivery environments supporting mission systemsRequired QualificationsActive DoD Secret clearanceBachelor’s degree in Computer Science, Data Science, Engineering, Information Systems, or a related technical discipline, and 8+ years of relevant experience; or Master’s degree in a related field and 6+ years of relevant experienceStrong hands-on experience designing, building, and maintaining production-grade data pipelines and integration solutionsStrong experience with Databricks, Apache Spark, and PySpark in enterprise data environmentsStrong programming skills in Python and SQL; experience with Java or similar languages is a plusExperience implementing ETL/ELT pipelines and data integration processes across multiple sources and platformsExperience with relational and non-relational databases, data modeling, and query optimizationExperience working in cloud-based data environments such as AWS, Azure, or GCPExperience with source control, CI/CD pipelines, and modern software engineering practicesAbility to identify and resolve issues related to data quality, pipeline performance, and operational reliabilityStrong communication and collaboration skills, with the ability to work effectively across technical and non-technical teamsPreferred QualificationsActive Top Secret clearance with SCI eligibilityExperience supporting enterprise data platforms in DoD or other federal environmentsExperience with data governance, metadata management, lineage, and access control conceptsExperience supporting AI/ML data preparation and feature engineering workflowsExperience with Airflow, Kafka, Docker, Kubernetes, or related orchestration and containerization technologiesExperience supporting data engineering solutions in secure or multi-environment enterprise settingsRelevant cloud or data engineering certificationsInterview ProcessVideo interview required and may include a technical assessmentCandidates should be prepared to clearly discuss:their hands-on experience with Databricks, PySpark, Python, and SQLexamples of pipelines or data applications they have built from the ground uplarge-scale data challenges they have solvedtheir experience with cloud, ETL/ELT, and enterprise data engineering best practicesWork Authorization / Clearance SponsorshipAt this time, IntelliTech will only consider candidates who currently possess an active Secret clearance or higher. Clearance sponsorship is not available for this role.Compensation And BenefitsIntelliTech is committed to fair and equitable compensation practices. The annual salary range for this position is $140,000 to $225,000, and actual compensation will be based on a variety of factors unique to each candidate, including job-related skills, relevant experience, certifications, training, and level of seniority. IntelliTech uses the full breadth of the salary range in making compensation decisions.IntelliTech also offers a comprehensive benefits package designed to support our employees’ well-being and professional growth, including health, dental, and vision insurance, a 401(k) plan, paid time off, professional development opportunities, and flexible work arrangements that promote work-life balance.About IntelliTechIntelliTech is a dynamic and forward-thinking small business specializing in Full Stack Engineering, Data Analytics, Cloud Solutions, and DevSecOps services. We support government and commercial clients in solving complex technical challenges through practical, mission-focused engineering and delivery excellence.Equal Opportunity EmployerIntelliTech is an Equal Opportunity Employer and is committed to fostering a diverse and inclusive workplace. We encourage all qualified candidates to apply.Powered by JazzHRaTSwV632Sv