Senior Data Engineer

Salary Range: $120,000.00 To $140,000.00 AnnuallyFull Time Professional Remote Salary Range: $120,000.00 To $140,000.00 Annually Job Title:Senior Data Engineer Clearance Requirement:Active DoD Secret Clearance required Location:Remote / PentagonPosition Overview The Senior Data Engineer is a hybrid role combining Data Analyst, Data Engineer, and Data Scientist responsibilities. This position operates with a high level of autonomy, owning projects end-to-end across functional areas. The ideal candidate is proactive, solution-oriented, and capable of identifying opportunities, reducing complexity, and delivering efficient, high-quality data solutions.This role also provides guidance to team members, helps remove roadblocks, and contributes to the continuous improvement of processes, systems, and deliverables.Key Responsibilities Data Analysis & InsightsGather, clean, and analyze complex datasets using advanced analytical techniquesApply statistical methods to identify trends, patterns, and anomaliesConduct exploratory data analysis (EDA) to support decision-makingTranslate data findings into actionable insights for technical and non-technical stakeholdersDesign, develop, and maintain ETL/ELT pipelines using Databricks and Delta LakeImplement Medallion Architecture (Bronze, Silver, Gold) to ensure data quality and scalabilityManage data ingestion processes with a focus on traceability and governance (e.g., Collibra)Build and maintain data pipelines within DoD environments such as Advana/JupiterTroubleshoot, debug, and optimize data pipelines, identifying root causes and implementing solutionsDevelop dashboards, reports, and visualizations using tools such as Tableau, Power BI, Qlik, or FoundryCreate interactive dashboards and reports to support operational and strategic decisionsEnsure accuracy, quality, and usability of all data visualizations and deliverablesIntegration & System SupportCollaborate with data engineers, analysts, scientists, and stakeholders to deliver integrated data solutionsSupport real-time data streaming using Databricks Structured StreamingOptimize data storage solutions leveraging Delta Lake capabilities (e.g., schema evolution, time travel)Governance & ComplianceMaintain data lineage and governance using tools such as CollibraEnsure compliance with data security, privacy, and DoD requirementsEstablish and enforce data quality standards across multiple data sourcesWork closely with cross-functional teams to gather and refine requirementsCommunicate findings, recommendations, and metrics clearly and professionallyTrack assigned tasks and provide regular updates to leadershipMentor junior team members and support team development initiativesRequired QualificationsBachelor’s degree in Data Science, Computer Science, Statistics, Engineering, or a related field5+ years of experience in data engineering and building data pipelines and architectures5+ years of experience in data analysis, data mining, or business intelligence3+ years of experience developing data solutions using Python, SQL, and/or PySpark in big data environments (e.g., Databricks, Snowflake)Strong experience with data visualization tools (Tableau, Power BI, Qlik, Foundry) and advanced Excel (macros, pivot tables, VBA)Experience with cloud platforms such as AWS, Azure, or Google CloudFamiliarity with big data frameworks (Hadoop, Spark, Kafka)Strong understanding of ETL processes, data warehousing, and BI best practicesProven ability to analyze large datasets and communicate insights effectivelyStrong problem-solving skills and attention to detailPreferred QualificationsMaster’s degree in Data Engineering, Computer Science, or related fieldExperience with DoD data platforms such as Advana and JupiterFamiliarity with statistical methods (e.g., hypothesis testing, regression analysis)Experience with SAP, Foundry, or advanced analytics platformsExperience with NoSQL databases (e.g., Cassandra, MongoDB)Knowledge of containerization tools (Docker, Kubernetes)Experience with version control systems (Git) and Agile methodologies (Scrum, Kanban)Prior experience in a client-facing government environmentEqual Employment Opportunity Statement ShadowObjects, LLC is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, and gender identity), national origin, age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable federal, state, or local law.#J-18808-Ljbffr