Senior Data Engineer (Azure Data Factory Databricks, PostgreSQL, Python)
Senior Data Engineer (PostgreSQL, Python, Azure) Location : Reston VA (on-site 9-10 days a month) Salary: Open and will be commensurate with experience. NOTE: This is a full time position and this person must be a Green Card Holder or be a US Citizen of the United States, as per the company, due to government compliance. Must have the following: Azure Data Factory, Databricks, Python, SQL, ETL/ELT pipelines, Data Lake, Spark, Data Engineering, Cloud Data Platforms, CI/CDResponsibilities:Design, build, and maintain scalable production data pipelines supporting enterprise data platformsPerform exploratory data analysis, statistical analysis, and data validation to support analytics and reportingDevelop and optimize ETL/ELT workflows including job design, orchestration, and performance tuningBuild and maintain relational database schemas, queries, and stored proceduresWork within Azure-based data environments including Data Factory, Databricks, and Data Lake StorageCollaborate with analytics, BI, and engineering teams to deliver reliable data productsImplement monitoring, logging, and observability for data pipelinesMaintain documentation, data lineage, and governance standardsParticipate in architecture discussions and contribute to long-term data platform strategyRequirements:Bachelor's degree in Computer Science, Statistics, Mathematics, Information Science, Data Engineering, Finance, or related field (Master's preferred)5+ years of data engineering experience working with production data pipelines5+ years of applied data analysis and statistical data work3+ years of ETL / ELT development experience3+ years working with relational databases and performance tuningExperience with Azure data services (Data Factory, Databricks, Data Lake, Synapse, Delta Lake, or similar)Strong programming experience with Python, PySpark, SQL, and BashExperience with Kafka, SAP data services, or similar integration tools preferredExperience with PostgreSQL, SAP ASE, or comparable databasesExperience with Power BI or BusinessObjects is a plusExperience with CI/CD pipelines, Git, Kubernetes, and infrastructure-as-codeKnowledge of data governance, cataloging, and access controlExperience with monitoring tools such as Datadog, Grafana, or PrometheusAbility to work independently while managing multiple prioritiesStrong communication and documentation skillsMust be eligible to work in the United States INDH Senior Data Engineer, Azure Data Factory, Databricks, Python, SQL, ETL, ELT, Data Pipelines, Data Lake, Spark, Delta Lake, Azure Synapse, Cloud Data Platform, Data Engineering, Big Data, Kafka, PostgreSQL, SAP Data Services, Power BI, CI/CD, Kubernetes, Data Governance, Data Lineage, Analytics Engineering, Data Integration, Financial Data, Enterprise Data, Data Architecture, BI Reporting, PySpark, Bash, Cloud Engineering, Data Warehouse, Data Modeling, Observability, Grafana, Prometheus, Datadog, Azure Cloud, Data Platform Engineer, Statistical Analysis