Azure Databricks/Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
*Jon Title: *Senior Data Engineer
*Location:* Memphis, TN – Remote
*Job Type:* Contract
*Experience:* 15+ Years
*Job Summary*
We are seeking an experienced *Senior Data Engineer* with strong expertise in *Azure Databricks, Spark, Python, SQL, and Azure data services* to design and develop scalable cloud-based data solutions for healthcare analytics.
*Key Responsibilities*
- Design, develop, and maintain scalable ETL/ELT pipelines using *Azure Databricks, PySpark, Azure Synapse, and Azure Data Factory*.
- Process and integrate both structured and unstructured healthcare data, including *EHR, claims, and related data sources*.
- Build and optimize data solutions using *Delta Lake, Azure Data Lake, Azure SQL, Databricks, and Synapse Analytics*.
- Implement modern *Lakehouse Architecture* and data warehousing solutions for enterprise analytics.
- Support machine learning and predictive analytics initiatives by preparing and engineering high-quality datasets.
- Ensure data quality, integrity, governance, security, and compliance with *HIPAA and applicable healthcare regulations*.
- Work closely with data scientists, analysts, and software engineers to deliver reliable and high-performance data solutions.
- Implement and maintain *CI/CD pipelines* and automation for data engineering workflows.
- Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and scalability.
- Participate in technical design reviews and contribute to data platform architecture decisions.
- Follow and promote data engineering best practices across development and production environments.
*Required Skills & Qualifications*
- 8+ years of professional experience in *Data Engineering*, with strong hands-on experience in Azure cloud environments.
- Strong expertise in developing data pipelines using *Python, SQL, Spark/PySpark, and Azure Databricks*.
- Solid understanding of *Delta Lake, Lakehouse Architecture, data warehousing, and modern data platforms*.
- Hands-on experience with *Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, and Azure SQL*.
- Experience working with healthcare datasets such as *EHR and claims data*.
- Strong understanding of healthcare data standards including *FHIR and HL7*.
- Experience supporting *machine learning, predictive analytics, or data science* initiatives.
- Practical experience implementing *DevOps and CI/CD practices* for data engineering workflows.
- Strong understanding of data security, governance, quality, and *HIPAA compliance*.
- Excellent problem-solving, communication, and collaboration skills in an Agile environment.
- *Azure Data Engineer or Databricks certification* is preferred.
Pay: $60.00 - $70.00 per hour
Application Question(s):
- How many years of experience you have?
Work Location: Remote