Python Developer - Databricks and Azure
Summary:
Job Summary (Python Developer Databricks and Azure) Minimum 7 10 years of experience in Python, ETL data handling, and SQL. Design and implement scalable data and application solutions using Python and Azure ML. Develop and optimize complex ETL/ELT processes for large-scale datasets using Spark and Python. Enhance Python job performance and cost-efficiency through advanced optimization techniques. Collaborate with data scientists, analysts, and business stakeholders to create technical solutions for business problems. Implement data security, compliance, and governance frameworks (e.g., Unity Catalog, access controls, encryption, data lineage). Champion DevOps and automation by building CI/CD pipelines using Azure DevOps, GitHub Actions, or Jenkins. Develop robust monitoring, logging, and alerting for production pipelines to ensure reliability. Must have strong experience in Databricks, Azure Cloud, Spark, and application development. Experience with software development life cycle (SDLC) and agile methodologies. Design and develop CI/CD pipelines for code deployment, preferably to Azure, using Git-based tools. At least 5 years of hands-on experience with Spark, Databricks, and monitoring/alerting systems.
Nice to have:
Java, Spring, comprehensive Azure services knowledge, and excellent communication skills. Experience using AI tools for enhanced productivity is a plus. Will work in a pod-based agile team structure, supporting multiple projects and ensuring consistent agile practices. Local candidates (within 50 miles of Fort Worth, TX) required; in-person interview and coding assignment mandatory.