Python Developer with Azure Databricks

Duration: 12+ Months Contract

Interview: F2F required.

Job Description: Key Responsibilities: Candidate must have 7 to 10 years of experience for this role. Design and Architecture: Participate contribute in end-to-end design and implementation of scalable data and application design using Python and Azure ML.ETL/ELT Development: Develop and implement complex ETL/ELT processes to process and transform large-scale datasets from diverse sources using Spark and Python Performance Optimization: Optimize Python jobs for performance and cost-efficiency using advanced techniques such as partitioning, caching, cluster configuration tuning, and troubleshooting bottlenecks. Collaboration & Leadership: Collaborate with data scientists, analysts, and business stakeholders to translate complex business problems into technical solutions. Data Governance & Security: Implement data security strategies, compliance standards, and governance frameworks like Unity Catalog, including managing access controls, encryption, and data lineage. DevOps & Automation: Champion code quality and implement DevOps (CI/CD) pipelines using tools like Azure DevOps, GitHub Actions, or Jenkins to automate deployment and management of data assets and infrastructure. Troubleshooting & Monitoring: Develop and implement robust monitoring, logging, and alerting systems for production-grade pipelines to proactively identify and resolve issues. Top 3 Skillsets: Python, Databricks, Azure Cloud, spark, Azure ML and good Application development skills.