JOBSEARCHER

Lead Databricks Developer-Azure-AWS

Job Title: Lead Databricks Developer-Azure-AWSLocation : Plano, TX (100% remote work accepted from anywhere in US)Duration : 9-12+ Months ContractTeams Meeting Interview Job Description:Client UPDATE: They need lead level hands on resource. Client primarily works on AWS platform so would need that experience rather than just Azure.and Only2-3 Pages of resumes AcceptingDesigning and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks.Required Skills:Extensive hands-on experience with Databricks and Apache Spark (PySpark, Scala, or SQL) - 8+ years of experienceProficiency in at least one programming language (Python, Scala, or Java) - 5+ years of experienceStrong understanding of cloud data architectures (Azure Data Lake, AWS S3, GCP Storage) and related ecosystem - 5+ years of experienceExperience with CI/CD tools and DevOps practices for data engineering - 5+ years of experienceFamiliarity with data warehousing concepts and tools (Delta Lake, SQL, etc.) - 5+ years of experienceSolid grasp of distributed computing, performance tuning, and big data best practices - 5+ years of experience.Excellent communication and problem-solving skills - 5+ years of experience.