Azure DataBricks Solution Architect

**Key Responsibilities**- Design and implement scalable data platforms and pipelines using Databricks (including Spark, Delta Lake, MLflow, etc.).- Work with stakeholders to develop modern data architectures that meet business requirements.- Lead the migration from legacy platforms to the Databricks Lakehouse architecture.- Establish data governance, quality, and security standards in collaboration with InfoSec and Compliance teams.- Optimize data ingestion, transformation, and consumption processes.- Mentor data engineers and developers on best practices for using Databricks.- Integrate Databricks with enterprise tools such as Power BI, Tableau, Kafka, Snowflake, and others.- Develop and implement machine learning/AI workflows within a Databricks environment.- Collaborate with cloud architects to ensure a robust infrastructure setup on AWS, Azure, or GCP.- Produce technical documentation, architectural diagrams, and data models.**Required Qualifications**- Over 8 years of experience in data engineering or architectural roles.- More than 5 years of experience in architecting solutions with Databricks.- Expertise in Apache Spark, Delta Lake, MLflow, and Lakehouse architecture.- Proficiency in SQL, Python, and/or Scala.- Practical experience with cloud platforms such as AWS, Azure, or GCP.- Strong understanding of distributed computing, performance tuning, and data security.- Experience with CI/CD pipelines, DevOps tools, and orchestration tools like Airflow or Data Factory.Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.