Data Architect-Databricks
Job Summary:
We are seeking an experienced Data Architect with 10-12 years of experience to design and deliver scalable, secure, governed, and high-performing enterprise data platforms using Databricks. The role will translate business and analytics requirements into target-state data architectures, define reusable design standards, and guide engineering teams through implementation and production readiness.
Key Responsibilities:
Enterprise Data Architecture: Define current-state and target-state architectures for data platforms, data products, analytics, reporting, and AI/ML workloads aligned with enterprise strategy.
Databricks Platform Design: Architect Lakehouse solutions using Databricks for data ingestion, engineering, transformation, governance, analytics, data sharing, and workload orchestration.
Data Modeling and Design: Establish conceptual, logical, and physical data models; define data domains, canonical models, metadata standards, and scalable Delta Lake and dimensional modeling patterns.
Data Integration and Engineering Standards: Design batch, streaming, API, and event-driven integration patterns and provide architecture guidance for ingestion, transformation, orchestration, and data quality.
Security and Governance: Embed access controls, encryption, data classification, lineage, retention, privacy, cataloging, Unity Catalog governance, and regulatory controls into platform designs.
Architecture Governance: Lead design reviews, maintain reference architectures and decision records, assess technical risks, and ensure engineering solutions conform to approved standards.
Performance, Reliability, and Cost Optimization: Define scalability, availability, disaster recovery, observability, query performance, cluster and serverless workload optimization, and FinOps requirements.
Stakeholder and Delivery Partnership: Partner with business leaders, Global Delivery, product owners, analytics teams, and client stakeholders to shape roadmaps, estimates, migration plans, and implementation approaches; mentor data engineers and solution designers.
Required Qualifications:
10-12 years of experience in data engineering, data architecture, cloud platforms, analytics, or enterprise technology, including significant experience leading complex data solution design and delivery. Strong hands-on architecture experience with Databricks, covering Lakehouse platforms, data engineering, analytics, integration, security, governance, performance optimization, and production deployment. Proficiency in SQL, Python, Apache Spark, Delta Lake, data modeling, dimensional modeling, ETL/ELT, REST APIs, CI/CD, infrastructure as code, and distributed data processing. Demonstrated ability to translate business requirements into architecture decisions, communicate with technical and executive stakeholders, and guide multidisciplinary delivery teams.
Preferred Qualifications:
Bachelor's or master's degree in computer science, engineering, data science, information systems, or a related discipline. Relevant Databricks certifications, such as Databricks Certified Data Engineer Professional or Databricks Certified Data Analyst Associate. Experience with Unity Catalog, Delta Lake, Lakeflow Connect, Lakeflow Declarative Pipelines, Lakeflow Jobs, Delta Sharing, Databricks SQL, cluster policies, data cataloging, master data management, and enterprise governance frameworks.