Solution Architect, Data Platform
Hiring: Solution Architect – Data Platform (Databricks) | San Francisco, CA | HybridWe're looking for an experienced Solution Architect with deep expertise in Databricks Lakehouse architecture and AWS to lead the end-to-end design of a modern enterprise data platform. The ideal candidate will drive architecture decisions, platform modernization, legacy data migrations, security, governance, and cost optimization while partnering with business and technology stakeholders.
Location: San Francisco, CA (Hybrid)
Duration: 6 Months (Possibility of Extension)(Financial Services Preferred)
Key Skills:
- 12+ years of experience in data engineering or architecture, including 5+ years of hands-on Databricks Lakehouse experience
- Strong expertise in Apache Spark, Delta Lake, SQL, and Medallion Architecture
- Experience designing enterprise-scale data platforms on Databricks
- Strong AWS architecture knowledge, including networking, IAM, encryption, and multi-account design
- Experience with Unity Catalog, PII/NPI data protection, access controls, audit logging, and data lineage
- Proven experience planning migrations from legacy Hadoop, Hive, EMR, and data warehouse platforms
- Strong understanding of batch and streaming architectures, including Kafka and Spark Structured Streaming
- Experience designing high-availability and disaster recovery solutions
- Expertise in Databricks cost optimization, DBU forecasting, capacity planning, and FinOpsExperience translating business requirements into solution architecture, reference designs, and delivery roadmaps
- Strong stakeholder management, vendor management, and architecture documentation skills
Good to Have:
- Banking, lending, or regulated financial services experience
- Marketing data architecture, Customer 360, consent management, and campaign measurement
- Collections data architecture, delinquency data, agency feeds, and dialer integrationsML/MLOps architecture using Databricks, Feature Store, and MLflowDatabricks or AWS Solution Architect certifications
What We're Looking For:
A strategic and hands-on Data Platform Architect who can own end-to-end Databricks architecture, drive legacy platform modernization, establish security and governance standards, and make critical technology and cost decisions while aligning business requirements with scalable enterprise data solutions. Interested? Apply now or DM us to explore this opportunity! You can share resumes at Sanskar@Wiseskulls.com