Resident Solutions Architect (RSA)

Job Title: Resident Solutions ArchitectLocation: MUST be able to work ONSITE in New York City, NYExperience Level: Senior (10+ Years)Pay rate: $140/hr - $150/hrContract Duration: Long term contract About the RoleOur client in the trading industry is seeking a high-caliber Resident Solutions Architect to join their professional services team. This is a dual-threat role requiring the technical depth of a seasoned Data Engineer and the strategic mindset of an elite Consultant. You will act as the primary technical trusted advisor for their strategic enterprise clients, guiding them through the architecture, deployment, and optimization of complex data ecosystems.As a Resident Architect, you don’t just draw diagrams; you bridge the gap between business value and technical execution, ensuring that large-scale data platforms are resilient, performant, and future-proof.Key ResponsibilitiesStrategic Consulting: Leverage 10+ years of consulting experience to lead high-stakes architectural discussions and align data strategies with business outcomes.Platform Architecture: Design and deliver production-grade data platforms using the Databricks Lakehouse architecture.Performance Optimization: Apply deep knowledge of Spark runtime internals to tune, troubleshoot, and optimize distributed computing workloads for maximum scalability.Full-Lifecycle Delivery: Lead the end-to-end development of data pipelines, from ingestion and transformation to MLOps integration and CI/CD automation.Cloud Leadership: Navigate complex multi-cloud environments (AWS, Azure, or GCP), providing deep subject matter expertise in at least one primary ecosystem.Required QualificationsExperience: 7+ years in Data Engineering/Analytics and 10+ years in a professional Consulting or Client-facing role.Technical Depth: Hands-on delivery of 6–8+ major projects specifically built on the Databricks platform.Spark Mastery: Expert-level understanding of distributed computing with Spark, including memory management, partitioning, and execution plans.Cloud Proficiency: Working knowledge of at least two major cloud providers (AWS, Azure, GCP) with deep expertise in one.Certification: Must have completed the Data Engineering Professional certification and all required prerequisite coursework.Modern DevOps: Proficiency in CI/CD workflows for data engineering and a working knowledge of MLOps principles.Databricks Expert: Up-to-date knowledge across the entire Databricks product suite (Unity Catalog, Delta Live Tables, SQL Warehouse, etc.).Experience with application development and Dataricks AppsComfort working in Linux environmentsBackground in financial markets, such as market making, trading, or related domainsAble to work independently, prioritize effectively, and proactively identify opportunities for improvementComfortable operating in a loosely defined scope, where they are expected not only to execute tasks but also help define priorities and drive work forward.  #IND1