Data Architect
Key ResponsibilitiesStrategic Architecture & Future-ProofingCloud-Agnostic Vision: Design and execute a 3-to-5-year enterprise data warehouse modernization roadmap that prioritizes extreme data portability, decoupling storage from compute using open table formats (e.g., Apache Iceberg).Multi-Cloud Readiness: Evaluate alternative ecosystems and ensure current AWS implementations are built with vendor-neutral patterns, avoiding proprietary lock-in.AI & Semantic Preparation: Establish strict semantic conventions, data hygiene standards, and metadata graphs today to ensure the underlying data warehouse is optimized for future conversational AI agents and modern BI tools.Engineering Governance & Quality AutomationScale Through Guardrails: Stop technical debt at the source by designing reusable framework templates and abstracted wrappers that enforce coding best practices across an offshore development teamAutomated DataOps Gates: Implement automated CI/CD quality gates (e.g., automated SQL linting, schema drift detection, and data validation frameworks) to catch low-quality code before it reaches human review.Operational Excellence: Redefine the onshore team''s workflows, shifting senior engineers from manual code-reviewers to platform product owners.Code modernization: Assist in setting policies and training for the team to move from working exclusively in SQL to also including Spark jobs. Help us figure out the proper handoff mechanisms and frameworks for evaluating SQL developed solutions to Spark jobs.Ingestion & Pipeline OptimizationHigh-Frequency Ingestion: Own the architectural pattern for high-frequency source replication, ensuring optimal performance without violating API limits or driving unnecessary cloud compute costs.Modern Orchestration & Storage: Guide the transition from rigid, scheduled jobs to event-driven processing using AWS Glue, EMR Serverless, and optimized presentation layers in Redshift.Mentorship & LeadershipTalent Elevation: Act as a dedicated mentor to the 3 intermediate and 3 senior onshore engineers, pushing them to think in terms of holistic system design and enterprise scalability.Soft Skills Coaching: Help senior staff develop critical soft skills, including "influence without authority," cross-functional stakeholder communication, and effective offshore vendor governance.Required Qualifications8+ years of deep experience in enterprise data engineering, data architecture, or data platform roles, with at least 2+ years operating at a Staff, Principal, or Lead Architect level within a Fortune 500 scale environment.Expertise in Cloud-Agnostic Design: Proven track record of building data lakehouses centered around open table formats (e.g., Apache Iceberg, Delta Lake) to ensure cross-cloud compatibility.Advanced AWS Data Ecosystem Experience: Hands-on architectural experience with AWS Glue, EMR Serverless, S3 data lakes, and Amazon Redshift.Governance at Scale: Demonstrated success implementing automated testing, CI/CD pipelines, and DataOps frameworks (e.g., dbt, Great Expectations, SQLFluff) to govern large delivery teams.Complex Ingestion Mastery: Experience managing high-frequency CDC data ingestion from massive enterprise ERP systems (specifically Oracle Fusion Cloud or equivalent) using modern tools like Fivetran.Expert Coding Skills: Mastery of Python and complex SQL, with a deep understanding of query optimization, data modeling (Kimball, Data Vault 2.0), and technical debt remediation.