{"schemaVersion":"jobsearcher.job.v1","id":"89cb64057cf287de4a140355","url":"https://jobsearcher.com/jobs/89cb64057cf287de4a140355","canonicalUrl":"https://jobsearcher.com/jobs/89cb64057cf287de4a140355","title":"Lead AWS Data Engineer – (Data Mesh & AI)","description":"For quick Apply, Please reach out to Akash – Call: (214) 501-0916 / Email: Akash.Kumar1@dexian.comRole: Lead AWS Data Engineer – (Data Mesh & AI)Location: San Francisco, CA Top/Required Skills: AWS Data Engineering, AWS Data Platform (S3, Glue, Lambda, Redshift), Python, PySpark, Terraform (IaC), Generative AI for SDLC (Code Generation/AI Tools), DevSecOps, Cybersecurity, SAST/DAST, Data Mesh, Technical Leadership/Ownership, Cloud Migration, AWS GovCloud/FedRAMP (Preferred), Data Mesh Architecture, Databricks/Starburst/Trino, Collibra/Immuta (Preferred), Generative AI/Agentic AI/RAG/Amazon Bedrock/LLMs (Good to have).About the Role:Need 12-15+ years of experience with proven leadership/ownership of AWS Data Engineering projects, data platforms, and enterprise-scale data systems from design through delivery.We are seeking an experienced Lead Data Engineer to join our team and drive the development of modern data platforms and AI-augmented solutions. This role is critical to supporting ongoing operations of Large Data Warehouse, architecting the Large Data Hub, and preparing for the enterprise data mesh modernization program.Key ResponsibilitiesData Engineering & Pipeline Development:Develop and maintain end-to-end ETL/ELT pipelines for data ingestion from multiple sources (databases, APIs, streaming), transformation, quality validation, data modeling, and consumption layer optimization using AWS services (Glue, EMR, Lambda, Kinesis, Step Functions)Implement data governance policies, metadata management, data lineage tracking, fine-grained access controls, and automated data quality frameworks with validation rules, anomaly detection, and monitoring/alerting mechanismsData Mesh ArchitectureDesign and implement Data Mesh architecture on AWS with federated governance, defining domain boundaries, data product specifications, and self-serve infrastructure patterns across Databricks, Starburst, Collibra, and Immuta platformsDevelop reusable frameworks, accelerators, and self-serve tools enabling domain teams to independently publish, discover, and consume data products while ensuring performance optimization and cost efficiencyDevSecOps & InfrastructureIntegrate DevSecOps practices including CI/CD pipelines, infrastructure as code (Terraform/CloudFormation), automated security scanning, compliance validation, and disaster recovery strategiesAI-Augmented DevelopmentDesign and build agentic AI solutions, RAG pipelines, and intelligent automation using LLMs, orchestration frameworks, and AI-powered development tools (Copilot, Claude Code) to enhance platform capabilities and accelerate SDLCTechnical Leadership & CollaborationProvide L3 technical support and mentor engineering teams on data mesh principles and modern data technologiesCollaborate with stakeholders to translate business requirements into technical solutionsLead architecture design reviews and create comprehensive technical documentationRequired Qualifications:Data Mesh Architecture & AWS (5+ years required):Deep experience designing distributed data architectures on AWS (S3, Glue, Lake Formation, EMR, Redshift)Hands-on implementation of data mesh principles including domain-oriented data ownership, data as a product, and federated computational governanceModern Data Platform Technologies:Proficiency: Databricks (Unity Catalog, Delta Lake), Starburst/Trino (federated query), Collibra (data governance), or Immuta (dynamic data access control)Ability to architect multi-technology solutionsDevSecOps & Infrastructure as Code:Strong experience with CI/CD pipelines (GitLab/GitHub Actions, Jenkins)Containerization expertise (Docker/ECS)Infrastructure automation (Terraform, CloudFormation)Security compliance frameworks for AWS GovCloud environments AI-Augmented Development & Engineering:Demonstrated use of generative AI tools for accelerating SDLC activities including code generation, testing, and documentationExperience designing or implementing agentic AI solutions using Amazon Bedrock or similar frameworksLeadership & Soft SkillsProven ability to translate business requirements into technical solutionsExperience leading technical design sessions and mentoring engineering teamsStrong communication skills to convey complex architectural concepts to both technical and non-technical stakeholdersExperience working across hybrid cloud/on-premises environmentsFor quick Apply, Please reach out to Akash – Call: (214) 501-0916 / Email: Akash.Kumar1@dexian.com","company":"Dexian","rawCompany":"dexian","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-07-27T12:05:02.118Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead AWS Data Engineer – (Data Mesh & AI)","description":"For quick Apply, Please reach out to Akash – Call: (214) 501-0916 / Email: Akash.Kumar1@dexian.comRole: Lead AWS Data Engineer – (Data Mesh & AI)Location: San Francisco, CA Top/Required Skills: AWS Data Engineering, AWS Data Platform (S3, Glue, Lambda, Redshift), Python, PySpark, Terraform (IaC), Generative AI for SDLC (Code Generation/AI Tools), DevSecOps, Cybersecurity, SAST/DAST, Data Mesh, Technical Leadership/Ownership, Cloud Migration, AWS GovCloud/FedRAMP (Preferred), Data Mesh Architecture, Databricks/Starburst/Trino, Collibra/Immuta (Preferred), Generative AI/Agentic AI/RAG/Amazon Bedrock/LLMs (Good to have).About the Role:Need 12-15+ years of experience with proven leadership/ownership of AWS Data Engineering projects, data platforms, and enterprise-scale data systems from design through delivery.We are seeking an experienced Lead Data Engineer to join our team and drive the development of modern data platforms and AI-augmented solutions. This role is critical to supporting ongoing operations of Large Data Warehouse, architecting the Large Data Hub, and preparing for the enterprise data mesh modernization program.Key ResponsibilitiesData Engineering & Pipeline Development:Develop and maintain end-to-end ETL/ELT pipelines for data ingestion from multiple sources (databases, APIs, streaming), transformation, quality validation, data modeling, and consumption layer optimization using AWS services (Glue, EMR, Lambda, Kinesis, Step Functions)Implement data governance policies, metadata management, data lineage tracking, fine-grained access controls, and automated data quality frameworks with validation rules, anomaly detection, and monitoring/alerting mechanismsData Mesh ArchitectureDesign and implement Data Mesh architecture on AWS with federated governance, defining domain boundaries, data product specifications, and self-serve infrastructure patterns across Databricks, Starburst, Collibra, and Immuta platformsDevelop reusable frameworks, accelerators, and self-serve tools enabling domain teams to independently publish, discover, and consume data products while ensuring performance optimization and cost efficiencyDevSecOps & InfrastructureIntegrate DevSecOps practices including CI/CD pipelines, infrastructure as code (Terraform/CloudFormation), automated security scanning, compliance validation, and disaster recovery strategiesAI-Augmented DevelopmentDesign and build agentic AI solutions, RAG pipelines, and intelligent automation using LLMs, orchestration frameworks, and AI-powered development tools (Copilot, Claude Code) to enhance platform capabilities and accelerate SDLCTechnical Leadership & CollaborationProvide L3 technical support and mentor engineering teams on data mesh principles and modern data technologiesCollaborate with stakeholders to translate business requirements into technical solutionsLead architecture design reviews and create comprehensive technical documentationRequired Qualifications:Data Mesh Architecture & AWS (5+ years required):Deep experience designing distributed data architectures on AWS (S3, Glue, Lake Formation, EMR, Redshift)Hands-on implementation of data mesh principles including domain-oriented data ownership, data as a product, and federated computational governanceModern Data Platform Technologies:Proficiency: Databricks (Unity Catalog, Delta Lake), Starburst/Trino (federated query), Collibra (data governance), or Immuta (dynamic data access control)Ability to architect multi-technology solutionsDevSecOps & Infrastructure as Code:Strong experience with CI/CD pipelines (GitLab/GitHub Actions, Jenkins)Containerization expertise (Docker/ECS)Infrastructure automation (Terraform, CloudFormation)Security compliance frameworks for AWS GovCloud environments AI-Augmented Development & Engineering:Demonstrated use of generative AI tools for accelerating SDLC activities including code generation, testing, and documentationExperience designing or implementing agentic AI solutions using Amazon Bedrock or similar frameworksLeadership & Soft SkillsProven ability to translate business requirements into technical solutionsExperience leading technical design sessions and mentoring engineering teamsStrong communication skills to convey complex architectural concepts to both technical and non-technical stakeholdersExperience working across hybrid cloud/on-premises environmentsFor quick Apply, Please reach out to Akash – Call: (214) 501-0916 / Email: Akash.Kumar1@dexian.com","datePosted":"2026-07-27T12:05:02.118Z","dateModified":"2026-07-27T12:05:02.118Z","hiringOrganization":{"@type":"Organization","name":"Dexian","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"89cb64057cf287de4a140355"},"url":"https://jobsearcher.com/jobs/89cb64057cf287de4a140355"}}