{"schemaVersion":"jobsearcher.job.v1","id":"04051f923a8c0d60afd2a4e1","url":"https://jobsearcher.com/jobs/04051f923a8c0d60afd2a4e1","canonicalUrl":"https://jobsearcher.com/jobs/04051f923a8c0d60afd2a4e1","title":"AWS Lead Data Engineer","description":"Summary :Lead the design and delivery of scalable data engineering solutions on AWS, supporting enterprise data onboarding and domain-oriented data products. The role will provide hands-on technical leadership across AWS-native data services and work with Prudential teams to build trusted, reusable and analytics/AI-ready data assets.Key Responsibilities\r\nTechnical Leadership & Architecture\r\nLead the design and implementation of data ingestion, transformation and processing solutions using AWS native services including S3, Glue, EMR, Redshift and Athena.\r\nDefine appropriate engineering patterns for batch and large-scale data processing using Python and PySpark.\r\nGuide implementation of modern lake/lakehouse patterns, including S3 and Apache Iceberg, where applicable.\r\nProvide technical direction across design, development, testing, deployment and production support.\r\nData Engineering & Data Products\r\nLead onboarding of data from legacy and enterprise source systems into AWS.\r\nDrive development of reusable pipelines and engineering components for specific enterprise data domains.\r\nSupport theADS / Authoritative Data Sourceapproach, where domain data is packaged as trusted data products for enterprise consumption.\r\nEnsure datasets produced by the engineering team are consumable for downstream analytics and AI use cases.\r\nEngineering Quality\r\nConduct design and code reviews for Python/PySpark and AWS data-engineering components.\r\nEstablish development standards, reusable patterns and engineering best practices.\r\nEnsure appropriate data validation and reconciliation are incorporated into pipelines.\r\nTroubleshoot performance and scalability issues across data pipelines and processing workloads.\r\nTeam Leadership & Collaboration\r\nProvide day-to-day technical guidance to Data Engineers.\r\nBreak functional/data requirements into engineering tasks and coordinate delivery.\r\nWork closely with Prudential's architecture, data, technology and business-aligned teams.\r\nCommunicate technical risks, dependencies and design decisions to stakeholders.\r\nMentor engineers and build the team's AWS/Python/PySpark engineering capability.","company":"Exavalu","rawCompany":"exavalu","city":"Newark","state":"DE","isRemote":false,"isActive":true,"createdAt":"2026-10-31T01:09:50.334Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"AWS Lead Data Engineer","description":"Summary :Lead the design and delivery of scalable data engineering solutions on AWS, supporting enterprise data onboarding and domain-oriented data products. The role will provide hands-on technical leadership across AWS-native data services and work with Prudential teams to build trusted, reusable and analytics/AI-ready data assets.Key Responsibilities\r\nTechnical Leadership & Architecture\r\nLead the design and implementation of data ingestion, transformation and processing solutions using AWS native services including S3, Glue, EMR, Redshift and Athena.\r\nDefine appropriate engineering patterns for batch and large-scale data processing using Python and PySpark.\r\nGuide implementation of modern lake/lakehouse patterns, including S3 and Apache Iceberg, where applicable.\r\nProvide technical direction across design, development, testing, deployment and production support.\r\nData Engineering & Data Products\r\nLead onboarding of data from legacy and enterprise source systems into AWS.\r\nDrive development of reusable pipelines and engineering components for specific enterprise data domains.\r\nSupport theADS / Authoritative Data Sourceapproach, where domain data is packaged as trusted data products for enterprise consumption.\r\nEnsure datasets produced by the engineering team are consumable for downstream analytics and AI use cases.\r\nEngineering Quality\r\nConduct design and code reviews for Python/PySpark and AWS data-engineering components.\r\nEstablish development standards, reusable patterns and engineering best practices.\r\nEnsure appropriate data validation and reconciliation are incorporated into pipelines.\r\nTroubleshoot performance and scalability issues across data pipelines and processing workloads.\r\nTeam Leadership & Collaboration\r\nProvide day-to-day technical guidance to Data Engineers.\r\nBreak functional/data requirements into engineering tasks and coordinate delivery.\r\nWork closely with Prudential's architecture, data, technology and business-aligned teams.\r\nCommunicate technical risks, dependencies and design decisions to stakeholders.\r\nMentor engineers and build the team's AWS/Python/PySpark engineering capability.","datePosted":"2026-10-31T01:09:50.334Z","dateModified":"2026-10-31T01:09:50.334Z","hiringOrganization":{"@type":"Organization","name":"Exavalu","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Newark","addressRegion":"DE","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"04051f923a8c0d60afd2a4e1"},"url":"https://jobsearcher.com/jobs/04051f923a8c0d60afd2a4e1"}}