{"schemaVersion":"jobsearcher.job.v1","id":"5ae0cb821e96f1b292d2d286","url":"https://jobsearcher.com/jobs/5ae0cb821e96f1b292d2d286","canonicalUrl":"https://jobsearcher.com/jobs/5ae0cb821e96f1b292d2d286","title":"Lead Cloud Data Engineer","description":"Job Title: Lead Cloud Data EngineerLocations: Fort Mill, SC or New York City, NY (Hybrid/Onsite)Type: Full TimeJob SummaryWe are looking for a highly experienced Data Engineer – AWS Tech Lead to design and lead scalable cloud-based data solutions. This role will combine hands-on engineering with leadership responsibilities, guiding a team of data engineers while collaborating with architects, product owners, and business stakeholders. The ideal candidate will have deep expertise in AWS data services, ETL/ELT pipelines, and big data frameworks, with proven experience in leading technical delivery. Key Responsibilities\nLead the design, development, and deployment of large-scale data pipelines and solutions on AWS.\nProvide technical leadership and mentorship to a team of data engineers, ensuring best practices in coding, architecture, and performance optimization.\nArchitect data lake and data warehouse solutions leveraging AWS Glue, Redshift, S3, Athena, EMR, and Lambda.\nDrive development of ETL/ELT processes using PySpark, Python, and SQL.\nImplement and enforce data governance, quality checks, and security standards across the platform.\nCollaborate with business analysts, data scientists, and product teams to translate business requirements into scalable solutions.\nOptimize cost and performance of AWS-based data workloads.\nTroubleshoot production issues and ensure high availability of data pipelines.\nParticipate in sprint planning, backlog refinement, and Agile ceremonies as a technical lead.\nRequired Qualifications\n13+ years of experience in Data Engineering, with at least 4+ years in a technical leadership role.\nStrong expertise in AWS data services: Glue, S3, Redshift, Athena, Lambda, Step Functions, EMR.\nProficiency in PySpark, Python, and SQL for large-scale data processing.\nSolid experience in data modeling (star, snowflake, dimensional modeling) and data lake/warehouse architectures.\nProven track record in leading and mentoring data engineering teams.\nStrong understanding of Agile methodologies and CI/CD practices for data pipelines.\nPreferred Qualifications\nExperience in BFSI / Wealth Management domain.\nAWS Certification (Data Analytics Specialty, Solutions Architect, or Big Data).\nFamiliarity with containerization (Docker, Kubernetes) and orchestration frameworks.\nEducation\nBachelor’s degree in Computer Science, Information Technology, Engineering, or related field.\nMaster’s degree preferred.","company":"Qode","rawCompany":"qode","city":"Fort Mill","state":"SC","isRemote":false,"isActive":false,"createdAt":"2026-04-14T11:25:17.569Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Cloud Data Engineer","description":"Job Title: Lead Cloud Data EngineerLocations: Fort Mill, SC or New York City, NY (Hybrid/Onsite)Type: Full TimeJob SummaryWe are looking for a highly experienced Data Engineer – AWS Tech Lead to design and lead scalable cloud-based data solutions. This role will combine hands-on engineering with leadership responsibilities, guiding a team of data engineers while collaborating with architects, product owners, and business stakeholders. The ideal candidate will have deep expertise in AWS data services, ETL/ELT pipelines, and big data frameworks, with proven experience in leading technical delivery. Key Responsibilities\nLead the design, development, and deployment of large-scale data pipelines and solutions on AWS.\nProvide technical leadership and mentorship to a team of data engineers, ensuring best practices in coding, architecture, and performance optimization.\nArchitect data lake and data warehouse solutions leveraging AWS Glue, Redshift, S3, Athena, EMR, and Lambda.\nDrive development of ETL/ELT processes using PySpark, Python, and SQL.\nImplement and enforce data governance, quality checks, and security standards across the platform.\nCollaborate with business analysts, data scientists, and product teams to translate business requirements into scalable solutions.\nOptimize cost and performance of AWS-based data workloads.\nTroubleshoot production issues and ensure high availability of data pipelines.\nParticipate in sprint planning, backlog refinement, and Agile ceremonies as a technical lead.\nRequired Qualifications\n13+ years of experience in Data Engineering, with at least 4+ years in a technical leadership role.\nStrong expertise in AWS data services: Glue, S3, Redshift, Athena, Lambda, Step Functions, EMR.\nProficiency in PySpark, Python, and SQL for large-scale data processing.\nSolid experience in data modeling (star, snowflake, dimensional modeling) and data lake/warehouse architectures.\nProven track record in leading and mentoring data engineering teams.\nStrong understanding of Agile methodologies and CI/CD practices for data pipelines.\nPreferred Qualifications\nExperience in BFSI / Wealth Management domain.\nAWS Certification (Data Analytics Specialty, Solutions Architect, or Big Data).\nFamiliarity with containerization (Docker, Kubernetes) and orchestration frameworks.\nEducation\nBachelor’s degree in Computer Science, Information Technology, Engineering, or related field.\nMaster’s degree preferred.","datePosted":"2026-04-14T11:25:17.569Z","dateModified":"2026-04-14T11:25:17.569Z","hiringOrganization":{"@type":"Organization","name":"Qode","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Fort Mill","addressRegion":"SC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"5ae0cb821e96f1b292d2d286"},"url":"https://jobsearcher.com/jobs/5ae0cb821e96f1b292d2d286"}}