{"schemaVersion":"jobsearcher.job.v1","id":"f57ece82a45253f66f3fb3a5","url":"https://jobsearcher.com/jobs/f57ece82a45253f66f3fb3a5","canonicalUrl":"https://jobsearcher.com/jobs/f57ece82a45253f66f3fb3a5","title":"Lead Data Engineer","description":"The Lead Data Engineer will take technical ownership of enterprise data engineering initiatives, supporting end-to-end design, architecture, and delivery across AWS-based platforms. This hybrid role is based in Charlotte, NC, with a preference for local candidates.Key ResponsibilitiesLead the design, architecture, and implementation of enterprise data engineering solutions across the AWS ecosystemCollaborate with Lead Developers, Data Scientists, Architects, Product Owners, and business stakeholders to define technical strategy and scalable solutionsProvide technical leadership and mentorship to Data Engineers and development teams, promoting engineering excellence and best practicesDrive key architectural decisions with Data Architects and Solution Architects to support scalability, security, reliability, and maintainabilityDesign and oversee data warehouse and data lake solutions balancing business usability, performance, and long-term sustainabilityEstablish engineering standards for data modeling, ETL frameworks, pipeline reliability, monitoring, and operational excellenceLead end-to-end solution delivery, ensuring alignment with business requirements, enterprise architecture standards, and regulatory requirementsOversee production support and operational management of AWS-based data platforms, including root-cause analysis and performance optimizationChampion data quality, governance, observability, and data stewardship practices across platforms and teamsIdentify opportunities to modernize data architecture and improve operational efficiency through automation and cloud-native technologiesRequired Qualifications8+ years of experience in Data Engineering, including at least 5+ years working extensively within AWS ecosystemsExpert-level experience with AWS services including S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, and Step FunctionsExperience creating AI applications with AWS BedrockStrong experience designing and implementing enterprise-scale data lake and data warehouse solutions using Lake Formation, Amazon Redshift, and Amazon AthenaExtensive experience with Kafka-based streaming architectures, preferably Confluent KafkaAdvanced SQL and data modeling expertise, including dimensional modeling, data vault, and large-scale data warehousing solutionsDeep experience designing, developing, and optimizing scalable, resilient data pipelines within AWS environmentsStrong understanding of distributed data processing frameworks, particularly PySpark and EMRExpert knowledge of database management principles, performance tuning, and data architecture best practicesAdvanced Python development skills with extensive hands-on experience using PySparkExpertise in Infrastructure as Code using TerraformExperience designing and implementing CI/CD frameworks using GitHub and GitHub ActionsDeep knowledge of AWS IAM roles, policies, governance, and security best practicesStrong experience with workflow orchestration tools such as AWS Step Functions, Apache Airflow, or equivalent platformsExperience leading cloud migration, modernization, and enterprise data platform initiativesStrong understanding of data governance, metadata management, data quality frameworks, and observability principlesAbility to lead hands-on development while providing technical direction, code reviews, and engineering oversight across multiple initiativesExperience establishing development environments, infrastructure standards, security controls, and migration strategies across multiple AWS accounts and environmentsAbility to architect, develop, and govern enterprise-scale data pipelines, ETL processes, data ingestion frameworks, and orchestration workflowsProven ability to identify data gaps, define strategic remediation plans, and implement scalable automation solutions that improve analytical capabilities across the organizationAbility to design and implement highly reliable data pipelines with a focus on data quality, observability, resiliency, and operational supportabilityExperience building and optimizing large-scale data warehousing solutions that prioritize business user experience and system performanceAbility to drive technical decision-making, influence architectural direction, and communicate complex technical concepts to technical and non-technical stakeholdersProven track record mentoring engineers, fostering technical growth, and building high-performing data engineering teamsExperience leading cross-functional initiatives involving data engineering, analytics, architecture, platform engineering, and business stakeholdersStrong problem-solving and leadership skills, including managing competing priorities in fast-paced enterprise environmentsExperience building AI-ready data pipelines and ML workflows, including feature engineering and MLOpsProficiency in Python, SQL, Spark, and Generative AI technologies for scalable data and analytics solutionsHands‑on experience with AWS, Azure, or Databricks and cloud-based AI/data platformsKnowledge of LLMs, RAG, and vector databases to support AI-powered applications and intelligent searchStrong understanding of data governance, quality, security, and responsible AI practicesPreferred SkillsAWS Certified Data Engineer, AWS Solutions Architect, or equivalent cloud certificationsExperience implementing enterprise data governance and metadata management platformsExperience with real-time analytics, event‑driven architectures, and streaming data platformsKnowledge of modern data architecture patterns including Data Mesh, Lakehouse, and domain‑oriented designExperience leading large‑scale cloud transformation or enterprise data modernization programsTechnology Focus\r\nAWS , including S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, and Step Functions;AWS Bedrock ;Lake Formation ;Amazon Redshift ;KafkaandConfluent Kafka ;PySpark ,Python ,SQL ;dimensional modelinganddata vault ;Terraform ;GitHubandGitHub Actions ;AWS IAM ;Apache Airflow ;ETLandCI/CD ;Generative AI ;AzureandDatabricks ;LLMs ,RAG ,vector databases , andMLOps ;Spark .Location and Role Summary\r\nCharlotte, NC (Hybrid) . Lead Data Engineer role designed for candidates with deep AWS data engineering experience and the ability to lead architecture, delivery, and mentorship across enterprise initiatives.#J-18808-Ljbffr","company":"Bartech Staffing","rawCompany":"bartech staffing","city":"Charlotte","state":"NC","isRemote":false,"isActive":false,"createdAt":"2026-10-14T01:33:01.998Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Data Engineer","description":"The Lead Data Engineer will take technical ownership of enterprise data engineering initiatives, supporting end-to-end design, architecture, and delivery across AWS-based platforms. This hybrid role is based in Charlotte, NC, with a preference for local candidates.Key ResponsibilitiesLead the design, architecture, and implementation of enterprise data engineering solutions across the AWS ecosystemCollaborate with Lead Developers, Data Scientists, Architects, Product Owners, and business stakeholders to define technical strategy and scalable solutionsProvide technical leadership and mentorship to Data Engineers and development teams, promoting engineering excellence and best practicesDrive key architectural decisions with Data Architects and Solution Architects to support scalability, security, reliability, and maintainabilityDesign and oversee data warehouse and data lake solutions balancing business usability, performance, and long-term sustainabilityEstablish engineering standards for data modeling, ETL frameworks, pipeline reliability, monitoring, and operational excellenceLead end-to-end solution delivery, ensuring alignment with business requirements, enterprise architecture standards, and regulatory requirementsOversee production support and operational management of AWS-based data platforms, including root-cause analysis and performance optimizationChampion data quality, governance, observability, and data stewardship practices across platforms and teamsIdentify opportunities to modernize data architecture and improve operational efficiency through automation and cloud-native technologiesRequired Qualifications8+ years of experience in Data Engineering, including at least 5+ years working extensively within AWS ecosystemsExpert-level experience with AWS services including S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, and Step FunctionsExperience creating AI applications with AWS BedrockStrong experience designing and implementing enterprise-scale data lake and data warehouse solutions using Lake Formation, Amazon Redshift, and Amazon AthenaExtensive experience with Kafka-based streaming architectures, preferably Confluent KafkaAdvanced SQL and data modeling expertise, including dimensional modeling, data vault, and large-scale data warehousing solutionsDeep experience designing, developing, and optimizing scalable, resilient data pipelines within AWS environmentsStrong understanding of distributed data processing frameworks, particularly PySpark and EMRExpert knowledge of database management principles, performance tuning, and data architecture best practicesAdvanced Python development skills with extensive hands-on experience using PySparkExpertise in Infrastructure as Code using TerraformExperience designing and implementing CI/CD frameworks using GitHub and GitHub ActionsDeep knowledge of AWS IAM roles, policies, governance, and security best practicesStrong experience with workflow orchestration tools such as AWS Step Functions, Apache Airflow, or equivalent platformsExperience leading cloud migration, modernization, and enterprise data platform initiativesStrong understanding of data governance, metadata management, data quality frameworks, and observability principlesAbility to lead hands-on development while providing technical direction, code reviews, and engineering oversight across multiple initiativesExperience establishing development environments, infrastructure standards, security controls, and migration strategies across multiple AWS accounts and environmentsAbility to architect, develop, and govern enterprise-scale data pipelines, ETL processes, data ingestion frameworks, and orchestration workflowsProven ability to identify data gaps, define strategic remediation plans, and implement scalable automation solutions that improve analytical capabilities across the organizationAbility to design and implement highly reliable data pipelines with a focus on data quality, observability, resiliency, and operational supportabilityExperience building and optimizing large-scale data warehousing solutions that prioritize business user experience and system performanceAbility to drive technical decision-making, influence architectural direction, and communicate complex technical concepts to technical and non-technical stakeholdersProven track record mentoring engineers, fostering technical growth, and building high-performing data engineering teamsExperience leading cross-functional initiatives involving data engineering, analytics, architecture, platform engineering, and business stakeholdersStrong problem-solving and leadership skills, including managing competing priorities in fast-paced enterprise environmentsExperience building AI-ready data pipelines and ML workflows, including feature engineering and MLOpsProficiency in Python, SQL, Spark, and Generative AI technologies for scalable data and analytics solutionsHands‑on experience with AWS, Azure, or Databricks and cloud-based AI/data platformsKnowledge of LLMs, RAG, and vector databases to support AI-powered applications and intelligent searchStrong understanding of data governance, quality, security, and responsible AI practicesPreferred SkillsAWS Certified Data Engineer, AWS Solutions Architect, or equivalent cloud certificationsExperience implementing enterprise data governance and metadata management platformsExperience with real-time analytics, event‑driven architectures, and streaming data platformsKnowledge of modern data architecture patterns including Data Mesh, Lakehouse, and domain‑oriented designExperience leading large‑scale cloud transformation or enterprise data modernization programsTechnology Focus\r\nAWS , including S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, and Step Functions;AWS Bedrock ;Lake Formation ;Amazon Redshift ;KafkaandConfluent Kafka ;PySpark ,Python ,SQL ;dimensional modelinganddata vault ;Terraform ;GitHubandGitHub Actions ;AWS IAM ;Apache Airflow ;ETLandCI/CD ;Generative AI ;AzureandDatabricks ;LLMs ,RAG ,vector databases , andMLOps ;Spark .Location and Role Summary\r\nCharlotte, NC (Hybrid) . Lead Data Engineer role designed for candidates with deep AWS data engineering experience and the ability to lead architecture, delivery, and mentorship across enterprise initiatives.#J-18808-Ljbffr","datePosted":"2026-10-14T01:33:01.998Z","dateModified":"2026-10-14T01:33:01.998Z","hiringOrganization":{"@type":"Organization","name":"Bartech Staffing","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Charlotte","addressRegion":"NC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"f57ece82a45253f66f3fb3a5"},"url":"https://jobsearcher.com/jobs/f57ece82a45253f66f3fb3a5"}}