{"schemaVersion":"jobsearcher.job.v1","id":"c636c72bb345f0dd6f402a5c","url":"https://jobsearcher.com/jobs/c636c72bb345f0dd6f402a5c","canonicalUrl":"https://jobsearcher.com/jobs/c636c72bb345f0dd6f402a5c","title":"Lead Data Engineer","description":"Location\n\nUnited States\n\nStart and end date\n\n12 Oct 2026 – 24 Oct 2027\n\nIndicative hourly rate\n\n$80 – 85/hr\n\nRespond by\n\n10 Oct 2026\n\nSkills\n\nSecurity Controls, Machine learning, Architecture, Enterprise Data Management, Python programming, Data, Confluent, Amazon, Feature engineering, Data streaming, Data Quality, Code reviews, EcoSYSTEMS, Identity and access management, Extract/transform/load, System Migration, Software applications, PySpark, Artificial Intelligence, SQL, Cloud Migration, Performance tuning, Language models, airflow, Business Analytics, Engineering, Data Governance, Data Architecture, Data analysis, Data management, Github, Apache Spark, Data warehousing, Vector, Distributed Computing Environment, Apache Kafka, Cloud Engineering, Continuous Delivery, Analytics, Databricks, Big Data, Event Driven Architecture, Infrastructure management, Supervision, Data modelling, Microsoft, CloudWatch, Planning, Workflow Management Systems, Amazon S3, Database administrationSecurity Controls, Machine learning, Architecture, Enterprise Data Management, Python programming, Data, Confluent, Amazon, Feature engineering, Data streaming, Data Quality, Code reviews, EcoSYSTEMS, Identity and access management, Extract/transform/load, System Migration, Software applications, PySpark, Artificial Intelligence, SQL, Cloud Migration, Performance tuning, Language models, airflow, Business Analytics, Engineering, Data Governance, Data Architecture, Data analysis, Data management, Github, Apache Spark, Data warehousing, Vector, Distributed Computing Environment, Apache Kafka, Cloud Engineering, Continuous Delivery, Analytics, Databricks, Big Data, Event Driven Architecture, Infrastructure management, Supervision, Data modelling, Microsoft, CloudWatch, Planning, Workflow Management Systems, Amazon S3, Database administration View all\nHybrid to Charlotte is preferred\nLead Data Engineer\nCore Technical Skills\n8+ years of experience in Data Engineering with at least 5+ years working extensively within AWS ecosystems\nExpert-level experience with AWS services including S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, and Step Functions\nExperience creating AI applications with AWS Bedrock\nStrong experience designing and implementing enterprise-scale data lake and data warehouse solutions using Lake Formation, Amazon Redshift, and Amazon Athena\nExtensive experience with Kafka-based streaming architectures, preferably Confluent Kafka\nAdvanced SQL and data modeling expertise, including dimensional modeling, data vault, and large-scale data warehousing solutions\nDeep experience designing, developing, and optimizing scalable, resilient data pipelines within AWS environments\nStrong understanding of distributed data processing frameworks, particularly PySpark and EMR\nExpert knowledge of database management principles, performance tuning, and data architecture best practices\nAdvanced Python development skills with extensive hands-on experience using PySpark\nExpertise in Infrastructure as Code using Terraform\nExperience designing and implementing CI/CD frameworks using GitHub and GitHub Actions\nDeep knowledge of AWS IAM roles, policies, governance, and security best practices\nStrong experience with workflow orchestration tools such as AWS Step Functions, Apache Airflow, or equivalent platforms\nExperience leading cloud migration, modernization, and enterprise data platform initiatives\nStrong understanding of data governance, metadata management, data quality frameworks, and observability principles\nCore Responsibilities\nLead the design, architecture, and implementation of enterprise data engineering solutions across the AWS ecosystem\nCollaborate with Lead Developers, Data Scientists, Architects, Product Owners, and business stakeholders to define technical strategy and scalable solutions\nProvide technical leadership and mentorship to Data Engineers and development teams, promoting engineering excellence and best practices\nDrive key architectural decisions in partnership with Data Architects and Solution Architects to ensure scalability, security, reliability, and maintainability\nDesign and oversee data warehouse and data lake solutions that balance business usability, performance, and long-term sustainability\nEstablish engineering standards for data modeling, ETL frameworks, pipeline reliability, monitoring, and operational excellence\nLead end-to-end solution delivery, ensuring alignment with business requirements, enterprise architecture standards, and regulatory requirements\nOversee production support and operational management of AWS-based data platforms, driving root-cause analysis and performance optimization initiatives\nChampion data quality, governance, observability, and data stewardship practices across platforms and teams\nIdentify opportunities to modernize data architecture and improve operational efficiency through automation and cloud-native technologies\nCore Experience and Abilities\nAbility to lead hands-on development efforts while providing technical direction, code reviews, and engineering oversight across multiple initiatives\nExperience establishing development environments, infrastructure standards, security controls, and migration strategies across multiple AWS accounts and environments\nAbility to architect, develop, and govern enterprise-scale data pipelines, ETL processes, data ingestion frameworks, and orchestration workflows\nProven ability to identify data gaps, define strategic remediation plans, and implement scalable automation solutions that improve analytical capabilities across the organization\nAbility to design and implement highly reliable data pipelines with strong focus on data quality, observability, resiliency, and operational supportability\nExperience building and optimizing large-scale data warehousing solutions that prioritize both business user experience and system performance\nAbility to drive technical decision-making, influence architectural direction, and effectively communicate complex technical concepts to both technical and non-technical stakeholders\nProven track record mentoring engineers, fostering technical growth, and building high-performing data engineering teams\nExperience leading cross-functional initiatives involving data engineering, analytics, architecture, platform engineering, and business stakeholders\nStrong problem-solving and leadership skills with the ability to manage competing priorities in fast-paced enterprise environments\nExperience building AI-ready data pipelines and ML workflows, including feature engineering and MLOps\nProficiency in Python, SQL, Spark, and Generative AI technologies for scalable data and analytics solutions\nHands-on experience with AWS, Azure, or Databricks and cloud-based AI/data platforms\nKnowledge of LLMs, RAG, and vector databases to support AI-powered applications and intelligent search\nStrong understanding of data governance, quality, security, and responsible AI practices\nPreferred Qualifications\nAWS Certified Data Engineer, AWS Solutions Architect, or equivalent cloud certifications\nExperience implementing enterprise data governance and metadata management platforms\nExperience with real-time analytics, event-driven architectures, and streaming data platforms\nKnowledge of modern data architecture patterns including Data Mesh, Lakehouse, and domain-oriented design\nExperience leading large-scale cloud transformation or enterprise data modernization programs\nRequirements\nSkills\nSecurity Controls — Intermediate\nMachine learning — Intermediate\nArchitecture — Intermediate\nEnterprise Data Management — Intermediate\nPython programming — Intermediate\nData — Intermediate\nConfluent — Intermediate\nAmazon — Intermediate\nFeature engineering — Intermediate\nData streaming — Intermediate\nData Quality — Intermediate\nCode reviews — Intermediate\nEcoSYSTEMS — Intermediate\nIdentity and access management — Intermediate\nExtract/transform/load — Intermediate\nSystem Migration — Intermediate\nSoftware applications — Intermediate\nPySpark — Nice to have\nArtificial Intelligence — Intermediate\nSQL — Intermediate\nCloud Migration — Intermediate\nPerformance tuning — Intermediate\nLanguage models — Intermediate\nairflow — Intermediate\nBusiness Analytics — Intermediate\nEngineering — Intermediate\nData Governance — Intermediate\nData Architecture — Intermediate\nData analysis — Intermediate\nData management — Intermediate\nGithub — Intermediate\nApache Spark — Intermediate\nData warehousing — Intermediate\nVector — Intermediate\nDistributed Computing Environment — Intermediate\nApache Kafka — Intermediate\nCloud Engineering — Intermediate\nContinuous Delivery — Intermediate\nAnalytics — Intermediate\nDatabricks — Intermediate\nBig Data — Intermediate\nEvent Driven Architecture — Intermediate\nInfrastructure management — Intermediate\nSupervision — Intermediate\nData modelling — Intermediate\nMicrosoft — Intermediate\nCloudWatch — Intermediate\nPlanning — Intermediate\nWorkflow Management Systems — Intermediate\nAmazon S3 — Intermediate\nDatabase administration — Nice to have\nLanguages\nEnglish — Professional working proficiency","company":"Vertage","rawCompany":"vertage","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-09-26T09:00:11.803Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Data Engineer","description":"Location\n\nUnited States\n\nStart and end date\n\n12 Oct 2026 – 24 Oct 2027\n\nIndicative hourly rate\n\n$80 – 85/hr\n\nRespond by\n\n10 Oct 2026\n\nSkills\n\nSecurity Controls, Machine learning, Architecture, Enterprise Data Management, Python programming, Data, Confluent, Amazon, Feature engineering, Data streaming, Data Quality, Code reviews, EcoSYSTEMS, Identity and access management, Extract/transform/load, System Migration, Software applications, PySpark, Artificial Intelligence, SQL, Cloud Migration, Performance tuning, Language models, airflow, Business Analytics, Engineering, Data Governance, Data Architecture, Data analysis, Data management, Github, Apache Spark, Data warehousing, Vector, Distributed Computing Environment, Apache Kafka, Cloud Engineering, Continuous Delivery, Analytics, Databricks, Big Data, Event Driven Architecture, Infrastructure management, Supervision, Data modelling, Microsoft, CloudWatch, Planning, Workflow Management Systems, Amazon S3, Database administrationSecurity Controls, Machine learning, Architecture, Enterprise Data Management, Python programming, Data, Confluent, Amazon, Feature engineering, Data streaming, Data Quality, Code reviews, EcoSYSTEMS, Identity and access management, Extract/transform/load, System Migration, Software applications, PySpark, Artificial Intelligence, SQL, Cloud Migration, Performance tuning, Language models, airflow, Business Analytics, Engineering, Data Governance, Data Architecture, Data analysis, Data management, Github, Apache Spark, Data warehousing, Vector, Distributed Computing Environment, Apache Kafka, Cloud Engineering, Continuous Delivery, Analytics, Databricks, Big Data, Event Driven Architecture, Infrastructure management, Supervision, Data modelling, Microsoft, CloudWatch, Planning, Workflow Management Systems, Amazon S3, Database administration View all\nHybrid to Charlotte is preferred\nLead Data Engineer\nCore Technical Skills\n8+ years of experience in Data Engineering with at least 5+ years working extensively within AWS ecosystems\nExpert-level experience with AWS services including S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, and Step Functions\nExperience creating AI applications with AWS Bedrock\nStrong experience designing and implementing enterprise-scale data lake and data warehouse solutions using Lake Formation, Amazon Redshift, and Amazon Athena\nExtensive experience with Kafka-based streaming architectures, preferably Confluent Kafka\nAdvanced SQL and data modeling expertise, including dimensional modeling, data vault, and large-scale data warehousing solutions\nDeep experience designing, developing, and optimizing scalable, resilient data pipelines within AWS environments\nStrong understanding of distributed data processing frameworks, particularly PySpark and EMR\nExpert knowledge of database management principles, performance tuning, and data architecture best practices\nAdvanced Python development skills with extensive hands-on experience using PySpark\nExpertise in Infrastructure as Code using Terraform\nExperience designing and implementing CI/CD frameworks using GitHub and GitHub Actions\nDeep knowledge of AWS IAM roles, policies, governance, and security best practices\nStrong experience with workflow orchestration tools such as AWS Step Functions, Apache Airflow, or equivalent platforms\nExperience leading cloud migration, modernization, and enterprise data platform initiatives\nStrong understanding of data governance, metadata management, data quality frameworks, and observability principles\nCore Responsibilities\nLead the design, architecture, and implementation of enterprise data engineering solutions across the AWS ecosystem\nCollaborate with Lead Developers, Data Scientists, Architects, Product Owners, and business stakeholders to define technical strategy and scalable solutions\nProvide technical leadership and mentorship to Data Engineers and development teams, promoting engineering excellence and best practices\nDrive key architectural decisions in partnership with Data Architects and Solution Architects to ensure scalability, security, reliability, and maintainability\nDesign and oversee data warehouse and data lake solutions that balance business usability, performance, and long-term sustainability\nEstablish engineering standards for data modeling, ETL frameworks, pipeline reliability, monitoring, and operational excellence\nLead end-to-end solution delivery, ensuring alignment with business requirements, enterprise architecture standards, and regulatory requirements\nOversee production support and operational management of AWS-based data platforms, driving root-cause analysis and performance optimization initiatives\nChampion data quality, governance, observability, and data stewardship practices across platforms and teams\nIdentify opportunities to modernize data architecture and improve operational efficiency through automation and cloud-native technologies\nCore Experience and Abilities\nAbility to lead hands-on development efforts while providing technical direction, code reviews, and engineering oversight across multiple initiatives\nExperience establishing development environments, infrastructure standards, security controls, and migration strategies across multiple AWS accounts and environments\nAbility to architect, develop, and govern enterprise-scale data pipelines, ETL processes, data ingestion frameworks, and orchestration workflows\nProven ability to identify data gaps, define strategic remediation plans, and implement scalable automation solutions that improve analytical capabilities across the organization\nAbility to design and implement highly reliable data pipelines with strong focus on data quality, observability, resiliency, and operational supportability\nExperience building and optimizing large-scale data warehousing solutions that prioritize both business user experience and system performance\nAbility to drive technical decision-making, influence architectural direction, and effectively communicate complex technical concepts to both technical and non-technical stakeholders\nProven track record mentoring engineers, fostering technical growth, and building high-performing data engineering teams\nExperience leading cross-functional initiatives involving data engineering, analytics, architecture, platform engineering, and business stakeholders\nStrong problem-solving and leadership skills with the ability to manage competing priorities in fast-paced enterprise environments\nExperience building AI-ready data pipelines and ML workflows, including feature engineering and MLOps\nProficiency in Python, SQL, Spark, and Generative AI technologies for scalable data and analytics solutions\nHands-on experience with AWS, Azure, or Databricks and cloud-based AI/data platforms\nKnowledge of LLMs, RAG, and vector databases to support AI-powered applications and intelligent search\nStrong understanding of data governance, quality, security, and responsible AI practices\nPreferred Qualifications\nAWS Certified Data Engineer, AWS Solutions Architect, or equivalent cloud certifications\nExperience implementing enterprise data governance and metadata management platforms\nExperience with real-time analytics, event-driven architectures, and streaming data platforms\nKnowledge of modern data architecture patterns including Data Mesh, Lakehouse, and domain-oriented design\nExperience leading large-scale cloud transformation or enterprise data modernization programs\nRequirements\nSkills\nSecurity Controls — Intermediate\nMachine learning — Intermediate\nArchitecture — Intermediate\nEnterprise Data Management — Intermediate\nPython programming — Intermediate\nData — Intermediate\nConfluent — Intermediate\nAmazon — Intermediate\nFeature engineering — Intermediate\nData streaming — Intermediate\nData Quality — Intermediate\nCode reviews — Intermediate\nEcoSYSTEMS — Intermediate\nIdentity and access management — Intermediate\nExtract/transform/load — Intermediate\nSystem Migration — Intermediate\nSoftware applications — Intermediate\nPySpark — Nice to have\nArtificial Intelligence — Intermediate\nSQL — Intermediate\nCloud Migration — Intermediate\nPerformance tuning — Intermediate\nLanguage models — Intermediate\nairflow — Intermediate\nBusiness Analytics — Intermediate\nEngineering — Intermediate\nData Governance — Intermediate\nData Architecture — Intermediate\nData analysis — Intermediate\nData management — Intermediate\nGithub — Intermediate\nApache Spark — Intermediate\nData warehousing — Intermediate\nVector — Intermediate\nDistributed Computing Environment — Intermediate\nApache Kafka — Intermediate\nCloud Engineering — Intermediate\nContinuous Delivery — Intermediate\nAnalytics — Intermediate\nDatabricks — Intermediate\nBig Data — Intermediate\nEvent Driven Architecture — Intermediate\nInfrastructure management — Intermediate\nSupervision — Intermediate\nData modelling — Intermediate\nMicrosoft — Intermediate\nCloudWatch — Intermediate\nPlanning — Intermediate\nWorkflow Management Systems — Intermediate\nAmazon S3 — Intermediate\nDatabase administration — Nice to have\nLanguages\nEnglish — Professional working proficiency","datePosted":"2026-09-26T09:00:11.803Z","dateModified":"2026-09-26T09:00:11.803Z","hiringOrganization":{"@type":"Organization","name":"Vertage","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"c636c72bb345f0dd6f402a5c"},"url":"https://jobsearcher.com/jobs/c636c72bb345f0dd6f402a5c"}}