{"schemaVersion":"jobsearcher.job.v1","id":"b2530c4841ecd008e1d2157f","url":"https://jobsearcher.com/jobs/b2530c4841ecd008e1d2157f","canonicalUrl":"https://jobsearcher.com/jobs/b2530c4841ecd008e1d2157f","title":"Data Engineering Lead","description":"HomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsHomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsJob DescriptionJob OverviewJob ID:J54228Job Title:Data Engineering LeadLocation:Irving, TXDuration:8 Months + ExtensionDomain Exposure:Utilities/ EnergyClient:To Be Discussed LaterEmployment Type:W-2, 1099, C2CWork Authorization:US Citizen, Green Card, H-1B, OPT-EAD, CPT, OtherView All JobsSimilar JobsData Engineer - Tampa, FLData Analyst - Philadelphia, PASenior Data Engineer - Charlotte,, NCData Scientist - San Francisco, CAAzure Data Architect - Atlanta, GAJob Title: Data Engineering LeadLocation: Irving, TXDuration: 8 Months + ExtensionBill Rate: $74/hour (C2C)Job Type: W-2, 1099, C2CClient: To Be Discussed LaterWork Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, OtherJob Description: Actively collaborate with Principal Software Engineers and DataArchitects to define solution architecture Lead the solution design and optimization of scalable data pipelinesand microservices in Python, enabling both real-time and batch dataprocessing across enterprise platforms Drive the development of cloud-native data ingestion and streamingsolutions leveraging AWS services including Kinesis, S3, DynamoDB,EventBridge, and related technologies Own the design, implementation, and operational excellence of dataintegration frameworks and source data pipelines supporting CI Autonomyinitiatives Partner with business, product, and engineering stakeholders totranslate complex requirements into scalable data architectures,workflows, mappings, and system designs Establish and enforce automated testing, data quality controls, andvalidation frameworks to ensure integrity, reliability, and complianceacross distributed data ecosystems Lead operational monitoring, performance tuning, and root-causeanalysis of production data platforms using observability tools such asCloudWatch to maintain high availability and service reliability Bachelor’s degree in Computer Science, Computer Engineering, orrelated field 8+ years of experience in data engineering or related disciplineswith increasing responsibility Extensive experience on modern, large scale, complex Caterpillar dataplatforms such as Helios Data Platform Strong foundation developing and deploying Python solutions to aproduction environment Experience leading teams to build high-throughput, scalable datapipelines Strong hands-on experience with AWS data services (Kinesis, S3,DynamoDB, EventBridge, etc.) at scale Strong in SQL, including data quality and validation practices Experience in deploying software using CI/CD tools such as AzureDevOps, Jira, Jenkins, etc. Experience developing microservices that support real-time dataingestion Experience developing software applications using relational andnoSQL databases Ability to ensure data integrity across distributed and streamingsystems Experience with monitoring, testing, and automation in large-scaledata environmentsApply NowEqual Opportunity EmployerWe are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.Home|About|Adaptive AI|Industries|Consulting |Contact Us© 2004-2026, Machine Learning Technologies LLC, or its affiliates","company":"Machine Learning Technologies","rawCompany":"machine learning technologies","city":"Arlington","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-11-08T08:36:43.595Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541690","title":"Other Scientific and Technical Consulting Services","slug":"other-scientific-and-technical-consulting-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineering Lead","description":"HomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsHomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsJob DescriptionJob OverviewJob ID:J54228Job Title:Data Engineering LeadLocation:Irving, TXDuration:8 Months + ExtensionDomain Exposure:Utilities/ EnergyClient:To Be Discussed LaterEmployment Type:W-2, 1099, C2CWork Authorization:US Citizen, Green Card, H-1B, OPT-EAD, CPT, OtherView All JobsSimilar JobsData Engineer - Tampa, FLData Analyst - Philadelphia, PASenior Data Engineer - Charlotte,, NCData Scientist - San Francisco, CAAzure Data Architect - Atlanta, GAJob Title: Data Engineering LeadLocation: Irving, TXDuration: 8 Months + ExtensionBill Rate: $74/hour (C2C)Job Type: W-2, 1099, C2CClient: To Be Discussed LaterWork Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, OtherJob Description: Actively collaborate with Principal Software Engineers and DataArchitects to define solution architecture Lead the solution design and optimization of scalable data pipelinesand microservices in Python, enabling both real-time and batch dataprocessing across enterprise platforms Drive the development of cloud-native data ingestion and streamingsolutions leveraging AWS services including Kinesis, S3, DynamoDB,EventBridge, and related technologies Own the design, implementation, and operational excellence of dataintegration frameworks and source data pipelines supporting CI Autonomyinitiatives Partner with business, product, and engineering stakeholders totranslate complex requirements into scalable data architectures,workflows, mappings, and system designs Establish and enforce automated testing, data quality controls, andvalidation frameworks to ensure integrity, reliability, and complianceacross distributed data ecosystems Lead operational monitoring, performance tuning, and root-causeanalysis of production data platforms using observability tools such asCloudWatch to maintain high availability and service reliability Bachelor’s degree in Computer Science, Computer Engineering, orrelated field 8+ years of experience in data engineering or related disciplineswith increasing responsibility Extensive experience on modern, large scale, complex Caterpillar dataplatforms such as Helios Data Platform Strong foundation developing and deploying Python solutions to aproduction environment Experience leading teams to build high-throughput, scalable datapipelines Strong hands-on experience with AWS data services (Kinesis, S3,DynamoDB, EventBridge, etc.) at scale Strong in SQL, including data quality and validation practices Experience in deploying software using CI/CD tools such as AzureDevOps, Jira, Jenkins, etc. Experience developing microservices that support real-time dataingestion Experience developing software applications using relational andnoSQL databases Ability to ensure data integrity across distributed and streamingsystems Experience with monitoring, testing, and automation in large-scaledata environmentsApply NowEqual Opportunity EmployerWe are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.Home|About|Adaptive AI|Industries|Consulting |Contact Us© 2004-2026, Machine Learning Technologies LLC, or its affiliates","datePosted":"2026-11-08T08:36:43.595Z","dateModified":"2026-11-08T08:36:43.595Z","hiringOrganization":{"@type":"Organization","name":"Machine Learning Technologies","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Arlington","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"b2530c4841ecd008e1d2157f"},"url":"https://jobsearcher.com/jobs/b2530c4841ecd008e1d2157f"}}