{"schemaVersion":"jobsearcher.job.v1","id":"02e89fdfdeb4bc5d990fdabf","url":"https://jobsearcher.com/jobs/02e89fdfdeb4bc5d990fdabf","canonicalUrl":"https://jobsearcher.com/jobs/02e89fdfdeb4bc5d990fdabf","title":"Senior Data Engineer – Physical AI Platform, Data Engineering","description":"Overview\nAs a Senior Data Engineer at Caterpillar, you design and operate scalable data platforms and pipelines to deliver high-quality data for cross-functional teams. You will work in an agile environment to improve data architecture, reliability, and performance at scale. You’ll collaborate with software engineers, data architects, and stakeholders to translate requirements into robust, cloud-native solutions that support autonomous construction initiatives. This role offers impact on safety, productivity, and the evolution of data-driven construction technologies.\n\nCompensation / BenefitsMedical, dental, and vision benefitsPaid time off (vacation, holidays, volunteering)401(k)Health Savings Account (HSA)Flexible Spending Accounts (FSAs)Career development\nResponsibilitiesDefine and implement solution architecture with lead engineersDevelop scalable data pipelines and microservices in Python for real-time and batch processingLead cloud-native data ingestion and streaming using AWS services (Kinesis, S3, DynamoDB, EventBridge)Design and operate data integration frameworks and pipelines for CI Autonomy initiativesCollaborate with business, product, and engineering stakeholders to translate requirements into scalable architecturesEstablish automated testing, data quality controls, and validation frameworksImplement monitoring and performance tuning using observability tools (CloudWatch) to ensure availability and reliability\nKey requirements5+ years in data engineering or related rolesStrong Python and Java backend development experienceProven experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge) at scaleExperience leading data engineering solutions in Agile environments (CI/CD familiarity)Hands-on with microservices, data pipelines, APIs, and databases (relational and NoSQL)Ability to ensure data integrity across distributed/streaming systemsExperience with monitoring, testing, and automation in large-scale data environmentsEffective communication across teamsCollaborative mindsetProblem solving and critical thinkingPythonJavaAWS data services (Kinesis, S3, DynamoDB, EventBridge)","company":"Caterpillar","rawCompany":"caterpillar","city":"Evanston","state":"IL","isRemote":false,"isActive":false,"createdAt":"2026-09-15T05:13:49.936Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Engineer – Physical AI Platform, Data Engineering","description":"Overview\nAs a Senior Data Engineer at Caterpillar, you design and operate scalable data platforms and pipelines to deliver high-quality data for cross-functional teams. You will work in an agile environment to improve data architecture, reliability, and performance at scale. You’ll collaborate with software engineers, data architects, and stakeholders to translate requirements into robust, cloud-native solutions that support autonomous construction initiatives. This role offers impact on safety, productivity, and the evolution of data-driven construction technologies.\n\nCompensation / BenefitsMedical, dental, and vision benefitsPaid time off (vacation, holidays, volunteering)401(k)Health Savings Account (HSA)Flexible Spending Accounts (FSAs)Career development\nResponsibilitiesDefine and implement solution architecture with lead engineersDevelop scalable data pipelines and microservices in Python for real-time and batch processingLead cloud-native data ingestion and streaming using AWS services (Kinesis, S3, DynamoDB, EventBridge)Design and operate data integration frameworks and pipelines for CI Autonomy initiativesCollaborate with business, product, and engineering stakeholders to translate requirements into scalable architecturesEstablish automated testing, data quality controls, and validation frameworksImplement monitoring and performance tuning using observability tools (CloudWatch) to ensure availability and reliability\nKey requirements5+ years in data engineering or related rolesStrong Python and Java backend development experienceProven experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge) at scaleExperience leading data engineering solutions in Agile environments (CI/CD familiarity)Hands-on with microservices, data pipelines, APIs, and databases (relational and NoSQL)Ability to ensure data integrity across distributed/streaming systemsExperience with monitoring, testing, and automation in large-scale data environmentsEffective communication across teamsCollaborative mindsetProblem solving and critical thinkingPythonJavaAWS data services (Kinesis, S3, DynamoDB, EventBridge)","datePosted":"2026-09-15T05:13:49.936Z","dateModified":"2026-09-15T05:13:49.936Z","hiringOrganization":{"@type":"Organization","name":"Caterpillar","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Evanston","addressRegion":"IL","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"02e89fdfdeb4bc5d990fdabf"},"url":"https://jobsearcher.com/jobs/02e89fdfdeb4bc5d990fdabf"}}