Data Engineer
Overview
As a Data Engineer on the Platform Data Engineering team, you will build Python data pipelines that create core business data objects for applications. You will work in a cross-functional setting to interpret design requirements and deliver reliable, scalable data solutions. You’ll deploy CI/CD pipelines and ensure quality through unit and integration testing, advancing the team's software engineering practices. This role combines hands-on development with collaboration to support Caterpillar's data-driven products and platforms. You’ll apply modern data and cloud technologies to impact how teams access and use data at scale.
Compensation / BenefitsMedical, dental, and vision benefitsPaid time off401(k) with matchingHealth Savings AccountFlexible Spending AccountsTuition Reimbursement
ResponsibilitiesDevelop and maintain Python data pipelines to build business data objectsBuild and deploy CI/CD pipelinesImplement source-to-target mapping as pipeline codePerform unit and integration testingIdentify and promote process improvements within the teamIndependently handle complex engineering problemsInterpret design requirements for implementationPerform other duties as assigned by management
Key requirementsPython software development experienceGit version controlCI/CD tooling experience (Jenkins, Github Actions, Azure DevOps)Experience with AWS components (Lambda, Dynamo, Fargate, S3, Sagemaker, IAM, RDS)Relational and/or NoSQL databases (PostgreSQL, DynamoDB, MongoDB, Oracle, etc.)Strong learning ability and staying current with technologiesExcellent communication and cross-functional collaborationstrong communicationcross-functional collaborationproactive learningPythonCI/CD toolsAWS services