Sr. Data Engineer IV

Overview In this role you will design, build, and operate scalable data pipelines in a cloud-based ecosystem to support inventory, supply, and yield analytics. You’ll modernize legacy data workflows, migrate systems, and deliver reliable data assets for analytics and reporting. You work closely with cross-functional teams to enable enterprise dashboards and data-driven decisions, including Tableau-driven insights. This position offers hands-on impact in a data modernization program with cloud-first architecture. ResponsibilitiesDesign, develop, test, and maintain scalable ETL pipelines using Databricks, Python, PySpark, AWS, and SnowflakeBuild data solutions for inventory, supply, and yield analyticsCreate core data assets and pipelines for enterprise reporting and analytics platforms (Tableau)Modernize legacy data jobs, contribute to cloud migration and debt reductionDocument technical specifications, tests, and QA processesProvide post-deployment support and troubleshoot production issues to ensure pipeline reliabilityIdentify SPOFs and improve platform stability and resiliencyDevelop and manage infrastructure with TerraformImplement CI/CD pipelines using GitHub Actions or ConcourseCollaborate with engineering teams and stakeholders in an Agile environmentParticipate in code reviews and knowledge sharingSupport continuous improvement initiatives Key requirementsExperience with Databricks, Python, PySpark, AWS, and SnowflakeStrong background in building and maintaining ETL/data pipelinesCloud migration and legacy modernization experienceFamiliarity with TerraformExperience setting up CI/CD pipelines (GitHub Actions or Concourse)Ability to troubleshoot production issues and ensure reliabilityCollaborative, cross-functional teamwork in an Agile settingAbility to interview onsite in Philadelphia, PA (remote role)collaborationproblem-solvingeffective communicationDatabricksPythonPySpark