Senior Data Engineer
You'll build and maintain data pipelines and datasets that support reporting, visualization, machine learning and data-driven decision making across finance, sales, supply chain, marketing and other business functionsYour responsibilities will include: Developing and maintaining scalable data pipelines and reusable datasets within a Databricks lakehouse environmentIngesting, validating, cleaning and transforming structured and unstructured data from multiple sources using Python, PySpark and SQLBuilding data models and reporting datasets that support Tableau and established analytics tools such as SpotfireIntegrating established data warehouse and reporting systems with modern cloud analytics platformsImproving pipeline reliability, data quality and processing performanceImplementing automated testing, monitoring, documentation and CI/CD practicesPartnering with analysts, architects, developers and business stakeholders to deliver practical data solutionsProviding technical guidance, reviewing code and mentoring other data engineerRequirements 7+ years of experience in data engineering, including building and supporting production data pipelinesStrong SQL skills and a solid understanding of data modeling, database design and data warehousingHands-on experience with Databricks, Apache Spark and cloud data platformsStrong proficiency in Python and PySparkExperience developing ETL/ELT pipelines and integrating data from multiple source systemsExperience preparing reliable datasets for Tableau or comparable business intelligence toolsFamiliarity with source control, automated testing and CI/CD practicesAbility to troubleshoot complex data issues and optimize pipeline performanceStrong communication skills and experience collaborating with technical teams and business stakeholdersExperience with Spotfire, Oracle, Informatica, R or data virtualization preferredDatabricks certification preferred