{"schemaVersion":"jobsearcher.job.v1","id":"d15762d34eda62df6daa889a","url":"https://jobsearcher.com/jobs/d15762d34eda62df6daa889a","canonicalUrl":"https://jobsearcher.com/jobs/d15762d34eda62df6daa889a","title":"Sr. Data Engineer","description":"JOB DESCRIPTION\nJoin our team as a Sr. Data Engineer in a hybrid role based in the Madison, WI area! We're looking for someone passionate about data, with hands-on experience in Databricks, SQL Server, SSIS, and SSRS, to help drive impactful reporting and robust data solutions. If you're energized by solving complex data challenges and enjoy working collaboratively, we encourage you to apply.\n\nThe Sr. Data Engineer is responsible for the design, development, and maintenance of data integration and reporting solutions. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles.\nResponsibilities\nData Integration\nDesign, develop, and maintain robust and efficient ETL pipelines and processes on Databricks.\nTroubleshoot and resolve Databricks pipeline errors and performance issues.\nMaintain legacy SSIS packages for ETL processes.\nTroubleshoot and resolve SSIS package errors and performance issues.\nOptimize data flow performance and minimize data latency.\nImplement data quality checks and validations within ETL processes.\nDatabricks Development\nDevelop and maintain Databricks pipelines and datasets using Python, Spark and SQL.\nMigrate legacy SSIS packages to Databricks pipelines.\nOptimize Databricks jobs for performance and cost-effectiveness.\nIntegrate Databricks with other data sources and systems.\nParticipate in the design and implementation of data lake architectures.\nImplement DevOps best practices for data pipelines, including CI/CD, monitoring, observability, and automated testing.\nIntegrate data ingestion from multiple sources (API, streaming, batch, databases) into centralized data platforms.\nUse Terraform/CloudFormation (or similar IaC tools) for provisioning Databricks clusters, cloud infrastructure, and networking components.\nImprove system performance and cost efficiency through monitoring, autoscaling, and cluster configurations.\nProvide mentorship and technical guidance to junior data engineers and collaborate with cross-functional teams.\nData Warehousing\nParticipate in the design and implementation of data warehousing solutions.\nSupport data quality initiatives and implement data cleansing procedures.\nReporting and Analytics\nCollaborate with business users to understand data requirements for department driven reporting needs.\nMaintain existing library of complex SSRS reports, dashboards, and visualizations.\nTroubleshoot and resolve SSRS report issues, including performance bottlenecks and data inconsistencies.\nCollaboration and Communication\nComfortable in entrepreneurial, self-starting, and fast-paced environment, working both independently and with our highly skilled teams.\nCollaborate effectively with business users, data analysts, and other IT teams.\nCommunicate technical information clearly and concisely, both verbally and in writing.\nDocument all development work and procedures thoroughly.\nContinuous Growth\nKeep abreast of the latest advancements in data integration, reporting, and data engineering technologies.\nContinuously improve skills and knowledge through training and self-learning.\nRequirements\nBachelor's degree in computer science, Information Systems, or a related field.\n7+ years of experience in data integration and reporting.\nExtensive experience with Databricks, including Python, Spark, and Delta Lake.\nStrong proficiency in SQL Server, including T-SQL, stored procedures, and functions.\nExperience with SSIS (SQL Server Integration Services) development and maintenance.\nExperience with SSRS (SQL Server Reporting Services) report design and development.\nExperience with data warehousing concepts and best practices.\nExperience with Microsoft Azure cloud platform and Microsoft Fabric desirable.\nStrong analytical and problem-solving skills.\nExcellent communication and interpersonal skills.\nAbility to work independently and as part of a team.\nExperience with Agile methodologies.\nMust be legally authorized to work in the United States.","company":"Agsource","rawCompany":"agsource","city":"Madison","state":"WI","isRemote":false,"isActive":false,"createdAt":"2026-07-15T12:28:44.082Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541714","title":"Research and Development in Biotechnology (except Nanobiotechnology)","slug":"research-and-development-in-biotechnology-except-nanobiotechnology"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Sr. Data Engineer","description":"JOB DESCRIPTION\nJoin our team as a Sr. Data Engineer in a hybrid role based in the Madison, WI area! We're looking for someone passionate about data, with hands-on experience in Databricks, SQL Server, SSIS, and SSRS, to help drive impactful reporting and robust data solutions. If you're energized by solving complex data challenges and enjoy working collaboratively, we encourage you to apply.\n\nThe Sr. Data Engineer is responsible for the design, development, and maintenance of data integration and reporting solutions. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles.\nResponsibilities\nData Integration\nDesign, develop, and maintain robust and efficient ETL pipelines and processes on Databricks.\nTroubleshoot and resolve Databricks pipeline errors and performance issues.\nMaintain legacy SSIS packages for ETL processes.\nTroubleshoot and resolve SSIS package errors and performance issues.\nOptimize data flow performance and minimize data latency.\nImplement data quality checks and validations within ETL processes.\nDatabricks Development\nDevelop and maintain Databricks pipelines and datasets using Python, Spark and SQL.\nMigrate legacy SSIS packages to Databricks pipelines.\nOptimize Databricks jobs for performance and cost-effectiveness.\nIntegrate Databricks with other data sources and systems.\nParticipate in the design and implementation of data lake architectures.\nImplement DevOps best practices for data pipelines, including CI/CD, monitoring, observability, and automated testing.\nIntegrate data ingestion from multiple sources (API, streaming, batch, databases) into centralized data platforms.\nUse Terraform/CloudFormation (or similar IaC tools) for provisioning Databricks clusters, cloud infrastructure, and networking components.\nImprove system performance and cost efficiency through monitoring, autoscaling, and cluster configurations.\nProvide mentorship and technical guidance to junior data engineers and collaborate with cross-functional teams.\nData Warehousing\nParticipate in the design and implementation of data warehousing solutions.\nSupport data quality initiatives and implement data cleansing procedures.\nReporting and Analytics\nCollaborate with business users to understand data requirements for department driven reporting needs.\nMaintain existing library of complex SSRS reports, dashboards, and visualizations.\nTroubleshoot and resolve SSRS report issues, including performance bottlenecks and data inconsistencies.\nCollaboration and Communication\nComfortable in entrepreneurial, self-starting, and fast-paced environment, working both independently and with our highly skilled teams.\nCollaborate effectively with business users, data analysts, and other IT teams.\nCommunicate technical information clearly and concisely, both verbally and in writing.\nDocument all development work and procedures thoroughly.\nContinuous Growth\nKeep abreast of the latest advancements in data integration, reporting, and data engineering technologies.\nContinuously improve skills and knowledge through training and self-learning.\nRequirements\nBachelor's degree in computer science, Information Systems, or a related field.\n7+ years of experience in data integration and reporting.\nExtensive experience with Databricks, including Python, Spark, and Delta Lake.\nStrong proficiency in SQL Server, including T-SQL, stored procedures, and functions.\nExperience with SSIS (SQL Server Integration Services) development and maintenance.\nExperience with SSRS (SQL Server Reporting Services) report design and development.\nExperience with data warehousing concepts and best practices.\nExperience with Microsoft Azure cloud platform and Microsoft Fabric desirable.\nStrong analytical and problem-solving skills.\nExcellent communication and interpersonal skills.\nAbility to work independently and as part of a team.\nExperience with Agile methodologies.\nMust be legally authorized to work in the United States.","datePosted":"2026-07-15T12:28:44.082Z","dateModified":"2026-07-15T12:28:44.082Z","hiringOrganization":{"@type":"Organization","name":"Agsource","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Madison","addressRegion":"WI","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"d15762d34eda62df6daa889a"},"url":"https://jobsearcher.com/jobs/d15762d34eda62df6daa889a"}}