{"schemaVersion":"jobsearcher.job.v1","id":"7be2cbf0fce633fe2abab516","url":"https://jobsearcher.com/jobs/7be2cbf0fce633fe2abab516","canonicalUrl":"https://jobsearcher.com/jobs/7be2cbf0fce633fe2abab516","title":"Sr. Data Engineer (SQL / Databricks / PySpark)","description":"Seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL, and Databricks to design, optimize, and deliver scalable cloud-based data solutions supporting analytics and enterprise data platforms\nExperience: Minimum 8+ Years\nLocation: Chicago, IL (Hybrid 3 days Work from Office)\nDuration: -12+ months\nEducational Qualifications: - Engineering Degree BE/ME/BTech/MTech/BSc/MSc. Technical certification in multiple technologies is desirable.\nMandatory skills\nETL / ELT Concepts: Strong understanding of pipeline patterns, incremental loads, data validation, and troubleshooting.\nSQL: Advanced querying (CTEs, views, joins, complex query logic) and performance tuning for transformations and validation. Python: Production-quality development (modular code, testing, logging, integration with APIs/files, CICD, Unit Test/Integration test automation, Code Coverage).\nPySpark: Distributed transformations and performance optimization (joins, partitions, debugging), CICD, Unit Test/Integration test automation, Code Coverage.\nAzure Data Factory (ADF): Build/operate ADF pipelines, parameterization, triggers, monitoring, retry/error handling; integrate with Databricks/ADLS.\nDatabricks: Develop and operationalize notebooks/jobs/workflows; Delta Lake patterns; basic cluster/job configuration.\nAzure Fundamentals + Pulumi: Hands-on with ADLS Gen2, Azure Portal, Storage Explorer, Resource Groups, Azure SQL, and familiarity integrating with Azure OpenAI. Able to use/maintain Pulumi scripts for provisioning and managing Azure resources across environments\nRoles and Responsibilities\nDesign, build, and support end-to-end data pipelines (ingestion, transformation, validation, publishing). Develop and optimize SQL and PySpark/Databricks transformations for large datasets.\nBuild production-grade Python components (reusable modules, logging, error handling, testing). Create and maintain Azure Data Factory (ADF) pipelines (triggers, parameterization, monitoring, failure handling).\nWork within Azure environments (ADLS Gen2, Azure SQL, resource groups, portal operations).\nProvision and maintain Azure components using Pulumi (Infrastructure as Code). Participate in code reviews, documentation, and operational support (triage + root cause analysis)\nNice to have skills: -\nAbility to support/translate validation rules with SQL scripts and create data quality reports. TypeScript: Useful for pulumi pipeline to create Azure components.\nJava: Useful for integration with existing services/components.\n.NET: Useful for integration with existing services/components. Angular / Spring Boot: Minor troubleshooting or coordination with app teams.\nDomain : Clinical (Health care)\n\nVeeRteq Solutions is an Equal Opportunity Employer","company":"Veerteq Solutions","rawCompany":"veerteq solutions","city":"Chicago","state":"IL","isRemote":false,"isActive":false,"createdAt":"2026-08-03T18:12:54.656Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Sr. Data Engineer (SQL / Databricks / PySpark)","description":"Seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL, and Databricks to design, optimize, and deliver scalable cloud-based data solutions supporting analytics and enterprise data platforms\nExperience: Minimum 8+ Years\nLocation: Chicago, IL (Hybrid 3 days Work from Office)\nDuration: -12+ months\nEducational Qualifications: - Engineering Degree BE/ME/BTech/MTech/BSc/MSc. Technical certification in multiple technologies is desirable.\nMandatory skills\nETL / ELT Concepts: Strong understanding of pipeline patterns, incremental loads, data validation, and troubleshooting.\nSQL: Advanced querying (CTEs, views, joins, complex query logic) and performance tuning for transformations and validation. Python: Production-quality development (modular code, testing, logging, integration with APIs/files, CICD, Unit Test/Integration test automation, Code Coverage).\nPySpark: Distributed transformations and performance optimization (joins, partitions, debugging), CICD, Unit Test/Integration test automation, Code Coverage.\nAzure Data Factory (ADF): Build/operate ADF pipelines, parameterization, triggers, monitoring, retry/error handling; integrate with Databricks/ADLS.\nDatabricks: Develop and operationalize notebooks/jobs/workflows; Delta Lake patterns; basic cluster/job configuration.\nAzure Fundamentals + Pulumi: Hands-on with ADLS Gen2, Azure Portal, Storage Explorer, Resource Groups, Azure SQL, and familiarity integrating with Azure OpenAI. Able to use/maintain Pulumi scripts for provisioning and managing Azure resources across environments\nRoles and Responsibilities\nDesign, build, and support end-to-end data pipelines (ingestion, transformation, validation, publishing). Develop and optimize SQL and PySpark/Databricks transformations for large datasets.\nBuild production-grade Python components (reusable modules, logging, error handling, testing). Create and maintain Azure Data Factory (ADF) pipelines (triggers, parameterization, monitoring, failure handling).\nWork within Azure environments (ADLS Gen2, Azure SQL, resource groups, portal operations).\nProvision and maintain Azure components using Pulumi (Infrastructure as Code). Participate in code reviews, documentation, and operational support (triage + root cause analysis)\nNice to have skills: -\nAbility to support/translate validation rules with SQL scripts and create data quality reports. TypeScript: Useful for pulumi pipeline to create Azure components.\nJava: Useful for integration with existing services/components.\n.NET: Useful for integration with existing services/components. Angular / Spring Boot: Minor troubleshooting or coordination with app teams.\nDomain : Clinical (Health care)\n\nVeeRteq Solutions is an Equal Opportunity Employer","datePosted":"2026-08-03T18:12:54.656Z","dateModified":"2026-08-03T18:12:54.656Z","hiringOrganization":{"@type":"Organization","name":"Veerteq Solutions","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Chicago","addressRegion":"IL","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"7be2cbf0fce633fe2abab516"},"url":"https://jobsearcher.com/jobs/7be2cbf0fce633fe2abab516"}}