{"schemaVersion":"jobsearcher.job.v1","id":"abb3ab4833fcb3e18ceeedc1","url":"https://jobsearcher.com/jobs/abb3ab4833fcb3e18ceeedc1","canonicalUrl":"https://jobsearcher.com/jobs/abb3ab4833fcb3e18ceeedc1","title":"Data Engineer","description":"Location: Chicago-IL - Hybrid 3 days at On-siteDuration: 6 monthsRole Descriptions:Key ResponsibilitiesPipeline Development - Design, implement, and optimize scalable ETL/ELT pipelines using Databricks (PySpark, SQL, Delta Lake) to ingest structured and semi structured data from multiple sources (APIs, databases, streaming).Data Warehousing - Build and maintain cloud data warehouse solutions (Snowflake / Azure Synapse) - design star schemas, fact/dimension tables, and aggregate tables for high performance reporting.Data Modeling - Create logical and physical data models for operational and analytical use cases; implement SCD Type 2, slowly changing dimensions, and data vault methodologies where appropriate.Performance Tuning - Optimize Spark jobs, SQL queries, and data partitioning strategies to handle petabyte scale data with low latency.Governance & Quality - Implement data quality checks, monitoring, and lineage using tools like Great Expectations or custom frameworks; enforce data governance policies (GDPR/CCPA).Collaboration - Partner with data analysts, product managers, and engineers to translate business requirements into technical data solutions.CI/CD & Automation - Automate deployment of data pipelines using Azure DevOps or GitHub Actions; maintain infrastructure as code (Terraform) for data resources.Required Skills & ExperienceTotal Experience: 10+ years in data engineering or related roles.Cloud Data Platforms: Deep hands on experience with Databricks (notebooks, jobs, clusters, Delta Lake, Unity Catalog) - must have production level work.Data Warehousing: Proven experience with cloud data warehouses (Snowflake, Azure Synapse, or Redshift) - design, optimisation, and administration.Data Modeling: Strong knowledge of dimensional modeling (Kimball/Inmon), relational database design, and experience with tools like ER/Studio or dbt.Programming: Expert in Python and SQL - ability to write maintainable, production grade code.Big Data: Hands on with Apache Spark (PySpark), distributed computing, and performance tuning.Orchestration: Experience with workflow tools (Airflow, Azure Data Factory, or Prefect) for scheduling and monitoring pipelines.Version Control: Proficient with Git and collaborative development workflows.","company":"Q1 Technologies","rawCompany":"q1 technologies","city":"Chicago","state":"IL","isRemote":false,"isActive":false,"createdAt":"2026-09-11T12:40:05.279Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541690","title":"Other Scientific and Technical Consulting Services","slug":"other-scientific-and-technical-consulting-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer","description":"Location: Chicago-IL - Hybrid 3 days at On-siteDuration: 6 monthsRole Descriptions:Key ResponsibilitiesPipeline Development - Design, implement, and optimize scalable ETL/ELT pipelines using Databricks (PySpark, SQL, Delta Lake) to ingest structured and semi structured data from multiple sources (APIs, databases, streaming).Data Warehousing - Build and maintain cloud data warehouse solutions (Snowflake / Azure Synapse) - design star schemas, fact/dimension tables, and aggregate tables for high performance reporting.Data Modeling - Create logical and physical data models for operational and analytical use cases; implement SCD Type 2, slowly changing dimensions, and data vault methodologies where appropriate.Performance Tuning - Optimize Spark jobs, SQL queries, and data partitioning strategies to handle petabyte scale data with low latency.Governance & Quality - Implement data quality checks, monitoring, and lineage using tools like Great Expectations or custom frameworks; enforce data governance policies (GDPR/CCPA).Collaboration - Partner with data analysts, product managers, and engineers to translate business requirements into technical data solutions.CI/CD & Automation - Automate deployment of data pipelines using Azure DevOps or GitHub Actions; maintain infrastructure as code (Terraform) for data resources.Required Skills & ExperienceTotal Experience: 10+ years in data engineering or related roles.Cloud Data Platforms: Deep hands on experience with Databricks (notebooks, jobs, clusters, Delta Lake, Unity Catalog) - must have production level work.Data Warehousing: Proven experience with cloud data warehouses (Snowflake, Azure Synapse, or Redshift) - design, optimisation, and administration.Data Modeling: Strong knowledge of dimensional modeling (Kimball/Inmon), relational database design, and experience with tools like ER/Studio or dbt.Programming: Expert in Python and SQL - ability to write maintainable, production grade code.Big Data: Hands on with Apache Spark (PySpark), distributed computing, and performance tuning.Orchestration: Experience with workflow tools (Airflow, Azure Data Factory, or Prefect) for scheduling and monitoring pipelines.Version Control: Proficient with Git and collaborative development workflows.","datePosted":"2026-09-11T12:40:05.279Z","dateModified":"2026-09-11T12:40:05.279Z","hiringOrganization":{"@type":"Organization","name":"Q1 Technologies","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Chicago","addressRegion":"IL","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"abb3ab4833fcb3e18ceeedc1"},"url":"https://jobsearcher.com/jobs/abb3ab4833fcb3e18ceeedc1"}}