{"schemaVersion":"jobsearcher.job.v1","id":"58e1ca7355ed07865f16d5ab","url":"https://jobsearcher.com/jobs/58e1ca7355ed07865f16d5ab","canonicalUrl":"https://jobsearcher.com/jobs/58e1ca7355ed07865f16d5ab","title":"US_East | Data Engineer_L4","description":"Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to lead the architectural design and hands-on implementation of our next-generation data platform on Cloud Platform (GCP). The ideal candidate is a subject matter expert in BigQuery and possesses deep experience building robust, scalable data pipelines using Dataform, Dataflow, and Dataproc. In this role, you will bridge the gap between high-level architectural strategy and technical execution, ensuring our data ecosystem is performant, cost-effective, and capable of supporting advanced analytics and machine learning initiatives.Key ResponsibilitiesArchitectural Design & LeadershipData Pipeline EngineeringArchitectural Design & LeadershipDesign and implement end-to-end data architectures on GCP, ensuring high availability, security, and scalability.Establish best practices for data modeling (Medallion architecture, Star Schema) specifically optimized for BigQuery's columnar storage.Evaluate emerging GCP technologies and provide strategic recommendations for platform evolution.Mentor junior engineers and conduct rigorous code reviews to maintain high engineering standards.Data Pipeline EngineeringDevelop complex ELT workflows using Dataform to manage SQL-based transformations, ensuring data lineage and quality through automated testing.Build and maintain large-scale batch and streaming data processing pipelines using Dataflow (Apache Beam).Preferred to have Dataproc knowledge for distributed processing of massive datasets using Spark or Hadoop where specialized compute is required.Integrate data from various sources (SaaS APIs, RDBMS, NoSQL) into the central BigQuery data warehouse.Technical RequirementsData Warehousing: Advanced BigQuery (Storage optimization, BQML, Analytics Functions)Transformation: Expert-level Dataform (SQLX, JavaScript, Project Configuration), understand Cortex CDC and Merge logical code logic and flowStream & Batch: Hands-on Dataflow (Apache Beam in Java or Python)Big Data Compute: Dataproc (Spark, Hive, Hadoop ecosystem)Programming: Proficiency in Python, Java, or Go; Expert SQL skillsOrchestration: Dataform code generation and custom namespace configuration. Cloud Composer (Airflow) or Vertex AI PipelinesInfrastructure: Terraform for GCP Resource Provisioning (IaC)QualificationsExperience: Data engineering, with at least 3 years focused heavily on Cloud Platform.Architecture: Proven track record of designing data platforms from the ground up that support both BI and Data Science workloads.Hands-on Skills: Ability to write clean, maintainable, and production-ready code.Soft Skills: Excellent communication skills with the ability to explain complex technical concepts to non-technical stakeholders.Preferred Certifications: Professional Data Engineer, Professional Cloud Architect. Knowledge of SAP Data model and SAP HANA required/preferred.","company":"Apolis","rawCompany":"apolis","city":"Chicago","state":"IL","isRemote":false,"isActive":false,"createdAt":"2026-08-25T04:27:13.490Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"US_East | Data Engineer_L4","description":"Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to lead the architectural design and hands-on implementation of our next-generation data platform on Cloud Platform (GCP). The ideal candidate is a subject matter expert in BigQuery and possesses deep experience building robust, scalable data pipelines using Dataform, Dataflow, and Dataproc. In this role, you will bridge the gap between high-level architectural strategy and technical execution, ensuring our data ecosystem is performant, cost-effective, and capable of supporting advanced analytics and machine learning initiatives.Key ResponsibilitiesArchitectural Design & LeadershipData Pipeline EngineeringArchitectural Design & LeadershipDesign and implement end-to-end data architectures on GCP, ensuring high availability, security, and scalability.Establish best practices for data modeling (Medallion architecture, Star Schema) specifically optimized for BigQuery's columnar storage.Evaluate emerging GCP technologies and provide strategic recommendations for platform evolution.Mentor junior engineers and conduct rigorous code reviews to maintain high engineering standards.Data Pipeline EngineeringDevelop complex ELT workflows using Dataform to manage SQL-based transformations, ensuring data lineage and quality through automated testing.Build and maintain large-scale batch and streaming data processing pipelines using Dataflow (Apache Beam).Preferred to have Dataproc knowledge for distributed processing of massive datasets using Spark or Hadoop where specialized compute is required.Integrate data from various sources (SaaS APIs, RDBMS, NoSQL) into the central BigQuery data warehouse.Technical RequirementsData Warehousing: Advanced BigQuery (Storage optimization, BQML, Analytics Functions)Transformation: Expert-level Dataform (SQLX, JavaScript, Project Configuration), understand Cortex CDC and Merge logical code logic and flowStream & Batch: Hands-on Dataflow (Apache Beam in Java or Python)Big Data Compute: Dataproc (Spark, Hive, Hadoop ecosystem)Programming: Proficiency in Python, Java, or Go; Expert SQL skillsOrchestration: Dataform code generation and custom namespace configuration. Cloud Composer (Airflow) or Vertex AI PipelinesInfrastructure: Terraform for GCP Resource Provisioning (IaC)QualificationsExperience: Data engineering, with at least 3 years focused heavily on Cloud Platform.Architecture: Proven track record of designing data platforms from the ground up that support both BI and Data Science workloads.Hands-on Skills: Ability to write clean, maintainable, and production-ready code.Soft Skills: Excellent communication skills with the ability to explain complex technical concepts to non-technical stakeholders.Preferred Certifications: Professional Data Engineer, Professional Cloud Architect. Knowledge of SAP Data model and SAP HANA required/preferred.","datePosted":"2026-08-25T04:27:13.490Z","dateModified":"2026-08-25T04:27:13.490Z","hiringOrganization":{"@type":"Organization","name":"Apolis","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Chicago","addressRegion":"IL","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"58e1ca7355ed07865f16d5ab"},"url":"https://jobsearcher.com/jobs/58e1ca7355ed07865f16d5ab"}}