JOBSEARCHER

Senior Data Engineer

Sr. Data EngineerLocation: Richfield, Minnesota_ 3-4 days onsite/weekDuration: 6+monthsJob Description:Hire an experienced Data Engineer to design, build, and maintain scalable batch/streaming data pipelines on Google Cloud. The role requires deep SQL expertise, production grade orchestration with Apache Airflow (Cloud Composer), and strong Python for ELT/ETL, with exposure to Postgres.Skills Overview: SQL (5+ years)Apache Airflow (Cloud Composer) (3+ years)GCP (BigQuery, Dataflow, Pub/Sub, GCS, Composer) (3+ years)Python (5+ years)Big Data (warehousing/processing concepts, performance)(5+ years)Postgres (3+)ExperienceDesign, develop, and operate reliable data pipelines and DAGs using Apache Airflow/Cloud Composer for batch and near real time workflows.Build ELT/ETL on GCP services (e.g., BigQuery, Dataflow, Pub/Sub, Cloud Storage; Composer for orchestration); enforce coding, testing, and observability standards.Write expert level SQL for modeling, complex transformations, windowing functions, and performance tuning; own query efficiency and cost optimization.Develop Python data components (operators, hooks, transforms), packaging and CI/CD for deployment to Composer/Dataflow.Work with Big Data ecosystems and MPP warehouses; support data ingestion, schema evolution, and partitioning/clustering strategies.Integrate Postgres sources/targetsPartner with product, analytics, and platform teams; uphold security, compliance, data quality (DQ checks, SLAs), and documentation standards.