Provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations, including the Internet of Things (IoT) / Smart City projects, enterprise data warehouse, the open data portal, and data science applications.

Job Title: Jr. Big Data Engineer (Urgent hiring) We are a premier IT consulting firm specializing in delivering top-tier Big Data solutions to companies across various sectors such as finance, energy, e-commerce, logistics, travel, retail, entertainment, automotive, and healthcare.

We are interested in a variety of topics including large-scale distributed systems, stream processing, edge computing, applied machine learning and AI, big graphs, natural language processing, big data management, and heterogenous data analytics.

6+ years of experience in data engineering working with big data systems that can process and transform data at scale. Data Engineer (Full Time) Experience developing with data SaaS and BI tooling (Fivetran, Looker, dbt, Databricks, Apache Airflow, etc.

Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Databricks, Big Query). ● Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines.

Professional Search Group (PSG) has teamed up with a world class media and entertainment company to find an experienced Sr. Data Engineer to join the team in New York, where technology meets storytelling.

Experience working in GCP based Big Data deployments (Batch/Real-Time) leveraging Terraform, Big Query, Big Table, Google Cloud Storage, PubSub, Data Fusion, Dataflow, Dataproc, Cloud Build, Airflow, Cloud Composer etc.

Data engineer responsible for designing, developing the transformation and modernization of big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies also build new data products in GCP. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to design and develop right solutions with appropriate combination of GCP and 3rd party technologies for deploying on GCP cloud.

Demonstrated understanding and experience using software and tools including big data tools like Kafka, Spark; relational SQL databases including Big Query or equivalent; workflow management and pipeline tools such as Airflow, and object function/object-oriented scripting languages including Scala, C.

The Data Capture team for the Data organization within the DE&ET organization is in search of a Lead Software Engineer. Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, Big Query.

Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Artifact Registry, Cloud Build, Cloud Run, Vertex AI, Pub/Sub, GCP APIs.

As a Senior DevOps engineer, you will play a crucial role in ensuring the ESP software product teams (primarily focused on the Pattern in-house WIS:dom for big data across weather, energy pricing, and geospatial data.

Expanding, scaling, and standardizing the core foundational principles through consistent observability, lineage, data quality, logging, and alerting across all engineering teams in the Data organization is imperative to the creation of a single pane of glass.

Two or more years Experience with Big Data on GCP - Dataproc, dataflow, Cloud Function, BigQuery, Composer, GKE, IA, etc. Deep hands-on experience with Spark, Hive, big data & open source technologies.

Experience with data warehouse platforms such as Redshift, Databricks, Big Query, Snowflake. 8+ years' experience in engineering data pipelines using big data technologies (Spark, Flink etc.