GCP Data Engineer - Remote
Job TitleMust haves:Basic GCP infrastructure /VPN/IAM 2. Basics GCP Dataproc 3. GCP storage 4. Exp. In GCP Data flow and Composer – Must have 5. Python 6. SQLRequired Qualification:• Experience writing Python and Pyspark scripts.• Knowledge of Apache Beam, Apache Spark, Pubsub or Kafka and IAM.• Basic understanding of cloud networking and infrastructure.• Have hands on experience with building streaming and batch pipelines.• Experience with Cloud function or cloud run.• Working knowledge of CICD tools like Jenkins, cloud build and a code management tool like git• Possess excellent knowledge of SQL along with its variation for popular cloud database like BigQuery, cloud sql, spanner etc.• Experience with relational databases like mysql, oracle, postgress.• Development experience building ETL pipelines using cloud tools like dataflow, lambda.• Experience in tuning SQL queries to maximize performance.• Working knowledge on implementing Data quality checks.• Experience with Airflow/Composer or Tidal to orchestrate the data pipelines.• Excellent critical reasoning, problem-solving skills and teamwork skills.• Solid written and verbal communication skills and able to articulate complex solutions to technical and non-technical personnel.• Experience working for clients in healthcare space.' Must Have' Experience:• Experienced in healthcare domain.• Hands-on with Google Cloud services for data engineering- Dataflow, Data Proc, Big Query, Composer, Pubsub.• Manage end to end data pipeline from extraction from source, landing on Google platform and transformation• Implemented data management best practices – Data quality, Capture of metadata