Google Cloud Platform Data Engineer

IntroductionAs a Google Cloud Platform Data Engineer, you will be responsible for designing, building, and maintaining data pipelines on Google Cloud Platform. You will work closely with data scientists and analysts to ensure data quality and availability for analytical and operational use.ResponsibilitiesDesign and implement scalable data pipelines using Big Query, Airflow, DataProc, PubSub, Hadoop Hive, Spark, and other Google Cloud Platform toolsDevelop and maintain ETL processes to ingest, transform, and load data from various sourcesOptimize data storage and retrieval for performance and cost efficiencyCollaborate with cross-functional teams to understand data requirements and deliver solutionsMonitor and troubleshoot data pipeline issues to ensure data integrity and availabilityDocument data pipeline architecture, processes, and best practicesRequirementsRequired Skills:Experience with Big Query, Airflow, DataProc, PubSub, Hadoop Hive, SparkProficiency in Python and shell scriptingSolid understanding of Big Data and Analytics solutionsWorking knowledge of Google Cloud Platform PubSub, Airflow, PubSub Kafka, Git, Jenkins, KafkaPreferred SkillsCertifications in Google Cloud PlatformExperience working with large-scale data systemsFamiliarity with machine learning and data science concepts