"Data Engineer"
I have an opportunity for a "Data Engineer with GCP" - (100% Remote). and I am looking for a candidate who can join Immediately if you are interested, reply to me with your updated resume or if you could refer someone I would really appreciate it.Position : Data Engineer with GCPLocation : Preferably Wellesley, MA, Hartford, CT, or NYC. Will Consider (Remote).Duration: 12 monthsMust Haves:5+ Years ofExperienceUnix/LinuxPig (Hive good to have)Python (good to have)ScalaCI/CD - GitLabGCPPrimary Responsibilities:Understand the business objectives and analyze, dissect system requirements and technical specificationsInterpret data, analyze results using statistical techniques and provide ongoing reportsDevelop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and qualityExplore the automation scope wherever possibleAcquire data from primary or secondary data sources and maintain databases / data systemsIdentify, analyze, and interpret trends or patterns in complex data setsDisplay strong technical knowledge in product analysis and debuggingWillingness to learn new technologies and adapt to product needsWork independently with little or no supervisionProvide technical mentoring for team members, troubleshootingUnderstand design concepts and product architecture. Propose solutions for performance and security issuesIdentify Process Gaps and drive Initiatives to address process GapsPartner with product owners and developers to identify areas for improved efficienciesShare and communicate ideas both verbally and in writing to staff, business sponsors, managers, and technical resources in clear concise language that is appropriate to the target audienceParticipate in communities of practice to share knowledge, learn, and innovateResearch and implement tools that support deliveryAssesses and interprets customer needs and requirementsSolves moderately complex problems and/or conducts moderately complex analysesAnalyzes and investigatesProvides explanations and interpretations within area of expertiseQuery structured and unstructured data and perform exploratory data analysis for further advanced modelingGuide and implement Optimization techniques across projectsRequired Qualifications:5+ years of IT experience in architecture of Big Data Technologies and ETL and other automation techniquesGood experience on Unix shell command and scriptingExperience of writing SQL and Complex SQLsGood knowledge of databases and Big Data especially Hive, HBase and SparkKnowledge in Hadoop Architecture, HDFS commands, experience designing and optimizing queries against data in the HDFS environment.Experience with bash shell scripts, UNIX utilities, and UNIX commandsFair knowledge on the Having experience on Hadoop Applications like Spark, Scala, Hbase, Hive, PIG, SqoopKnowledge on tools like Kibana and SplunkKnowledge on Kafka StreamingKnowledge on implementing Data Integrations projects from sourcing to auditing and implements controls for each stage of IntegrationKnowledge of large scale search applications and building high volume data pipelinesDeeply analyticalGood communication and presentation skillsProblem solving skills with the ability to think laterally, and to think with a medium term and long term perspective.RegardsAlex KeylorNAVTECH INC1600 Golf Road. Suite 1200, Rolling Meadows, IL 60008Ph: (224) 348-1340 || Email: alex@navtechusa.com || www.navtechusa.coE-Verified Company