Hadoop Developer

Hadoop DeveloperCalifornia Bay Area, Day 1 at office• Development experience in Hadoop eco-system and/or NoSQL technologies such as Cassandra, and MongoDB with experience in real-time & stream processing systems.• Minimum 2 years of work on data privacy• Excellent knowledge of Core Java or UNIX shell script or PL/SQL stored procedures is required• Should have knowledge in different Hadoop Distributions like CDH 4 / 5, Hortonworks, MapR, IBM Big Insights.• Strong foundational knowledge and experience with a range of Big data components such as Hadoop/Yarn, HDFS, HBase, MapReduce, Oozie, Falcon, Pig, Presto, Spark, Hive, Zookeeper, Sqoop and Flume• Develop MapReduce programs or Hadoop streaming.• Develop Pig scripts/Hive QL for analyzing all semi-structured/unstructured/structured data flows.• Should have knowledge of Table definitions, file formats, UDF, Data Layout ( Partitions & Buckets), Debugging & performance optimizations.• Must have BS or equivalent in CS, or related field• Extensive hands-on experience with Linux• Provide guidelines and SME in data privacy issues• Fine tune Hadoop applications for high-performance and throughput. Troubleshoot and debug any Hadoop ecosystem runtime issues• In-depth understanding of Data Structure and Algorithms.• Experience in managing and reviewing Hadoop logfiles.• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.