Big Data Developer
Job Title: Big Data Developer/Engineer
Duration: 6 - 12+ Months Contract
Location: Hybrid (San Francisco, Bay Area)
Key Responsibilities:
- Design, develop, and maintain end to end data solutions using open source, modern data lake, and enterprise data warehouse technologies (Hadoop, Spark, Cloud, etc.)Contribute to multiple data solutions throughout their entire lifecycle (conception to launch)
- Partner with business stakeholders to understand and meet their data requirements Design, build, and maintain machine learning data pipelines
- Maintain security in accordance with Bank security policies
- Participate in an Agile development environment Qualifications
- Bachelor’s degree in computer science, Engineering, or Information Management (or equivalent) 5+ years of relevant work experience
- Professional experience supporting Big Data platform applications and solutions
Hands-on experience with a variety of big data (Hadoop / Cloudera, Cloud, etc.)Experience with object-oriented scripting languages: Java (required), Python (nice to have), etc.
Experience in Big Data, Hadoop, Spark, HDFS, Hive, HBase, Kafka, Impala, Spark, and AWS, EMRAdvanced knowledge of SQL and experience with relational databases Experience with UNIX shell scripts and commands Experience with version control (git), issue tracking (Jira), and code reviews
Proficient in agile development practices
Ability to clearly document operational procedures and solution designs Ability to communicate effectively (both verbal and written) Ability to work collaboratively in a team environment Ability to balance competing priorities and expectations.