Sr. Big Data Engineer

Overview In this role you will design and implement big data solutions that enable advanced analytics. You will work with a cross-functional team to pre-process, analyze and visualize large data sets, turning information into business insights. You’ll evaluate and deploy machine learning models on big data, tackling complex problems with scalable code. This is an opportunity to shape analytics capabilities in a fast-paced, collaborative environment. ResponsibilitiesEvaluate, develop, maintain and test big data solutions for advanced analytics projectsDesign and implement big data pre-processing and reporting workflows (collecting, parsing, managing, analyzing and visualizing data)Test machine learning models on big data and deploy them for scoring and predictionCollaborate in an agile team to deliver modular, reusable and scalable codeWork with cloud platforms and distributed computing tools to process large datasetsParticipate in automation and scripting to streamline tasks Key requirementsExpert-level proficiency in at least one of Java, C++ or PythonScala knowledge is a strong advantageExperience with distributed computing frameworks (Hadoop 2.0, YARN, MR, HDFS) and related technologies (Hive, Sqoop, Avro, Flume, Oozie, Zookeeper)Hands-on experience with Apache Spark (Streaming, SQL, MLLib) is a strong advantageCloud computing platforms experience (AWS: EMR, EC2, S3, SWF; AWS CLI)Linux environment proficiency and shell/Python scriptingAgile experience and familiarity with Jira; understanding of Git workflowsStrong problem-solving skills and ability to navigate tight cornersTeamwork and collaborationProblem-solving mindsetAdaptability in a fast-paced environmentJavaPythonC++