Data Engineer

We are currently seeking a Big Data Engineer for an onsite position located in Charlotte, NC, Denver, CO, Jacksonville, FL and Chicago, IL. This is a 12+ month W2 contract opportunity. Summary: Join a passionate, tight-knit, and supportive team as a Big Data Developer/Engineer at a Global Financial Institution. This role focuses on delivering the best experience for customers while remaining sensitive to their unique needs. This position is required to be fulfilled onsite 5 days a week. Responsibilities:Develop and manage data ingestion from various sources including message queues, file shares, REST APIs, and relational databasesDesign and build end-to-end Near-Real Time and Batch Data PipelinesPerform performance tuning for Spark/MapReduce and SQL jobsWork within an Agile development process through all phases of the Software Development Life CycleUtilize source code and version control systems for code managementWork with minimal supervision and collaborate effectively within a team of diverse skill setsComprehend customer requests to provide correct solutions and resolve complex issues Requirements:Over 9+ years of experience as Data Engineer.Strong SQL skills (MySQL, HIVE, Impala, SPARK SQL)Experience with data ingestion and data formats (json, csv, xml)Experience with SPARK Structured Streaming, Hadoop/Big Data, and Distributed SystemsWorking experience with Spark, Sqoop, Kafka, MapReduce, and NoSQL Databases (HBase, SOLR)Experience with CDP/HDP (Cloudera or Hortonworks), Elastic Search, and KibanaHands-on programming experience in at least one of the following: Scala, Python, PHP, or Shell ScriptingProficiency with the Linux operating systemExperience with Source Code and Version Control systems (SVN, Git, Bit Bucket)Experience with Jenkins and Jar managementStrong analytical and problem-solving skillsAbility to adapt and learn new technologies