Sr. Data Engineer (Spark, NoSQL, Hadoop, Python) | TELECOMMUTE |

Data Engineering Team MemberJoin our data engineering team that is embarking on a fortune 10 human capital digital transformation journey!Responsibilities:Design, code, test, document, and maintain high-quality and scalable big data solutions.Ingest and transform data using a variety of technologies from a variety of sources (API's, streaming, files, databases ...).Develop reusable patterns and encourage innovation that will increase team's velocity.Design and develop applications in an agile environment, deploy using CI/CD.Participate with prototypes as well as design and code reviews, own or assist with incident and problem management.The ideal candidate will be a self-starter who can learn things quickly, who is enthusiastic and actively engaged.Required 3-5 years of experience with the following technologies:Hadoop, Python, Hive, SQL, shell scripting.Apache Spark.NoSQL and relational databases.Required 1-3 years of experience with the following technologies:Scheduling tools like Airflow / Tivoli Work scheduler.Working in Agile/Scrum environment.Jenkins or similar CICD tool, GitHub.Preferred 2-5 years of experience with the following technologies:Apache Kafka.API's.Kubernetes.