Lead Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Data Engineering Services_ St. Louis, MO (Hybrid, 3 Days Onsite)Must haves - Scala, Pyspark, Databricks and AWSNote: Candidate must be local to St. Louis and the final round of Interview is a On-site Interview.Role Overview:Team Focus: Supports critical data ingestion, streaming and model monitoring platforms that enable real time decisioning and fraud risk capabilities. The team contributes to enhancements & modernization. The main team focus right now is model monitoring, second is modernization of applications/legacy systems and third, leveraging AI toolsHigh level overview: Engineer with experience in Scala, Python or Java, Big Data+ AWS/Databricks. Needs AI agent knowledge to create agents within the team to automate the processesCore skills:Data Engineering / Streaming Platforms (Kafka, real-time pipelines using scala/python, NIFI)Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala, AWS, Databricks, cloudera manager platform)Production Support & Platform Reliability (using Splunk for monitoring, troubleshooting, performance tuning)Strong SQLAI agent knowledge