Motion Recruitment

The ideal candidate will have a strong background in data engineering, with a focus on Databricks, and have experience implementing real-time streaming technologies.. As the technical lead and architect, your primary responsibility will be to design and implement highly efficient, reusable, and scalable data processing systems and pipelines in Databricks and Snowflake.. Experience in batch and streaming ETL using Spark, Python, Scala, Snowflake or Databricks for Data Engineering or Machine Learning workloads.. Experience orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi. Experience with containerization and orchestration technologies (Docker, Kubernetes) and experience with shell scripting in Bash, Unix or windows shell is preferable.

data engineer

We are looking for a Staff Data Engineer to join one of the 100 Best Companies to Work For, with offices in the Chicagoland area and remote flexibility, on a full-time basis. This leading supplier of maintenance, repair, and operating products for businesses and a wide range of industries across the globe has a focus on sustainability, social responsibility, and community engagement, serving more than 4.5 million customers worldwide. As a Staff Data Engineer, you will help the team by ingesting flat files and multimodal files like PDFs, videos, voice recordings, and images to help improve their AI/ML platform that uses LLM technologies. This platform will help how the organization is servicing their various customers. In this role you’ll be contributing to ongoing architecture, development, and mentor junior engineers. The ideal candidate will have a strong background in data engineering, with a focus on Databricks, and have experience implementing real-time streaming technologies. Having experience IaC will be an added bonus. We encourage you to apply for this exciting opportunity and be part of a company that values sustainability, social responsibility, community engagement, innovation, and growth. Required Skills & Experience <ul><li>As the technical lead and architect, your primary responsibility will be to design and implement highly efficient, reusable, and scalable data processing systems and pipelines in Databricks and Snowflake.</li><li>Design and implement technical solutions and processes to ensure data reliability and accuracy. </li><li>Develop data models and mappings and build new data assets required by users. Perform exploratory data analysis on existing products and datasets. </li><li>Educate data engineering teams in adopting new data patterns and tools. </li><li>Function as SME within this area when engaging with our AI, Platform, and Business Analytics teams to build useful pipelines and data assets. </li></ul>Desired Skills & Experience <ul><li>Experience in batch and streaming ETL using Spark, Python, Scala, Snowflake or Databricks for Data Engineering or Machine Learning workloads.</li><li>Experience orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi</li><li>Experience prepping structured and unstructured data for data science models.</li><li>Experience with containerization and orchestration technologies (Docker, Kubernetes) and experience with shell scripting in Bash, Unix or windows shell is preferable.</li><li>Implemented CI/CD with automated testing in Jenkins, Github Actions, or Gitlab CI/CD</li><li>Familiarity with AWS Services not limited to Glue, Athena, Lambda, S3, and DynamoDB</li><li>Demonstrated experience implementing data management life cycle, using data quality functions like standardization, transformation, rationalization, linking and matching. </li></ul>The Offer <ul><li>Bonus eligible </li></ul>You Will Receive The Following Benefits <ul><li>Medical, dental, vision, and life insurance plans</li><li>Paid time off (PTO) and 6 company holidays per year</li><li>Automatic 6% 401(k) company contribution each pay period</li><li>Employee discounts, parental leave, 3:1 match on donations and tuition reimbursement</li><li>A comprehensive set of emotional, financial, physical and social wellbeing programs </li></ul>Applicants must be currently authorized to work in the US on a full-time basis now and in the future. Posted By: Esteban Medina

START NEW SEARCH