Senior Data Engineer - Databricks

As a leading industrial distributor with operations primarily in North America, Japan and the United Kingdom, We Keep The World Working® by serving more than 4.5 million customers worldwide with products delivered through innovative technology and deep customer relationships. With 2023 sales of $16.5 billion, we’re dedicated to providing value for customers, fostering an engaging culture for team members and driving strong financial results.Our welcoming workplace enables you to learn, grow and make a difference by keeping businesses running and their people safe. As a 2024 Glassdoor Best Place to Work and a Great Place to Work-Certified™ company, we’re looking for passionate people to join our team as we continue leading the industry over our next 100 years.Position DetailsWe are seeking a highly skilled Data engineer to work in our Commerce Product team at Grainger. This role directly impacts the success of our business and the satisfaction of our users. The ideal candidate will have a record of solving complex problems, driving innovation, and delivering results in a fast-paced environment. If you thrive on challenges, work well with stakeholders, have a passion for continuous learning, and want to make a significant impact for Grainger, this role is for you. You will work on a team of data and software engineers building our next generation data platform.You will be report to the Senior Manager, Product Engineering and will be based in both our Lake Forest, IL and downtown Chicago on a hybrid basis (8 days per month).You WillDesign and implement technical solutions and processes to ensure data reliability and accuracy.Build an end-to-end data platform utilizing the latest data architectural patterns and data platform technologies.Understand trends and emerging technologies to evaluate the performance and applicability of potential tools for our requirements.Build APIs to scale for multiple partners across Grainger.com while ensuring high availability.Collaborate with stakeholders, including team and product managers, to create secure and efficient data products.Design for scalability, using distributed technologies to handle increasing data volumes efficiently while driving access to our data across multiple touch points.Work within an Agile delivery / DevOps methodology to deliver product increments in iterative sprints. You Have3+ years of experience in batch and streaming ETL using Spark, Python, Scala, Snowflake, or Databricks for Data Engineering or Machine Learning workloads. Snowflake and Databricks are a must.3+ years orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi3+ years of experience with containerization and orchestration technologies (Docker, Kubernetes) and experience with Python or shell scripting in Bash, Linux, or Windows shell.A strong understanding of Structured Query Language. Experience building scalable Restful APIs using Java or Kotlin.Experience using AWS cloud services (S3, Lambda, EKS, ECS, DynamoDB).Experience with TDD and other testing strategies.Implemented CI/CD with automated testing in Jenkins, Github Actions, CircleCI or Gitlab CI/CDExperience with MongoDB and GraphQL as a preferred skill.Demonstrated experience implementing data management life cycle, using data quality functions like standardization, transformation, rationalization, linking, and matching.Experience working in vector databases like Milvus, Pinecone, or Weaviate as a nice to have skillRewards And BenefitsWith benefits starting day one, Grainger is committed to your safety, health and wellbeing. Our programs provide choice and flexibility to meet our team members' individual needs. Check out some of the rewards available to you at Grainger.Medical, dental, vision, and life insurance plans Generous paid time off (PTO) and 6 company holidays per year Automatic 6% 401(k) company contribution each pay period Employee discounts, parental leave, 3:1 match on donations and tuition reimbursement A comprehensive set of emotional, financial, physical and social wellbeing programs We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity workplace.We are committed to fostering an inclusive, accessible environment that includes both providing reasonable accommodations to individuals with disabilities during the application and hiring process as well as throughout the course of one’s employment. With this in mind, should you need a reasonable accommodation during the application and selection process, please advise us so that we can provide appropriate assistance.