Senior Data Engineer

What You Will Do Design, build, and maintain robust and scalable data pipelines using Python and SQL within Databricks and Sagemaker. Contribute to the development of a modular platform architecture that supports client-specific customizations while maintaining a clean and efficient core system. Develop and implement automation for routine operational tasks, such as data ingestion and configuration management. This includes automating manual data uploading processes. Develop and maintain a comprehensive unit testing framework for ETL processes and data transformations to ensure data quality. Implement comprehensive logging/monitoring/alerting mechanisms for all ETL processes and data transformations. Collaborate effectively with a geographically dispersed team of engineers to achieve shared goals. Provide guidance and mentorship to junior engineers to enhance their technical skills. What You Will Bring 5+ years of experience as a Data Engineer, with a proven track record of leading and owning complex data engineering projects from inception to completion. Advanced programming skills in Python and SQL. Deep experience with cloud-based data platforms, particularly Databricks, including a strong understanding of best practices for cloud data architecture. Experience with workflow orchestration tools, such as Databricks Jobs or Airflow. Experience with data modeling, ETL development, and data warehousing. Experience with unit testing and CI/CD pipelines. Excellent communication and collaboration skills, including the ability to communicate technical concepts to non-technical audiences. Ability to work independently and as part of an agile team. Passion for data quality, automation, and building scalable systems. Experience working with large datasets from diverse sources, with an emphasis on designing solutions that can handle scale and complexity. Actively engaged in utilizing and staying current with AI tools, finding innovative ways to enhance personal productivity and improve our products by incorporating AI/ML. Strong problem-solving skills and a desire to learn and grow professionally. Bonus Points Experience with predictive modeling and scoring. Experience working with early childhood education data. Experience with data visualization tools, such as Power BI. Job Type: Full-time Pay: $116,642.00 - $124,121.00 per year Benefits: 401(k) Dental insurance Health insurance Paid time off Schedule: Monday to Friday On call People with a criminal record are encouraged to apply Work Location: Remote