Senior Data Engineer

Job Summary:Our client is seeking a Senior Data Engineer to join their team! This position is located in New York, New York or Bristol, Connecticut.Duties:Design, build, and optimize large-scale data pipelines using Python, Spark, and Scala, maintaining strict uptime SLAsArchitect and develop reusable shared libraries that abstract complex business logic to ensure consistency across data pipelinesMaintain and enhance distributed data processing systems in production environmentsPartner cross-functionally with Product Managers, Architects, and Engineering teams to deliver reliable and scalable data solutionsDevelop and document standards for pipeline configuration, naming conventions, partitioning strategies, and governance best practicesEnsure high operational excellence, data quality, and reliability across datasets consumed by Engineering, Analytics, Data Science, and Operations teamsIdentify performance bottlenecks and optimize for scale, cost efficiency, and reliabilityParticipate actively in Agile/Scrum ceremonies and contribute to continuous team improvementBuild strong relationships with internal stakeholders to understand evolving data needs and prioritize impactful enhancementsMaintain detailed documentation to support data governance, lineage, and compliance requirementsDesired Skills/Experience:Bachelor’s degree in Computer Science, Engineering, or a related technical field5+ years of experience building and maintaining large-scale data pipelines in production environmentsStrong Python programming expertise with solid software engineering fundamentalsHands-on experience with distributed processing frameworks such as Apache SparkExperience with workflow orchestration tools such as Apache AirflowStrong SQL skills with the ability to analyze and optimize complex datasetsExperience working in cloud environmentsStrong problem-solving and algorithmic thinking skillsExperience operating in production environments with uptime and reliability expectationsExcellent analytical, documentation, and communication skillsSelf-starter with the ability to quickly learn new technologies and frameworksBenefits:Medical, Dental, & Vision Insurance PlansEmployee-Owned Profit Sharing (ESOP)401K offeredThe approximate pay range for this position is between $62.00 and $89.00. Please note that the pay range provided is a good faith estimate. Final compensation may vary based on factors including but not limited to background, knowledge, skills, and location. We comply with local wage minimums.At KellyMitchell, our culture is world class. We’re movers and shakers! We don’t mind a bit of friendly competition, and we reward hard work with unlimited potential for growth. This is an exciting opportunity to join a company known for innovative solutions and unsurpassed customer service. We're passionate about helping companies solve their biggest IT staffing & project solutions challenges. As an employee-owned, women-led organization serving Fortune 500 companies nationwide, we deliver expert service at a moment's notice.By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from KellyMitchell and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at https://www.careers.kellymitchell.com/privacy-policy