Staff Software Engineer - Data Platform

Overview As a Data Platform Engineer and Technical Lead at Harness, you design, build, and maintain scalable data pipelines and the supporting infrastructure. You collaborate with data scientists and analysts to translate requirements into robust data solutions, ensuring quality and reliability across the data lifecycle. You optimize pipelines for performance, troubleshoot issues, and document architecture to empower the team. You’ll stay ahead of new data technologies and mentor junior engineers, contributing to Harness’s mission of AI-driven software delivery with governance and scalability. Compensation / Benefitscompetitive salarycomprehensive healthcare benefitsFlexible Spending Account (FSA)Flexible work scheduleEmployee Assistance Program (EAP)Flexible Time Off and Parental Leave, ResponsibilitiesDesign, build, and maintain scalable data pipelines and infrastructure for ingestion, processing, and storageCollaborate with data scientists, analysts, and stakeholders to translate data needs into solutionsImplement data quality checks and ensure data integrity across the lifecycleOptimize and tune pipelines for performance and efficiencyTroubleshoot data-related issues and provide timely resolutionsStay updated on data engineering best practices and apply them to improve systemsDocument data architecture, processes, and workflowsProvide guidance and mentorship to junior team members Key requirementsBachelor's degree in Computer Science, Engineering, or related field; Master’s preferred9+ years of experience as a data engineer or similar roleStrong programming skills in Python, Java, or ScalaExperience with BigQuery, Spark, Kafka, DBT, SQLMeshHands-on experience with AWS, Azure, or Google CloudStrong SQL skills; experience with relational and NoSQL databasesFamiliarity with data visualization tools (Tableau, Power BI, Looker)Excellent problem-solving, analytical, and collaborative skillsstrong communicationteam collaborationproblem-solvingPythonJavaScala