Data Engineer - IBM Quantum

Location: Research Triangle Park, NC, Yorktown Heights, NY, Austin, TX, Chicago, IL, New York, NY

Responsibilities: Design, build, and maintain scalable and reliable data pipelines that support analytics, operational dashboards, and quantum hardware performance insights. Design and implement ETL/ELT processes to move data between operational systems and business intelligence platforms. Build scalable data connectors for IBM Quantum's Lakehouse platform. Develop and maintain data integration workflows with a strong focus on data quality, accuracy, reliability, and continuous improvement. Apply advanced SQL using PostgreSQL and Presto for complex analytical queries and performance optimization. Build and manage workflow orchestration using Apache Airflow, including dependency management, retries, monitoring, and backfills. Develop data transformations, validation pipelines, and analytics using Python and related libraries such as pandas. Process large-scale datasets, including system telemetry, experiment metadata, cloud operations data, and quantum device performance metrics. Work with streaming platforms such as Apache Kafka or IBM Event Streams to process event-driven data from distributed quantum systems. Apply streaming architecture concepts, including topics, partitions, consumer groups, and schema evolution. Integrate multiple technical data sources, including quantum hardware telemetry, calibration data, experiment logs, job execution data, user activity, and system health metrics. Collaborate with quantum hardware, software, cloud, SRE, product, and analytics teams to deliver production-ready data solutions. Use Git-based version control, participate in code reviews, and follow software engineering best practices.

Qualifications: Bachelor's degree in Computer Science, Data Engineering, Software Engineering, or a related field. Experience designing, building, and maintaining scalable ETL/ELT data pipelines. Strong SQL skills using PostgreSQL and Presto. Experience with Python, including pandas and related data processing libraries. Experience building and operating Apache Airflow workflows. Experience processing large-scale heterogeneous datasets. Familiarity with Apache Kafka or IBM Event Streams. Understanding of streaming architectures and distributed data systems. Experience with Git and collaborative software development practices. Strong problem-solving, communication, and collaboration skills.

Preferred: Master's degree in a related field. Experience with Lakehouse architectures, including IBM watsonx.data. Experience with distributed analytics platforms such as Presto, Trino, or Apache Spark. Knowledge of data modeling for analytics and reliability engineering. Familiarity with data governance, dataset ownership, lineage, and lifecycle management. Experience operating cloud-based or distributed data pipelines. Experience working with hardware telemetry, infrastructure monitoring, or large operational datasets. Interest or experience in quantum computing, advanced hardware systems, or cryogenic technologies.

Annual salary: $116,000 to $200,000, depending on experience, skills, and location. Comprehensive healthcare benefits, including medical, prescription, dental, vision, and mental health coverage. Financial benefits including 401(k), pension plan, employee stock purchase plan, financial counseling, life insurance, and disability coverage. Performance-based incentive opportunities. Paid time off including holidays, vacation, sick leave, parental bonding leave, and paid family leave where applicable. Access to IBM's AI-powered learning platform with training and industry certifications. Employee resource groups, volunteer opportunities, and discounts on products, services, and experiences.

Work arrangement: Hybrid.

Travel requirement: Up to 20% (approximately one day per week).No visa sponsorship is available for this position. Applicants must already have authorization to work in the United States without current or future sponsorship. IBM is committed to equal employment opportunity and welcomes applicants from diverse backgrounds. The position supports IBM Quantum's mission of developing industry-leading quantum computing systems, software, and cloud services through advanced data engineering and analytics.