{"schemaVersion":"jobsearcher.job.v1","id":"1239f621ef9f52a3d3d9dc08","url":"https://jobsearcher.com/jobs/1239f621ef9f52a3d3d9dc08","canonicalUrl":"https://jobsearcher.com/jobs/1239f621ef9f52a3d3d9dc08","title":"Senior Databricks Data Engineer","description":"Senior Databricks Data Engineer - Pharma / Scientific DataLocation: 100% Remote - US-based candidates only (Onshore)Working Hours: 100% Pacific Time (PT) business hoursStart Date: Within 2-3 weeksDuration: 6 months, with strong possibility of extensionExperience Level: SeniorRole OverviewWe are seeking a Senior Databricks Data Engineer with strong pharmaceutical/scientific data experience, particularly working with clinical, laboratory and assay data. Client is NOT looking for pre-clinical data experience.The ideal candidate combines hands-on Databricks engineering expertise with strong business analysis, data modeling and stakeholder engagement skills. This person must be comfortable working directly with scientists, understanding their data requirements and translating them into scalable technical solutions.Pharma/scientific domain experience is critical. Candidates with strong Databricks skills but limited exposure to scientific data will not be a good fit.Key ResponsibilitiesDesign, develop and optimize data pipelines, transformations, views and data solutions within Databricks.Work directly with scientists and business stakeholders to gather, clarify and document requirements.Design data models and mappings for complex scientific datasets, particularly laboratory, assay and clinical data.Establish relationships between scientific entities such as compounds, assays, experimental results and associated identifiers.Integrate data from multiple scientific systems, laboratory sources and external vendors.Develop processes for handling corrected or revised scientific data, including pipeline reprocessing and maintaining data accuracy.Translate scientific and functional requirements into robust, scalable Databricks solutions.Demonstrate technical approaches, explain design decisions and guide stakeholders toward appropriate solutions.Troubleshoot data quality, integration and modeling issues.Required Skills & ExperienceDatabricks & Data EngineeringExtensive hands-on experience with Databricks.Strong Python, PySpark and SQL skills.Experience building and maintaining data ingestion and transformation pipelines.Strong data modeling, mapping and integration experience.Experience managing pipeline reruns, incremental processing, corrections and data quality.Pharmaceutical / Scientific Data Expertise - CriticalProven experience working with pharmaceutical, biotechnology or life sciences data.Hands-on experience with laboratory and assay datasets.Understanding of scientific data structures, experimental results, compounds and associated identifiers.Experience integrating, transforming and modeling scientific data for analytics.Familiarity with clinical data is valuable.Business Analysis & Stakeholder EngagementExperience gathering technical and functional requirements directly from scientists or scientific business users.Ability to ask relevant questions to uncover business needs, data relationships and quality issues.Strong analytical and problem-solving capabilities.Excellent verbal and written communication skills.Ability to explain technical solutions, trade-offs and recommendations to nontechnical stakeholders.Capable of working independently and taking ownership of requirements through implementation.Preferred QualificationsExperience working in pharmaceutical R&D, drug discovery or scientific research environments.Familiarity with laboratory data sources and scientific data workflows.Experience developing data solutions supporting scientific analysis and decision-making.Databricks certifications.","company":"Bitcruit Solutions","rawCompany":"bitcruit solutions","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-10-22T09:51:00.135Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541714","title":"Research and Development in Biotechnology (except Nanobiotechnology)","slug":"research-and-development-in-biotechnology-except-nanobiotechnology"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Databricks Data Engineer","description":"Senior Databricks Data Engineer - Pharma / Scientific DataLocation: 100% Remote - US-based candidates only (Onshore)Working Hours: 100% Pacific Time (PT) business hoursStart Date: Within 2-3 weeksDuration: 6 months, with strong possibility of extensionExperience Level: SeniorRole OverviewWe are seeking a Senior Databricks Data Engineer with strong pharmaceutical/scientific data experience, particularly working with clinical, laboratory and assay data. Client is NOT looking for pre-clinical data experience.The ideal candidate combines hands-on Databricks engineering expertise with strong business analysis, data modeling and stakeholder engagement skills. This person must be comfortable working directly with scientists, understanding their data requirements and translating them into scalable technical solutions.Pharma/scientific domain experience is critical. Candidates with strong Databricks skills but limited exposure to scientific data will not be a good fit.Key ResponsibilitiesDesign, develop and optimize data pipelines, transformations, views and data solutions within Databricks.Work directly with scientists and business stakeholders to gather, clarify and document requirements.Design data models and mappings for complex scientific datasets, particularly laboratory, assay and clinical data.Establish relationships between scientific entities such as compounds, assays, experimental results and associated identifiers.Integrate data from multiple scientific systems, laboratory sources and external vendors.Develop processes for handling corrected or revised scientific data, including pipeline reprocessing and maintaining data accuracy.Translate scientific and functional requirements into robust, scalable Databricks solutions.Demonstrate technical approaches, explain design decisions and guide stakeholders toward appropriate solutions.Troubleshoot data quality, integration and modeling issues.Required Skills & ExperienceDatabricks & Data EngineeringExtensive hands-on experience with Databricks.Strong Python, PySpark and SQL skills.Experience building and maintaining data ingestion and transformation pipelines.Strong data modeling, mapping and integration experience.Experience managing pipeline reruns, incremental processing, corrections and data quality.Pharmaceutical / Scientific Data Expertise - CriticalProven experience working with pharmaceutical, biotechnology or life sciences data.Hands-on experience with laboratory and assay datasets.Understanding of scientific data structures, experimental results, compounds and associated identifiers.Experience integrating, transforming and modeling scientific data for analytics.Familiarity with clinical data is valuable.Business Analysis & Stakeholder EngagementExperience gathering technical and functional requirements directly from scientists or scientific business users.Ability to ask relevant questions to uncover business needs, data relationships and quality issues.Strong analytical and problem-solving capabilities.Excellent verbal and written communication skills.Ability to explain technical solutions, trade-offs and recommendations to nontechnical stakeholders.Capable of working independently and taking ownership of requirements through implementation.Preferred QualificationsExperience working in pharmaceutical R&D, drug discovery or scientific research environments.Familiarity with laboratory data sources and scientific data workflows.Experience developing data solutions supporting scientific analysis and decision-making.Databricks certifications.","datePosted":"2026-10-22T09:51:00.135Z","dateModified":"2026-10-22T09:51:00.135Z","hiringOrganization":{"@type":"Organization","name":"Bitcruit Solutions","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"1239f621ef9f52a3d3d9dc08"},"url":"https://jobsearcher.com/jobs/1239f621ef9f52a3d3d9dc08"}}