{"schemaVersion":"jobsearcher.job.v1","id":"60e47d9b7caf270af663f26b","url":"https://jobsearcher.com/jobs/60e47d9b7caf270af663f26b","canonicalUrl":"https://jobsearcher.com/jobs/60e47d9b7caf270af663f26b","title":"Data Engineer - Python, SQL, Databricks","description":"Job Description\r\nSeeking a Senior Data Engineer to design, build, and optimize scalable data pipelines supporting analytics, AI, and machine learning initiatives. This role will own pipeline development from ingestion through transformation and delivery while driving data quality, reliability, and engineering best practices.Key ResponsibilitiesDesign and build scalable, fault-tolerant data pipelines using modern cloud data platforms.Develop complex SQL transformations and data models leveraging medallion architecture.Build and maintain DBT testing, data quality, and validation frameworks.Support batch and streaming ingestion, including schema evolution and Parquet/JSON processing.Optimize pipeline performance, reliability, and scalability.Manage CI/CD and deployment workflows through GitHub.Partner with ML engineers and data scientists to support AI/ML data and feature pipelines.Drive strong documentation, lineage, and engineering standards.Skills and RequirementsAdvanced SQL and strong data modeling expertise.Strong knowledge of data warehousing and ETL/ELT architecture.Experience with Databricks, Snowflake, AWS, or similar cloud data platforms.Experience with CI/CD, GitHub, and production data pipelines.8+ years of data engineering experience.dbt Core or dbt Cloud major plusSpark SQL and PythonStreaming ingestion and schema evolutionParquet and JSON processingWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.#J-18808-Ljbffr","company":"Insight Global United States","rawCompany":"insight global united states","city":"Westbrook","state":"ME","isRemote":false,"isActive":false,"createdAt":"2026-11-13T01:31:05.061Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer - Python, SQL, Databricks","description":"Job Description\r\nSeeking a Senior Data Engineer to design, build, and optimize scalable data pipelines supporting analytics, AI, and machine learning initiatives. This role will own pipeline development from ingestion through transformation and delivery while driving data quality, reliability, and engineering best practices.Key ResponsibilitiesDesign and build scalable, fault-tolerant data pipelines using modern cloud data platforms.Develop complex SQL transformations and data models leveraging medallion architecture.Build and maintain DBT testing, data quality, and validation frameworks.Support batch and streaming ingestion, including schema evolution and Parquet/JSON processing.Optimize pipeline performance, reliability, and scalability.Manage CI/CD and deployment workflows through GitHub.Partner with ML engineers and data scientists to support AI/ML data and feature pipelines.Drive strong documentation, lineage, and engineering standards.Skills and RequirementsAdvanced SQL and strong data modeling expertise.Strong knowledge of data warehousing and ETL/ELT architecture.Experience with Databricks, Snowflake, AWS, or similar cloud data platforms.Experience with CI/CD, GitHub, and production data pipelines.8+ years of data engineering experience.dbt Core or dbt Cloud major plusSpark SQL and PythonStreaming ingestion and schema evolutionParquet and JSON processingWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.#J-18808-Ljbffr","datePosted":"2026-11-13T01:31:05.061Z","dateModified":"2026-11-13T01:31:05.061Z","hiringOrganization":{"@type":"Organization","name":"Insight Global United States","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Westbrook","addressRegion":"ME","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"60e47d9b7caf270af663f26b"},"url":"https://jobsearcher.com/jobs/60e47d9b7caf270af663f26b"}}