{"schemaVersion":"jobsearcher.job.v1","id":"b300ef04368f8bb8e8e1802c","url":"https://jobsearcher.com/jobs/b300ef04368f8bb8e8e1802c","canonicalUrl":"https://jobsearcher.com/jobs/b300ef04368f8bb8e8e1802c","title":"DS Data Engineer 2","description":"PLEASE NOTE: This position requires an ACTIVE Top Secret/SCI Clearance with Polygraph. To be considered for this position, you MUST have an ACTIVE Clearance Level of Top Secret/SCI with PolygraphPosition Code: 04-DM0828-1SummaryThe Data Engineer will leverage their development skills and experience, to support the successful designing, ingesting, cleansing, transformation, loading, and display of significant amounts of data.Duties, Tasks & ResponsibilitiesDesigning, implementing, and optimizing data extraction, cleansing, transformation, loading, replication/distribution, and large-scale ingest systems in a Big Data environmentDevelop ad-hoc ETL pipelines to help analyze new data sourcesLeverage Big Data holdings to power prototypical AI/ML based analyticsDeveloping custom solutions/code to ingest and exploit new and existing data sourcesDeveloping data profiling, deduping logic, and matching logic for analysisOrganizing and maintaining Data Layer documentation, so others are able to understand and use it. Also, work closely with data scientists to craft data pipelines which serve the development of modern AI/ML workflowsCollaborating with teammates, other service providers, vendors, and users to develop new and more efficient methodsLight admin responsibilities for small number of Linux serversEffectively articulating the risks and constraints associated with software solutions, based on environmentRequired Experience, Skills, & TechnologiesHigh School Diploma/GED with 10+ years of relevant software development/programming experience.Demonstrated data analysis, parsing, and programming language experience (e.g. Python, Java) coupled with significant SQL/database experience.Experience with the full data lifecycle, from ingest through display, in a Big Data environment.Hands-on experience with Python-related technologies, such as environment management, async development, and FastAPI. General experience with RESTful APIsExperience with data pipelining systems (e.g. Apache Airflow) and developing/performing ETL tasks in a Linux environment.Desired Experience, Skills & TechnologiesExperience deploying systems that leverage AI/ML technologyExperience publishing results in BI dashboards.","company":"Probity","rawCompany":"probity","city":"Gaithersburg","state":"MD","isRemote":false,"isActive":false,"createdAt":"2026-09-27T09:17:02.445Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541690","title":"Other Scientific and Technical Consulting Services","slug":"other-scientific-and-technical-consulting-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"DS Data Engineer 2","description":"PLEASE NOTE: This position requires an ACTIVE Top Secret/SCI Clearance with Polygraph. To be considered for this position, you MUST have an ACTIVE Clearance Level of Top Secret/SCI with PolygraphPosition Code: 04-DM0828-1SummaryThe Data Engineer will leverage their development skills and experience, to support the successful designing, ingesting, cleansing, transformation, loading, and display of significant amounts of data.Duties, Tasks & ResponsibilitiesDesigning, implementing, and optimizing data extraction, cleansing, transformation, loading, replication/distribution, and large-scale ingest systems in a Big Data environmentDevelop ad-hoc ETL pipelines to help analyze new data sourcesLeverage Big Data holdings to power prototypical AI/ML based analyticsDeveloping custom solutions/code to ingest and exploit new and existing data sourcesDeveloping data profiling, deduping logic, and matching logic for analysisOrganizing and maintaining Data Layer documentation, so others are able to understand and use it. Also, work closely with data scientists to craft data pipelines which serve the development of modern AI/ML workflowsCollaborating with teammates, other service providers, vendors, and users to develop new and more efficient methodsLight admin responsibilities for small number of Linux serversEffectively articulating the risks and constraints associated with software solutions, based on environmentRequired Experience, Skills, & TechnologiesHigh School Diploma/GED with 10+ years of relevant software development/programming experience.Demonstrated data analysis, parsing, and programming language experience (e.g. Python, Java) coupled with significant SQL/database experience.Experience with the full data lifecycle, from ingest through display, in a Big Data environment.Hands-on experience with Python-related technologies, such as environment management, async development, and FastAPI. General experience with RESTful APIsExperience with data pipelining systems (e.g. Apache Airflow) and developing/performing ETL tasks in a Linux environment.Desired Experience, Skills & TechnologiesExperience deploying systems that leverage AI/ML technologyExperience publishing results in BI dashboards.","datePosted":"2026-09-27T09:17:02.445Z","dateModified":"2026-09-27T09:17:02.445Z","hiringOrganization":{"@type":"Organization","name":"Probity","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Gaithersburg","addressRegion":"MD","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"b300ef04368f8bb8e8e1802c"},"url":"https://jobsearcher.com/jobs/b300ef04368f8bb8e8e1802c"}}