{"schemaVersion":"jobsearcher.job.v1","id":"794bb1bbfedd6a3741b95c47","url":"https://jobsearcher.com/jobs/794bb1bbfedd6a3741b95c47","canonicalUrl":"https://jobsearcher.com/jobs/794bb1bbfedd6a3741b95c47","title":"Data Engineer","description":"ID: 2021-006-py-data-eng\nTitle: Data Engineer\nJob Location: McLean, VA\nPosted Date: 06/7/2021\n\nJob Description\n\nSeeking a Data Engineer to assist in modernizing modeling processes for one of our large financial clients. You will port SAS code to Python code (Pandas and PySpark) utilizing AWS and EMR.\nResponsibilities\n\nTranslate existing SAS code into Python code. You must know both Pandas data frames and PySpark data frames.\nVerify that the Python version of the SAS code is equivalent to the SAS version. This involves running both processes, comparing the output, and resolving any differences.\nLeverage PySpark and AWS EMR to parallelize the process and reduce the runtime.\nOptimize the Python code to reduce the runtime.\nEnhance the Python process to be fault-tolerant and contain checkpoints to make rerunning a subset of the process more efficient.\nWrite automated tests for Python code.\nPeer review code and automated tests, help team members with design and implementation challenges.\nQualifications\n\nAt least 3 years of experience developing production Python code.\nA strong understanding of Pandas and PySpark.\nA strong understanding of SQL.\nExperience with SAS.\nSolid understanding of software design principles.\nPreferred Skills\n\nBS in Computer Science or equivalent experience.\nExperience with cloud computing and storage services, particularly AWS EMR.\nExperience writing automated unit, integration, regression, performance and acceptance tests.\nStrong quantitative skills (statistics, econometrics, linear algebra).","company":"Novagigs","rawCompany":"novagigs","city":"McLean","state":"VA","isRemote":false,"isActive":false,"createdAt":"2026-04-12T20:19:26.206Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer","description":"ID: 2021-006-py-data-eng\nTitle: Data Engineer\nJob Location: McLean, VA\nPosted Date: 06/7/2021\n\nJob Description\n\nSeeking a Data Engineer to assist in modernizing modeling processes for one of our large financial clients. You will port SAS code to Python code (Pandas and PySpark) utilizing AWS and EMR.\nResponsibilities\n\nTranslate existing SAS code into Python code. You must know both Pandas data frames and PySpark data frames.\nVerify that the Python version of the SAS code is equivalent to the SAS version. This involves running both processes, comparing the output, and resolving any differences.\nLeverage PySpark and AWS EMR to parallelize the process and reduce the runtime.\nOptimize the Python code to reduce the runtime.\nEnhance the Python process to be fault-tolerant and contain checkpoints to make rerunning a subset of the process more efficient.\nWrite automated tests for Python code.\nPeer review code and automated tests, help team members with design and implementation challenges.\nQualifications\n\nAt least 3 years of experience developing production Python code.\nA strong understanding of Pandas and PySpark.\nA strong understanding of SQL.\nExperience with SAS.\nSolid understanding of software design principles.\nPreferred Skills\n\nBS in Computer Science or equivalent experience.\nExperience with cloud computing and storage services, particularly AWS EMR.\nExperience writing automated unit, integration, regression, performance and acceptance tests.\nStrong quantitative skills (statistics, econometrics, linear algebra).","datePosted":"2026-04-12T20:19:26.206Z","dateModified":"2026-04-12T20:19:26.206Z","hiringOrganization":{"@type":"Organization","name":"Novagigs","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"McLean","addressRegion":"VA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"794bb1bbfedd6a3741b95c47"},"url":"https://jobsearcher.com/jobs/794bb1bbfedd6a3741b95c47"}}