{"schemaVersion":"jobsearcher.job.v1","id":"cf2b64dc2b2639e025e9f170","url":"https://jobsearcher.com/jobs/cf2b64dc2b2639e025e9f170","canonicalUrl":"https://jobsearcher.com/jobs/cf2b64dc2b2639e025e9f170","title":"Senior AWS Python Developer / Pyspark Data Engineer","description":"Job Description\n\nJob Title:Senior AWS Python Developer / PySpark Data EngineerLocation:Lafayette, LA · Knoxville, TN · Columbia, SC · Birmingham, ALType:Direct HireWork Model:Hybrid\r\nOverviewWe are looking for a Senior Python + PySpark Data Engineer with strong AWS big data experience — ideally someone who has worked in cybersecurity or security data environments.This is primarily a hands-on data engineering role, not a traditional Python application developer role.Responsibilities\r\nDeveloping scalable Python applications and data processing solutions\r\nIntegrating APIs\r\nWriting and optimizing complex SQL queries\r\nProcessing large datasets using Spark and AWS services\r\nTroubleshooting application and data processing performance\r\nContributing to CI/CD automation\r\nWorking closely with technical and business teams across the organization\r\nRequirements\r\n8+ years of hands on Python development, including development of data intensive and big data applications.\r\nStrong Python programming fundamentals and experience developing scalable, production grade applications.\r\n5+ years of experience working with Apache Spark/PySpark, including troubleshooting and optimizing Spark jobs.\r\n5+ years of hands on development experience with AWS, including EMR, Lambda, EventBridge, Step Functions, Redshift, S3, and Glue.\r\nAdvanced SQL skills, including complex queries, data transformations, joins, and recursive CTEs.\r\nExperience developing and consuming REST APIs and integrating applications with external services and data sources.\r\nStrong background working with large datasets, including data manipulation, transformation, analysis, and processing.\r\nExperience with big data technologies such as Hadoop/EMR, Spark, and Hive.\r\n4+ years of experience working with AI related technologies or applications.\r\nHands on CI/CD and infrastructure automation experience using GitLab and Terraform.\r\nStrong debugging, performance tuning, analytical, and problem solving skills.\r\nAbility to collaborate effectively across development teams and a matrixed organization.\r\nBachelor's degree in Computer Science, Information Systems, or a related field.?\r\nSystem One, and its subsidiaries including Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.\r\nSystem One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.\r\n#LI-Ref: #404-IT Pittsburgh","company":"System One","rawCompany":"system one","city":"Columbia","state":"SC","isRemote":false,"isActive":false,"createdAt":"2026-11-03T02:23:30.798Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior AWS Python Developer / Pyspark Data Engineer","description":"Job Description\n\nJob Title:Senior AWS Python Developer / PySpark Data EngineerLocation:Lafayette, LA · Knoxville, TN · Columbia, SC · Birmingham, ALType:Direct HireWork Model:Hybrid\r\nOverviewWe are looking for a Senior Python + PySpark Data Engineer with strong AWS big data experience — ideally someone who has worked in cybersecurity or security data environments.This is primarily a hands-on data engineering role, not a traditional Python application developer role.Responsibilities\r\nDeveloping scalable Python applications and data processing solutions\r\nIntegrating APIs\r\nWriting and optimizing complex SQL queries\r\nProcessing large datasets using Spark and AWS services\r\nTroubleshooting application and data processing performance\r\nContributing to CI/CD automation\r\nWorking closely with technical and business teams across the organization\r\nRequirements\r\n8+ years of hands on Python development, including development of data intensive and big data applications.\r\nStrong Python programming fundamentals and experience developing scalable, production grade applications.\r\n5+ years of experience working with Apache Spark/PySpark, including troubleshooting and optimizing Spark jobs.\r\n5+ years of hands on development experience with AWS, including EMR, Lambda, EventBridge, Step Functions, Redshift, S3, and Glue.\r\nAdvanced SQL skills, including complex queries, data transformations, joins, and recursive CTEs.\r\nExperience developing and consuming REST APIs and integrating applications with external services and data sources.\r\nStrong background working with large datasets, including data manipulation, transformation, analysis, and processing.\r\nExperience with big data technologies such as Hadoop/EMR, Spark, and Hive.\r\n4+ years of experience working with AI related technologies or applications.\r\nHands on CI/CD and infrastructure automation experience using GitLab and Terraform.\r\nStrong debugging, performance tuning, analytical, and problem solving skills.\r\nAbility to collaborate effectively across development teams and a matrixed organization.\r\nBachelor's degree in Computer Science, Information Systems, or a related field.?\r\nSystem One, and its subsidiaries including Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.\r\nSystem One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.\r\n#LI-Ref: #404-IT Pittsburgh","datePosted":"2026-11-03T02:23:30.798Z","dateModified":"2026-11-03T02:23:30.798Z","hiringOrganization":{"@type":"Organization","name":"System One","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Columbia","addressRegion":"SC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"cf2b64dc2b2639e025e9f170"},"url":"https://jobsearcher.com/jobs/cf2b64dc2b2639e025e9f170"}}