AWS Python Developer

About The Role: System One is seeking a Senior AWS Python Developer / PySpark Data Engineer for a direct-hire opportunity. This hybrid role is available in Lafayette, Louisiana; Knoxville, Tennessee; Columbia, South Carolina; and Birmingham, Alabama. The position is primarily focused on hands-on data engineering rather than traditional Python application development. The successful candidate will build and improve scalable data-processing solutions, work with large datasets, and apply substantial experience with Python, PySpark, and AWS big data services. Experience in cybersecurity or security data environments is especially relevant.

Qualifications: Candidates should have at least eight years of hands-on Python development experience, including work on data-intensive or big data applications, and a strong foundation in developing scalable, production-grade solutions. At least five years of experience with Apache Spark or PySpark is required, including troubleshooting and optimizing jobs. Candidates should also bring at least five years of hands-on AWS development experience with services such as EMR, Lambda, EventBridge, Step Functions, Redshift, S3, and Glue. Advanced SQL skills are required, including the ability to write complex queries and perform data transformations, joins, and recursive CTEs. The role calls for experience developing and consuming REST APIs and integrating applications with external services and data sources. Candidates should be comfortable manipulating, transforming, analyzing, and processing large datasets, and familiar with big data technologies such as Hadoop or EMR, Spark, and Hive. At least four years of experience with AI-related technologies or applications is also required. Additional qualifications include hands-on CI/CD and infrastructure automation experience using GitLab and Terraform, strong debugging and performance-tuning abilities, and analytical problem-solving skills. Candidates should be effective collaborators who can work across development teams and within a matrixed organization. A bachelor’s degree in Computer Science, Information Systems, or a related field is required.

Responsibilities: Develop scalable Python applications and data-processing solutions that support production data needs. Process large datasets using Spark and AWS services, and build reliable workflows that meet technical and business requirements. Write, review, and optimize complex SQL queries to support data transformation and analysis. Develop and consume APIs, integrating applications with external services and data sources as appropriate. Troubleshoot data-processing and application performance issues, identify root causes, and optimize Spark jobs and related workflows. Contribute to CI/CD automation and infrastructure practices using tools such as GitLab and Terraform. Collaborate with technical and business teams across the organization to clarify needs, communicate solutions, and support dependable delivery.

Benefits: Eligible employees may have access to medical, dental, and vision coverage; spending accounts; life insurance; voluntary plans; and participation in a 401(k) plan. Benefit options are subject to eligibility and applicable plan terms.

Equal Opportunity: System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, including pregnancy, childbirth, or related medical conditions, sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.