Python, Data Engineer, AWS
Purple DrivePython, Data Engineer, AWS Share Columbus, OH PDT - 9410 10-12 11/04/2025Overview: Python, Data Engineer, AWSKey responsibilities:Develop and maintain data pipelinesBuild, test, and maintain ETL (Extract, Transform, Load) processes to move and transform and manage data architectureConstruct and manage data infrastructure, including data warehouses, data lakes, and data processesUse Python to automate tasks and build data processing data sourcesConnect internal and external data sources and APIs, and ensure system data quality and securityImplement data quality checks, security controls, and access management policies.Collaborate with stakeholdersWork with data scientists, analysts, and other teams to understand requirements and deliver solutions.Optimize systemsMonitor system performance, troubleshoot issues, and implement optimizations for reliability and efficiency.Required skills and qualifications:Programming: Proficiency in Python is a must. SQL and other languages like Java or Scala are also valuable.Databases: Strong knowledge of database management systems (relational and NoSQL) and data modeling.Big Data Technologies: Experience with big data frameworks such as Apache Spark and Hadoop.Cloud Platforms: Familiarity with cloud services is often required, such as AWS, GCP, or Azure.Version Control: Experience with version control systems like Git.Problem-Solving: Strong analytical and problem-solving skills.Communication: Excellent communication skills to collaborate with technical and non-technical teams.Education: A bachelors degree in Computer Science, Engineering, or a related field is typically required.