Cloud/Python Software Engineer- - Only W2
Job Title: Cloud/Python Software EngineerLocation: Onsite in Urbandale IAContract: 12 monthsOnly W2 Job PurposePosition OverviewThis role will initially be onsite with the possibility of transitioning to remote based on performance. The ideal candidate is a highly technical software engineer with expertise in Python development, cloud computing, and big data processing. The engineer will design, build, and support cloud-based weather data acquisition, processing, and analytics solutions while working in a fast-paced, agile software delivery environment.Key ResponsibilitiesDesign, develop, and maintain scalable cloud-based weather data processing applications.Architect and enhance AWS and Databricks solutions for ingesting, caching, and processing terabyte- and petabyte-scale weather datasets.Collaborate with product managers and stakeholders to gather requirements, prioritize work, and deliver technical solutions.Develop Infrastructure as Code (IaC) using Terraform.Optimize cloud infrastructure for scalability, performance, and cost efficiency.Design, develop, and maintain REST APIs and backend services using Python, AWS Lambda, and AWS Chalice.Build and support containerized applications using Docker.Implement caching solutions using Redis and manage databases including PostgreSQL/PostGIS.Develop and maintain Databricks/Spark data pipelines for historical weather data processing using PySpark, SQL, Parquet, and Delta Lake.Build, migrate, and maintain CI/CD pipelines using GitHub Actions.Enhance system monitoring, logging, and alerting using Datadog.Troubleshoot production issues, support field testing, and resolve customer-reported data problems.Partner with data scientists to efficiently process and prepare large weather datasets for modeling and analytics.Required QualificationsBachelor's or Master's degree in Computer Science, Software Engineering, Data Engineering, or a related technical field.Strong programming experience in Python with production software deployment.Experience building scalable backend applications and RESTful APIs.Hands-on experience with AWS cloud services, including:IAMLambdaS3RDSExperience working with terabyte- or petabyte-scale datasets.Strong understanding of cloud architecture and distributed systems.Experience with Databricks, Apache Spark, and PySpark.Experience with Infrastructure as Code using Terraform.Knowledge of containerization using Docker.Experience with Redis, PostgreSQL, and PostGIS.Experience implementing and maintaining CI/CD pipelines using GitHub Actions.Familiarity with monitoring tools such as Datadog.Strong analytical, troubleshooting, and problem-solving skills.Ability to work independently in a fast-paced Agile environment.Preferred QualificationsExperience with weather, geospatial, GIS, or environmental data.Experience working with APIs such as IBM Weather Company API.Knowledge of Delta Lake and Parquet data formats.Experience optimizing cloud infrastructure costs.Exposure to data science or machine learning workflows.Experience supporting production cloud applications.