Python Developer - with Data engineering Skills
Location: Richmond - hybrid.IntroductionThe project is centered on a data management (TDM) function responsible for securely moving sensitive data across non-production environments using internally built frameworks. The work is heavily backend-focused, combining data engineering and software engineering, with pipelines primarily built in Scala on Spark and supported by AWS services (including EMR, IAM, KMS, S3) and Python-based serverless components like Lambda. The contractor will help maintain and enhance this patented in-house framework, automate data pipelines, ensure compliance with strict cybersecurity and auditing requirements, and contribute to ongoing feature development and self-service capabilities. The team operates entirely in production, even though the data movement is between non-production environments.Required Skills & QualificationsStrong expertise in Spark, Scala, AWS, Python, and shell scriptingExperience in building data pipelinesSoftware engineering skills slightly preferredMust have previous client experience working for this customer in the past 5 yearsPreferred Skills & Qualifications Experience with Ab InitioDay-to-Day Responsibilities Maintain and enhance the in-house framework, Data Shield, which is built in Scala and runs on SparkAutomate data pipelines and ensure compliance with cybersecurity standardsContribute to ongoing feature development and self-service capabilitiesIntegrate into a small, highly collaborative backend team operating in a fast-paced environmentCompany Benefits & Culture Work in a fast-paced, dynamic environmentOpportunity to contribute to patented technologyCollaborative team atmosphereFor immediate consideration please click APPLY to begin the screening process with Alex.