JOBSEARCHER

Senior Data Engineer- US Citizen

Role: Senior Data Engineer- US CitizenLocation: Minneapolis, MNRate: Depends on experienceAdditional RequirementsMust be a U.S. CitizenMust be currently located in Minnesota (MN), or willing to relocateDescriptionWe are looking for Senior Data Engineer to join our dynamic team! With our extensive knowledge in application, data, and cloud engineering services, we strive to create groundbreaking solutions that provide real value to our clients.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Apache Spark (PySpark and/or Scala)Build and optimize data workflows on Databricks, including Delta Lake, notebooks, and scheduled jobsIngest, transform, and curate large-scale structured and semi-structured datasetsPerform performance tuning and cost optimization of Spark workloads and Databricks clustersImplement data quality checks, monitoring, and error handlingCollaborate with analytics and business stakeholders to deliver well-modeled, analytics-ready dataSupport batch processing and, where applicable, streaming data pipelinesFollow best practices for testing, documentation, security, and version controlRequired Qualifications5+ years of experience in Data Engineering or related rolesStrong hands-on experience with Apache Spark (PySpark or Scala)Proven experience working in Databricks environmentsStrong SQL skills and experience with relational and analytical databasesExperience building and maintaining ETL/ELT pipelines at scaleFamiliarity with modern data lake architectures (Delta Lake preferred)Experience with Git-based version controlFlexible work from home options available.