Senior Databricks Data Engineer

Peak Performers has partnered with a Texas State Agency to assist in their search for a contract Sr. Databricks Data Engineer in Austin, Tx . In this position, you will be responsible for developing, maintaining, and optimizing big data solutions using the Databricks Unified Analytics Platform.Major dutiesDesigning and developing scalable data pipelinesImplementing ETL/ELT workflowsOptimizing Spark jobsIntegrating with Azure Data FactoryAutomating deploymentsCollaborating with cross-functional teamsEnsuring data quality, governance, and securityBuild AI accelerators and reusable components to boost development teams’ productivity. What are we looking for?Minimum8 years of experience implementing ETL/ELT workflows for structured and unstructured data, designing and maintaining data models, schemas, and database structures, and ensuring data quality, validation, governance, security, and compliance. 8 years of experience collaborating with cross-functional teams, including data scientists, analysts, stakeholders, and working in agile, multicultural environments. 4 years of experience automating deployments with CI/CD tools and working with Azure cloud, DevOps, version control systems, and data storage solutions such as data lakes and data warehouses. 4 years of experience with Python, R, SQL, troubleshooting, and debugging. 3 years of experience designing and developing scalable data pipelines using Apache Spark on Databricks, including performance optimization, integration with Azure Data Factory, and use of Unity Catalog or Delta Lake. 3 years of hands-on experience with Databricks notebooks, clusters, jobs, Delta Lake, and a strong understanding of Spark architecture, RDDs, DataFrames, and Spark SQL. 2 years of experience building AI accelerators and reusable components, implementing GenAI/LLM applications and utilities, and supporting AI governance, observability, evaluation, vector stores, traceability, and SIEM integration. 2 years of knowledge of ML libraries such as MLflow, Scikit-learn, and TensorFlow. PreferredDatabricks Certified Associate Developer for Apache Spark. Azure Data Engineer Associate certification. Exciting Opportunity Details Rate: $86.00/hour W2 Contract Worksite Location: Austin, Tx 78751 Hybrid10 month contract with opportunity for extensionThe Peak Performers difference Excellent medical health, dental & vision insurance at 60 days Our employees may choose to participate in a 403(b) retirement plan Qualified applicants with chronic medical conditions and/or disabilities receive priority placement We pay weekly through direct deposit In business since 1994 and thousands of job placements All employment offers are contingent on the successful completion of a pre-employment criminal background check, in compliance with all applicable federal and state laws.Applicants for employment with Peak Performers must possess work authorization that does not require sponsorship for a visa now or in the future.Peak Performers is an equal opportunity employer and will consider all applicants without regard to race, marital status, sex, age, color, religion, national origin, veteran status, disability or any other characteristic protected by law. Peak Performers does not accept unsolicited resumes from headhunters, recruitment agencies or fee-based recruitment services.Hv79684193