Data Engineer - Databricks Migration
Data Engineer - Databricks Migrations*This is a mid level "do-er" role. Not senior / architect level*Start: 2 weeks from date of offer
Location: Remote - working PST hours
Length of contract: 6 months
Hourly Pay:
60-64 p/hr on W2*Background Check Required**W2 Contract Only*Responsibilities: Ingests: Design and implement Databricks ingestion processes, leveraging Databricks skills, customer tools and skills with different types of sources. Design and Build: Design silver and gold tables in Databricks based on existing solutions deployed in Health Catalyst installed on Microsoft SQL Server. Collaborate and Develop: Work collaboratively with Business Intelligence analysts and Business Intelligence developers to design and build silver and gold tables. Design and Code Reviews: Prepare for and participate in design and code reviews according to customer design standards. Test and Troubleshoot: Participate in testing methodologies, ensuring the functionality and integrity of our reporting solutions. Troubleshoot and resolve errors and solve complex technical problems. Compliance: Ensure adherence to corporate policies and privacy regulations like HIPAA.Experience/skills: SQL Proficiency: Strong SQL experience writing queries, creating tables, and performing updates with Transact SQL and DB SQL. ETL Expertise: Strong experience writing ETL with Azure Databricks, DBSQL, Microsoft SQL Server, Transact SQL, SSIS. Data Ingestion: Experience ingesting data from many different types of sources (RDBMS, XML files, JSON files, Flat files, APIs) Database Expertise: Experience with database management systems, including performance optimizing and tuning and security Design Experience: Experience with data warehousing methodologies and data model development Additional Experience: Experience with Power BI, Health Catalyst, and Epic is a plus Communication/Collaboration: Speak up quickly when something is discovered, listen and work with others to solve problems, share lessons learned from prior migrations. Required criteria: Experience: Minimum of 4 years of related experience