Azure Data Engineer

Greetings from Smart IT Frame, Hope you are doing well!Smart IT Frame specializes in enabling you with your most critical line of resources. Whether it is for permanent staffing, contract staffing, contract-to-hire or executive search, we understand the importance of delivering the most suitable talent; on time and within budget. With our Core focus in emerging technologies, we have provided global technology workforce solutions in North America, Canada & India. We take pride in delivering specialized talent, superior performance, and seamless execution to meet the challenging business needs of customers worldwide.Role: Azure Data EngineerLocation: US RemoteType: ContractRequired Skills:Data Engineer : 8-10 yearsAzure : 8 years - ExpertADF : 6 years - ExpertDataBricks : 6 years- ExpertSpark (PySpark, SparkSQL): 6 years – ExpertAzure DevOps CI/CD : 4 yearsJob Descriptions:We operate in an Azure + Databricks Lakehouse. We’ll need a person with:Azure experience – ADF for orchestration, ADLS for storage, AzureDevOps for CI/CDDatabricks experience – all compute/ETL leverages Databricks and is programmed leveraging Spark (PySpark, SparkSQL)PowerShell experience – this is our scripting language of choiceSQL proficiency – it’s used everywhere (TSQL, PostgreSQL)Proficiency with parquet and delta formatsAdditionally – they will need experience in:SDLC + CI/CD – we follow a standard deployment process (dev, test, prod) that includes peer reviewed code. They need to be comfortable with standard DevOps practices.Should have a deep understanding of indexes and partitioning.Should be proficient optimizing code for performance (able to read a DAG, determine where CBO is using most resources)Should be proficient in writing code in a matter that it can run repeatedly and produce the same state (we have a custom SQL Deployment framework)