Steneral Consulting

The ideal candidate will have a proven track record in designing and delivering Microsoft Azure Integration solutions and building modern data pipelines using ADLS & ADF. We are seeking someone who can design, create, and deliver a range of Azure platform elements and who has a proven track record of solution excellence.. The resource will be a member of data management team and be responsible for designing and engineering ETL pipelines from corporate systems using a combination of Azure Data Factory, Azure Data Lake and Azure Databricks.. Create, maintain & grow highly scalable data pipelines across Azure Data Lake Storage, Azure Data factory and Databricks. Minimum 3 years of experience in managing databases, Azure Data Platform services - Azure Data Lake (ADLS), Data factory (ADF), Databricks, SQL Server, Data Warehouse etc.. Minimum 2 years of experience in Azure Databricks and Delta files.

data engineer

Data Engineer (Contract) Top Skills <ul><li>Azure Data Factory/ADLS, </li><li>Databricks, SQL, </li><li>Data Replication - a plus </li></ul>Overview The ideal candidate will have a proven track record in designing and delivering Microsoft Azure Integration solutions and building modern data pipelines using ADLS & ADF. We are seeking someone who can design, create, and deliver a range of Azure platform elements and who has a proven track record of solution excellence. The resource will be a member of data management team and be responsible for designing and engineering ETL pipelines from corporate systems using a combination of Azure Data Factory, Azure Data Lake and Azure Databricks. Responsibilities <ul><li>Create, maintain & grow highly scalable data pipelines across Azure Data Lake Storage, Azure Data factory and Databricks </li><li>Maintain and build schedules for the data pipelines to run effectively</li><li>Set up and maintain daily health checks on different pipelines</li><li>Respond to, triage, and debug pipelines when there is a problem</li><li>Contribute to the continued evolution of analytics platform and integrated data model</li><li>Identify gaps and weaknesses in our data stack and continue to guide learning advancements for the team</li><li>Provide technical expertise and leadership to data management team in all phases of work including analysis, design, and architecture to develop and implement cutting-edge solutions</li><li>Create & maintain documentation of solutions (e.g., data models, configurations, and setup)</li><li>Implement data validation and cleansing routines to maintain data accuracy and integrity. </li></ul>Required Experience, Education And Skills <ul><li>Minimum 10 years of IT professional experience in data engineering field</li><li>Minimum 7 years of experience working/designing/optimizing on MS SQL, stored procedures, SSIS and relational databases and database design</li><li>Minimum 4 years of experience in creating legacy application logic and functionality into Azure Data Factory/Data Lake, SQL Database and SQL Datawarehouse environment.</li><li>Minimum 3 years of experience in working with dataflows in Azure Data Factory (ADF) </li><li>Minimum 3 years of experience in working with data extraction from REST API call and SFTP.</li><li>Minimum 3 years of experience in managing databases, Azure Data Platform services - Azure Data Lake (ADLS), Data factory (ADF), Databricks, SQL Server, Data Warehouse etc.</li><li>Minimum 2 years of experience in Azure Databricks and Delta files.</li><li>Experience with any data replication tools is a plus </li></ul>Competency/Soft Skills <ul><li>Proactive self-starter with a strong work-ethics, accountability and responsibility for the accuracy and completeness of assigned work and results</li><li>Excellent Communication and Customer Service Skills.</li><li>Must be able to work individually and as part of a team to achieve common goals.</li><li>Ability to effectively manage time and prioritize workload with competing/changing priorities.</li><li>Comply with all laws, regulations, and company policies</li><li>Travel when required</li></ul>

START NEW SEARCH