Data Engineer

MUST:5 years minimum as data engineerVery strong with pipelines with one of these: Synapse OR Azure data factory/data bricksVery strong with writing notebooks and very strong with sparkVery strong with data Lakehouse developmentUnderstands how to build out a Datawarehouse, temp tablesStrong coding in either python or sqlUnderstand Source code, git for source codeExperience with either: Azure devops or Jiraproven experience building robust scalable ETL/ELT pipelinesComes from a regulated environment – banking is idealExperience working with various sources for data: with SFTP integrations, api’s, direct database connectionsPLUS:Powerbi exposureFabric- nice to have from ETL standpointBankingDAY TO DAY:Our client is building out a new “align team” to help build a new datawarehouse. The Senior Data Engineer will build, develop, and maintain robust, scalable ETL/ELT pipelines using Azure Synapse, Azure Data Factory, Databricks, Spark, Python, and SQL. The Data Engineer will write and optimize Spark notebooks to transform and process large volumes of data within a data lakehouse environment. The Data Engineer will design and develop data warehouse solutions, including data models, temporary tables, data transformations, and integrations. This person will collaborate with business and operations teams to understand requirements and develop scalable data engineering solutions that support business needs.You will participate in the full database development lifecycle, including design, development, testing, deployment, and ongoing maintenance. The Data Engineer will develop and maintain integrations using SFTP, APIs, and direct database connections while ensuring data quality, security, scalability, and reliability. The Data Engineer will use Git and Azure DevOps or Jira to manage source code, track development work, and support development processes. The Data Engineer will troubleshoot and optimize pipelines, contribute to database development standards and best practices, and work within a regulated environment to ensure compliance with applicable requirements. The Data Engineer will also mentor and provide technical guidance to fellow data engineers and may support Power BI and Microsoft Fabric initiatives as needed.