Data Engineer

Job TitleRequired Skills:Education University degree in any IT discipline Minimum 5+ years of experience in the IT industry Expected Skills 7+ Experience in Data Engineering if applying for a Sr Data Engineer Role. Or 4yrs Experience in Data Engineering if applying for Data Engineer Role.Proven technology champion in working with relational, Data warehouses databases, query authoring (SQL) as well as working familiarity with a variety of databases.Experience/Knowledge in working with NoSQL databases and can create E2E pipelines.Experienced in building and optimizing complex queries. Good with manipulating, processing, and extracting value from large, disconnected datasets.Proven Experience in working with any one of the data engineering technologies like ADLS, ADF, Azure Databricks, Azure SQL, Synapse, SAP HANA, AWS.Your experience in handling big data sets and big data technologies will be an asset.Proven champion with in-depth knowledge of any one of the scripting languages: Python, SQL, Spark-SQL/ PySpark.Very Good understanding in Data Foundation initiatives, like Modelling, Data Quality Management, Data Governance, Data Maturity Assessments and Data Strategy in support of the key business stakeholders.Experience in working with AGILE, KANBAN methodologies. Able to run a sprint.Communication Skills to engage both technical developers, Architects, and stakeholders.Nice to Have SkillsPreviously created or enhanced CI/CD build and releases pipelines.Experience in working with scripting languages such as YAML, PowerShell, Terraform etc.Experience with big data tools: Kafka, Hadoop, Spark, and similar technologies.Experience with stream-processing systemsExperience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow and more.Core Python skills like: NumPy, Panda, Django