Data Engineer

The Job:Are you an experienced Data Engineer with a strong foundation in Databricks, SQL, and Python?We are seeking a talented individual to design, implement, and maintain the data infrastructure that drives business intelligence, analytics, and data science initiatives for a global business. In this role, you will use Databricks, SQL, Spark, and Python to develop scalable ETL/ELT pipelines, optimize data workflows, and manage data warehouses and data lakes.You'll play a critical role in integrating data from various sources and ensuring the availability of clean, reliable data. You will also be responsible for automating data processes, supporting BI tools, and participating in data governance to maintain high data quality standards.Responsibilities:Data Pipeline Development: Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and other big data technologies. Optimize data workflows to handle large volumes of data efficiently.Data Warehousing & Management: Build and manage data warehouses and data lakes to store both structured and unstructured data. Utilize SQL, Python, and Spark for data extraction, transformation, and loading (ETL) processes.Data Quality & Governance: Implement data quality checks and develop governance policies to maintain high standards of data accuracy, completeness, and consistency.Business Intelligence & Reporting: Develop and support BI tools and dashboards, providing business insights and data-driven decision-making support.Automation & Optimization: Automate repetitive data processing tasks to improve efficiency, continuously monitor pipeline performance, and address bottlenecks.About You:Experience: 4-6 years of experience in data engineering with a strong focus on big data technologies, particularly in Databricks, SQL, Python, and Spark.Technical Skills: Advanced SQL skills, strong programming in Python, and proficiency in using Databricks for data engineering tasks. Familiarity with BI tools like Tableau or Power BI, and experience with cloud platforms, particularly Azure.Additional Skills: Experience with data modeling and data architecture design. Understanding of machine learning concepts and their application in data engineering is a plus.Attributes: Strong attention to detail, excellent organizational skills, ability to lead data initiatives, and strong interpersonal skills to collaborate effectively with cross-functional teams.The Company:My client is a prominent global consultancy working with a leading tech business, dedicated to delivering innovative solutions and maintaining a high standard of excellence. They offer a dynamic and supportive work environment with opportunities to engage with cutting-edge technologies. You will work remotely and collaborate with international teams, contributing to a culture of continuous improvement and knowledge sharing.Salary, Location & Process:Salary: $30 per hour - initial 6-month contract with possibility to extendLocation: 100% remote, with a required overlap of 4 hours in US East Coast Time Zone, then flexible.Interview Process: 3-stage interview process