Lead Engineer, Data Platform

Location: RemoteTop Skill 8 - 10 years of experience in data engineering and designing scalable ETL pipelines Advanced Proficiency in Hadoop, Scala, Spark, Kafka and SQL6+ years of experience with cloud platforms like Azure, AWS, GoogleBe skilled at architecting large and complex data pipelines. Experience performing data analysis and data exploration. Experience working with Cloud technologies, Azure, Databricks, ADLS, Spark, Cosmos DB, and other big data technologies. Experience working in an agile delivery environment. Experience working in multi-developer environment, using version control. Excellent knowledge in data structures and design patterns Preferred experience with data integration tools Work with cross-functional agile teams to drive projects through the full development cycle. Help the team improve with the usage of data engineering best practices. Write SQL for processing raw data, data validation and QAKnowledge working with APIs to collect or ingest data Strong Database knowledge, SQL & No-SQL preferred Communication Skills Data Engineers are part of a team, working with database administrators, data analysts and management and need to be effective communicators. Problem-Solving Skills Data Engineers look at an issue that needs to be solved and come up with solutions quickly. Experience integrating and building data platform in support of BI, Analytics, Data Science, and real-time applications. Strong communication skills, with the ability to initiate and drive projects proactively and accurately