Data Engineer

Job Description: Minimum 5+ years of IT experience and minimum 1+ years of hands-on experience in Databricks with validated knowledge in designing database models to store structured & unstructured data efficiently and in creating effective data tools for analytics experts along with following: o Familiarity with Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution, ACID compatibility, History capture etc. o Integrating Databricks with various ETL/Orchestration tools and perform required operations. o Expertise in Spark ecosystems, Data frame API, Data set API, RDD APIs & Spark SQL. o Expertise in workspace and cluster configuration, performance tuning and log monitoring. o Experience with structured streaming along with streaming frameworks. o Hands on experience with Python, Scala and SQL. o Create and maintain optimal data pipeline architecture with knowledge in best practices from Databricks around Cluster setup/Development/Deployment o Strong understanding of Data Modelling and defining conceptual logical and physical data models. o Experience in building Data Engineering solutions using AWS/Azure native stack o Experience in managing various client relationships to get consensus on solutions. o Nice to have AI/ML skill and any architect level certification from Databricks You can also share your resume at ashish@bslci.com Thanks & Regards Ashish Singh Contact: +1(512)-866-3413 BSL CONSULTING Job Type: Full-time Pay: Up to $100,000.00 per year Benefits: Dental insurance Health insurance Schedule: 8 hour shift Experience: Databricks: 2 years (Required) SQL: 5 years (Required) Data warehouse: 6 years (Required) Work Location: On the road