Data Engineer
Job Description:
Minimum 5+ years of IT experience and minimum 1+ years of hands-on experience in Databricks with validated knowledge in designing database models to store structured & unstructured data efficiently and in creating effective data tools for analytics experts along with following:
o Familiarity with Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution, ACID compatibility, History capture etc.
o Integrating Databricks with various ETL/Orchestration tools and perform required operations.
o Expertise in Spark ecosystems, Data frame API, Data set API, RDD APIs & Spark SQL.
o Expertise in workspace and cluster configuration, performance tuning and log monitoring.
o Experience with structured streaming along with streaming frameworks.
o Hands on experience with Python, Scala and SQL.
o Create and maintain optimal data pipeline architecture with knowledge in best practices from Databricks around Cluster setup/Development/Deployment
o Strong understanding of Data Modelling and defining conceptual logical and physical data models.
o Experience in building Data Engineering solutions using AWS/Azure native stack
o Experience in managing various client relationships to get consensus on solutions.
o Nice to have AI/ML skill and any architect level certification from Databricks
You can also share your resume at ashish@bslci.com
Thanks & Regards
Ashish Singh
Contact: +1(512)-866-3413
BSL CONSULTING
Job Type: Full-time
Pay: Up to $100,000.00 per year
Benefits:
Dental insurance
Health insurance
Schedule:
8 hour shift
Experience:
Databricks: 2 years (Required)
SQL: 5 years (Required)
Data warehouse: 6 years (Required)
Work Location: On the road