Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Job Description:
Minimum 5+ years of IT experience and minimum 1+ years of hands-on experience in Databricks with validated knowledge in designing database models to store structured & unstructured data efficiently and in creating effective data tools for analytics experts along with following:
o Familiarity with Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution, ACID compatibility, History capture etc.
o Integrating Databricks with various ETL/Orchestration tools and perform required operations.
o Expertise in Spark ecosystems, Data frame API, Data set API, RDD APIs & Spark SQL.
o Expertise in workspace and cluster configuration, performance tuning and log monitoring.
o Experience with structured streaming along with streaming frameworks.
o Hands on experience with Python, Scala and SQL.
o Create and maintain optimal data pipeline architecture with knowledge in best practices from Databricks around Cluster setup/Development/Deployment
o Strong understanding of Data Modelling and defining conceptual logical and physical data models.
o Experience in building Data Engineering solutions using AWS/Azure native stack
o Experience in managing various client relationships to get consensus on solutions.
o Nice to have AI/ML skill and any architect level certification from Databricks
You can also share your resume at ashish@bslci.com
Thanks & Regards
Ashish Singh
Contact: +1(512)-866-3413
BSL CONSULTING
Job Type: Full-time
Pay: Up to $100,000.00 per year
Benefits:
Dental insurance
Health insurance
Schedule:
8 hour shift
Experience:
Databricks: 2 years (Required)
SQL: 5 years (Required)
Data warehouse: 6 years (Required)
Work Location: On the road