Big Data Lead
Job Description :
Location - US (remote) . East coast preferable
Primary Skill :
Technical Lead -Data Engneering
Azure databricks- Build Data Pipelines using ADB-Leveraging Python and Spark
Build Data Transformation in ADB
Convert Scala Pgms to Py Spark Pgms
Understand the SCALA program in DataBricks
ADF
Secondary Skills:
Azure data lake gen 2
Synapse analytics (dedicated SQL pool)
Exp in delta Lake
Pyspark
Nice to Have : Tidal Scheduler , Exp in Healthcare Domain