Upvote
Downvote
Databricks Architect - IT / Software Development
Share Job
- Suggest Revision
- Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)
- Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring
- Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs
- Lead Data Engineering Projects to manage and implement data-driven communication systems
- 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
Active Job
Updated 5 days agoSimilar Job
Relevance
Active