AWS Databricks Developer
AWS Databricks DeveloperLocation: Austin, TX (Hybrid)
Experience: 10+ Years (Look for more exp)
Mandatory skills: Databricks, PySpark, Ab Initio, Teradata, AWS, Healthcare
ResponsibilitiesStrong expertise in Databricks, Spark/PySpark, Teradata, AWS, and DevOps practices while driving end-to-end data engineering initiatives in an Agile environment.
Key ResponsibilitiesCollaborate with business and technical stakeholders to understand requirements and translate them into scalable data solutions.
Design, document, and implement cloud-native data architectures and engineering solutions.
Develop high-performance ETL/ELT pipelines using Spark and PySpark.
Build and optimize data ingestion, transformation, and loading processes for enterprise-scale data platforms.
Technical SkillsSpark & PySpark Development
Databricks (Delta Lake, Notebooks, Pipelines, Cluster Management)
Teradata SQL Development (Teradata SQL, Hive SQL, Spark SQL)
Ab Initio Shell Scripting (Unix/Linux, KSH)
AWS Cloud Services (S3, EC2, Lambda, Glue, SNS, SQS, ECS, IAM, CloudWatch)
Data Warehouse & Data Lake Implementation
CI/CD & DevOps Tools (Git, Jenkins, Artifactory)
Production Support & Monitoring
Agile Methodologies
Preferred Skills: Jira & Confluence. Healthcare Domain Experience Enterprise Scheduling Tools (CA7) Cloud Data Migration & Modernization Azure/AWS Integration
Educational Qualifications: Engineering Degree – BE/ME/BTech/MTech/BSc/MSc. Technical certification in multiple technologies is desirable.