JOBSEARCHER

AWS Databricks Developer

AWS Databricks DeveloperLocation: Austin, TX (Hybrid) Experience: 10+ Years (Look for more exp) Mandatory skills: Databricks, PySpark, Ab Initio, Teradata, AWS, Healthcare ResponsibilitiesStrong expertise in Databricks, Spark/PySpark, Teradata, AWS, and DevOps practices while driving end-to-end data engineering initiatives in an Agile environment. Key ResponsibilitiesCollaborate with business and technical stakeholders to understand requirements and translate them into scalable data solutions. Design, document, and implement cloud-native data architectures and engineering solutions. Develop high-performance ETL/ELT pipelines using Spark and PySpark. Build and optimize data ingestion, transformation, and loading processes for enterprise-scale data platforms. Technical SkillsSpark & PySpark Development Databricks (Delta Lake, Notebooks, Pipelines, Cluster Management) Teradata SQL Development (Teradata SQL, Hive SQL, Spark SQL) Ab Initio Shell Scripting (Unix/Linux, KSH) AWS Cloud Services (S3, EC2, Lambda, Glue, SNS, SQS, ECS, IAM, CloudWatch) Data Warehouse & Data Lake Implementation CI/CD & DevOps Tools (Git, Jenkins, Artifactory) Production Support & Monitoring Agile Methodologies Preferred Skills: Jira & Confluence. Healthcare Domain Experience Enterprise Scheduling Tools (CA7) Cloud Data Migration & Modernization Azure/AWS Integration Educational Qualifications: Engineering Degree – BE/ME/BTech/MTech/BSc/MSc. Technical certification in multiple technologies is desirable.