AWS Data Engineer – Databricks

Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agile methodologies, and data-driven intelligence to modernize systems of engagement and simplify human/tech interaction.Amazing things happen when we work in environments where everyone feels a true sense of belonging and when candidates have the requisite skills and opportunities to succeed. At Droisys, we invest in our talent and support career growth, and we are always on the lookout for amazing talent who can contribute to our growth by delivering top results for our clients. Join us to challenge yourself and accomplish work that matters.AWS Data Engineer – DatabricksLocation: Plano, TX (Hybrid)12 + MonthsMust be open to face to face interviewAbout the RoleWe are looking for an experienced AWS Data Engineer with strong hands-on experience in Databricks to design, develop, and maintain scalable data pipelines and cloud-based data solutions. The ideal candidate should have strong expertise in AWS data services, Databricks, PySpark, SQL, and modern data engineering practices.Databricks experience is mandatory for this role.Key ResponsibilitiesDesign, develop, and maintain scalable ETL/ELT data pipelines on AWS.Build and optimize data processing workflows using Databricks and PySpark.Develop data pipelines using AWS services such as S3, Glue, Lambda, Redshift, and CloudWatch.Work extensively with Databricks Delta Lake, including Delta tables, partitioning, optimization, and schema management.Develop and maintain batch and near-real-time data pipelines.Write complex and optimized SQL queries for data transformation and analysis.Implement data ingestion from databases, APIs, files, and other structured/semi-structured sources.Apply data quality, validation, monitoring, and error-handling mechanisms.Optimize Spark/Databricks jobs for performance and cost efficiency.Implement CI/CD and deployment processes for data engineering workloads.Work with data architects, analysts, and business stakeholders to understand data requirements.Troubleshoot production data pipeline issues and provide root-cause analysis.Follow security, governance, and data management best practices.Mandatory Skills8+ years of experience in Data Engineering.Hands-on Databricks experience is mandatory.Strong experience with AWS cloud services.Strong programming experience in Python and/or PySpark.Strong SQL skills.Hands-on experience with Apache Spark.Experience with Databricks Delta Lake.Experience building and maintaining production-grade ETL/ELT pipelines.Strong understanding of data warehousing and data lake concepts.Experience with AWS S3 and at least some of AWS Glue, Redshift, Lambda, or EMR.Experience with Git and CI/CD practices.Droisys is an equal opportunity employer. We do not discriminate based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. Droisys believes in diversity, inclusion, and belonging, and we are committed to fostering a diverse work environment.