Sr. Databricks Developer

About Client:The client provides information technology (IT) services, including business outsourcing, infrastructure technology, and application services. The application service offered by the company includes application development, maintenance, and support. The markets served by the company are financial services and insurance, healthcare, manufacturing, government, transportation, communications, and consumer and retail industries.Rate Range: $65-$70/HrJob Description:We are looking for a Databricks Developer with strong experience in Python and Apache Spark to design, develop, and optimize scalable data pipelines and cloud-based data solutions.The ideal candidate will have hands-on expertise in Databricks, PySpark, SQL, and modern data engineering practices.Key Responsibilities:Design, develop, and maintain ETL/ELT pipelines using Databricks and PySparkBuild scalable batch and real-time data processing solutions using Apache SparkDevelop data transformation workflows using Python, PySpark, and Spark SQLImplement Delta Lake solutions and optimize data processing performanceCreate and manage Databricks notebooks, jobs, and workflowsEnsure data quality, validation, logging, and exception handlingOptimize Spark performance using partitioning, caching, and tuning techniquesCollaborate with cross-functional teams to gather requirements and deliver solutions- Support CI/CD, deployment automation, and production releasesTroubleshoot and resolve issues in data pipelines and platform processes.Required Skills:-Strong hands-on experience with DatabricksStrong Python programming skillsExpertise in Apache Spark, PySpark, and Spark SQL- Strong SQL and data transformation skillsExperience with Delta Lake and lakehouse concepts- Knowledge of ETL/ELT and data pipeline designExperience with AWS, Azure, or GCP- Familiarity with Git, CI/CD, and Agile practicesGood problem-solving and communication skillsPreferred Skills:Experience with Airflow, Azure Data Factory, or Databricks WorkflowsKnowledge of Kafka or streaming frameworksExperience with MLflow or analytics platformsUnderstanding of data governance and security best practicesAbout ApTask:ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management. With a focus on excellence, collaboration, and innovation, ApTask provides unparalleled opportunities for professional growth and development. As a member of the ApTask team, you will have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success across diverse industries. Join us at ApTask and be part of our mission to empower organizations to thrive while fostering a diverse and inclusive work environment.Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.Candidate Data Collection Disclaimer:At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.If you have any concerns or queries about your personal information, please feel free to contact our compliance team at businessexcellence@aptask.comApplicant Consent:By submitting your application, you agree to ApTask's (www.aptask.com) Terms of Use and Privacy Policy, and provide your consent to receive SMS and voice call communications regarding employment opportunities that match your resume and qualifications. You understand that your personal information will be used solely for recruitment purposes and that you can withdraw your consent at any time by contacting us at 732-355-8000 or help@aptask.com. Message frequency may vary. Msg & data rates may apply.About ApTask:ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-owned company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management. With a focus on excellence, collaboration, and innovation, ApTask provides unparalleled opportunities for professional growth and development. As a member of the ApTask team, you will have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success across diverse industries. Join us at ApTask and be part of our mission to empower organizations to thrive while fostering a diverse and inclusive work environment.Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.Candidate Data Collection Disclaimer:At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.If you have any concerns or queries about your personal information, please feel free to contact our compliance team at compliance@aptask.com.Applicant Consent:By submitting your application, you agree to ApTask's (www.aptask.com) Terms of Use and Privacy Policy, and provide your consent to receive SMS and voice call communications regarding employment opportunities that match your resume and qualifications. You understand that your personal information will be used solely for recruitment purposes and that you can withdraw your consent at any time by contacting us at 732-355-8000 or help@aptask.com. Message frequency may vary. Msg & data rates may apply.