Database Engineer – Databricks
A leader in the financial services industry is hiring a Database Engineer- Databricks in Irvine, CA for a full time position, onsite 2 days a week.
Sponsorship not available for this role.
Database Engineer- Databricks Perks:
Competitive salary up to $150,000 annually.
Working for one of the most trusted names in financial services for more than 100 years, a brand known by millions.
Flexibility and work-life balance.
Working on a caring and supportive team that values your input, shares your goals, and celebrates your success.
Database Engineer- Databricks Requirements:
3+ years of hands-on data engineering experience in a production environment.
Deep Databricks expertise including notebooks, Jobs, Workflows, Unity Catalog governance, and Databricks Certification.
Strong Python, PySpark, and SQL skills for building and debugging distributed data transformations.
Solid MSSQL/SQL Server experience with focus on query optimization, indexing, and performance diagnostics.
Production experience with Apache Airflow — authoring, scheduling, and debugging DAGs.
Database Engineer- Databricks Responsibilities:
Own day-to-day operation and reliability of Databricks jobs, pipelines, compute/cluster configuration, Delta Lake tables, and SQL warehouses.
Develop and optimize Spark transformations across bronze/silver/gold medallion layers including incremental loads via Auto Loader and Structured Streaming.
Administer governance and access through Unity Catalog consistent with PII containment in a regulated lending environment.
Monitor and control DBU consumption and cluster costs through alerting and right-sizing to keep platform spend predictable.
Diagnose and resolve pipeline failures, data quality issues, schema drift, and connectivity problems end-to-end while maintaining runbooks and documentation.
About Profiles:
An award-winning creative and marketing workforce solutions provider. For 25+ years, Profiles has combined deep industry expertise with forward-thinking innovation to help organizations build, scale, and transform their teams. Anyone can fill a role. What we do goes beyond this, supporting workforce strategies that drive competitive advantage in an AI-powered landscape. Offering contract, contract to hire, direct hire, embedded teams, and consulting services nationwide. Join our network. New job opportunities are listed daily - careerprofiles.com.
CH123