Remote Databricks Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Design and build reliable, scalable data pipelines for ingestion, transformation, normalization, and augmentationWork with structured, semi-structured, and unstructured data across diverse environmentsDevelop approaches to source data from diverse platforms (flat files, databases, APIs, streams, etc.)Develop and maintain data transformation workflows in Databricks using Delta Lake, Spark notebooks, and Unity CatalogCollaborate with cross-functional teams to gather data requirements and translate them into actionable data modelsPerform data quality checks and implement validation logic to ensure reliable outputsCreate basic visualizations to support validation, exploration, and stakeholder communicationOptimize performance of pipelines in cloud and distributed computing environments3+ years of hands-on production Databricks experience with SQL and Python in data engineering rolesExperience with data transformation tools/frameworks such as DLT, dbt, and Apache Spark within the Databricks ecosystemHands-on experience with Databricks, including Delta Lake, Spark notebooks, and Unity Catalog in production environmentsFamiliarity with cloud data platforms (e.g., Azure, AWS)Solid understanding of ETL/ELT processes and pipeline orchestrationExperience with DataOps processes and tools such as Databricks Asset Bundles (DABs) and using version control systems like GitStrong communication and problem-solving skillsProactive in seeking opportunities to learn and grow skillsetPrior experience in a consulting or client-facing rolePreferred:Advanced Databricks experience including Databricks Workflows/Jobs, Lakeflow Connect, Delta Live Tables (DLT), and performance tuning at scaleExperience with modern Data and ML workflow tools (e.g., Airflow, MLflow)Familiarity with data visualization libraries or tools (e.g., matplotlib, Power BI, Tableau)Understanding of best practices in data modeling, data quality, and pipeline monitoringCompetitive financial compensation and utilization bonus plansMedical, Dental, Vision Insurance401k, With 4% MatchingPaid Time OffHealth Savings Account (HSA)/Flexible Spending Account (FSA)Short-Term/Long-Term Disability InsuranceBusiness funded Life Insurance PlanDynamic yet relaxed work atmosphereWide Variety of Growth Opportunities