Data Engineer - Databricks

Overview In this role, you will design and build large-scale data solutions within a cloud-enabled enterprise setting, focusing on data platforms and governance. You will work with Databricks Lakehouse and cloud databases to enable scalable, secure data pipelines that support analytics and decision-making. You will collaborate with cross-functional teams to implement modern data warehousing concepts and maintain system reliability. This is a remote opportunity at a financial firm, offering exposure to advanced data technologies and a strong emphasis on security and uptime. Responsibilitiesdesign and implement large-scale data solutions in an enterprise environmentbuild and manage cloud databases (AWS RDS, DynamoDB, DocumentDB) and Databricks Lakehousedevelop and maintain data pipelines with a focus on security, scale, uptime, and reliabilityapply data warehousing concepts using both traditional and modern distributed technologiesperform data modeling (relational and dimensional) and ensure data governanceutilize CI/CD pipelines in data engineering workflowswork with ETL/ELT tools and technologiesengage in Agile methodologies to deliver iterations and improvementsperform UNIX server administration and general IT tasks as needed Key requirementsBachelor in Computer Science7 years designing and building large-scale enterprise solutions3 years cloud design/build experienceexpertise in cloud databases (AWS RDS, DynamoDB, DocumentDB) or similarexpertise in Databricks Lakehouse or similardeep SQL, data modeling, and governance in relational databasesexperience with data warehousing concepts (Vertica, Teradata) and distributed tech (SparkSQL, Hadoop, Kafka)scripting skills (Python, bash)data platform thinking for secure, scalable pipelinesCI/CD pipeline experienceknowledge of Presto, Hive, SparkSQL, Cassandra, Solr is a plusexperience with Spark, Kafka, Hadoop or similar is a plusexperience with Agile methodologiesETL/ELT tools experience (Talend, Informatica) is a plusCloud Data Warehouses experience (Redshift, BigQuery) is a plusagile mindsetcollaborationproblem-solvingDatabricks LakehouseAWS RDSDynamoDB