Databrick Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Mid Level Marketing Data Platform DeveloperSimilar to previous reqs. Looking for someone that is more mid-level. Someone that can come in and be heads down and deliver on user stories. Knowledge of Kafka would be helpful. Uses Kafka to stream on-prem data to azure. Azure, Python/Pyspark for the ETL. This person is ingesting the data, some data curation.Project: Marketing Data Platform (used to enable real time campaigns and data for other teams). Building new cloud data warehouse solution, that is built in SnowFlake. Consume real time data through Kafka (coming from multiple sources). Data gets uploaded to SnowFlake. Framework is built, but they are in the initial stages.What are the top 5-10 responsibilities for this position (please be detailed as to what the candidate is expected to do or complete on a daily basis)?Should have prior experience managing Data lake and data warehouse type applicationShould have prior experience managing big data platform to ingest / transform time series, batch data for real time access1 to 3 years of experience with Snowflake/synapse, Databricks, Kafka, eventHub, Spark.Should have experience with data security and governance guidelineShould have experience managing such application on cloud (preferably Azure) platform and also understand native cloud concept such as eventHub, ADLS, Azure data factory.Should have experience managing various kind of BI tools for reporting like tableauWhat does the ideal candidate background look like (ex: healthcare specific background specific industry experience etc.)?ETL, Data warehousing, Python experienceWhat skills/attributes are required (please be detailed as to number of years of experience for each skill)?Undergraduate degree or equivalent experience5 + year of IT experience1 to 3 years of experience with Snowflake/synapse, Databricks, Kafka, eventHub, Spark. [required]What skills/attributes are preferred (what will set a candidate apart)?1 to 3 or more years of experience with Snowflake/synapse, Databricks, Kafka, eventHub, Spark.