Sr Data Engineer
Overview
In this role you will design and build data pipelines to connect, collect, and cleanse data from diverse sources. You will implement SQL, Hive queries, and APIs to extract data, and collaborate with data scientists to ensure reliable, aggregated source data. You’ll partner with product managers and cloud/data architects to shape scalable cloud pipelines, with DevOps supporting automation. This position suits a hands-on engineer driving data quality and end-to-end data solutions in a finance-focused context.
ResponsibilitiesAnalyze data sources and APIs to determine integration approachesDesign and develop methods to connect and collect data from diverse sourcesDesign and implement data filtering and cleansing processesDevelop SQL, Hive queries and APIs to extract data from storesCollaborate with data scientists to ensure data is cleansed and aggregatedCoordinate with product managers to understand business objectives and translate them into data solutionsWork with cloud/data architects to define robust cloud-based architectures, pipelines, and workflowsPartner with DevOps to build automated data pipelines
Key requirements4-10 years of relevant experienceclient-facing roles and excellent communication skillsexperience with finance & banking domain knowledge (fraud, payments)Big Data-Hadoop, NoSQL, Hive, Apache SparkPythonJava & RESTGit and version controlstrong communicationcross-functional collaborationhigh accountabilityBig Data-HadoopNoSQLHive