Upvote
Downvote
Data Engineer
Share Job
- Suggest Revision
Full-time
- What we do: As a member of Markets Technology Delivery supporting the Markets business domain; the area responsible for the Auctions, Trading Desks and Operations, you will contribute to financial applications and tools in support of Markets’ auctions, trading, operations planning, and execution.
- Your role as a Data Engineer: In this role you will be responsible for designing, developing, and maintaining data pipelines in support of data management functions such as data engineering, data integration and data quality and governance activities.
- You must be passionate about data management with a solid background in AWS, Databricks, Python, Trino/Starburst, Databases and SQL.Design, develop, monitor, and maintain data pipelines in an AWS Gov Cloud ecosystem with AWS, Databricks, Delta Lake and Trino as the underlying platforms.
- Automate testing of the data pipelines and configure as part of CICD.Optimize data processing and query performance for large-scale datasets within AWS and Databricks environments.
- Troubleshooting and debugging data-related issues on the AWS Databricks platform.
Active Job
Updated TodaySimilar Job
Relevance
Active