Sr Data Engineer

Job Title: Sr Data EngineerJob ID: 87104Location: Calgary, AlbertaWhat you will be doing:Cloud Ecosystem: Primary AWS environment.Architecture: Medallion Architecture (Bronze / Silver / Gold layers) using Apache Iceberg and Hive table formats.Orchestration & Transformation: Implementation via MWAA (Airflow), containerized workloads, and dbt.Query & Performance: Design/optimization of Athena-based query patterns; must understand partitioning strategies and table maintenance (compaction/expiry).Infrastructure: Infrastructure-as-Code (IaC) is critical. Must be proficient in Terraform (and ideally Terragrunt).The "Tenant" Challenge: Troubleshooting and monitoring pipelines across 200+ tenant environments (sports teams/leagues), ensuring strict SLA adherence.Innovation: Strong comfort with AI-assisted development (Claude Code) for pipeline generation and debugging while maintaining human oversight.What you must have:Experience: 5+ years for Senior; 3-5 years for Intermediate.Core Languages: Professional-grade Python and advanced SQL (Athena/Trino dialect).API Mastery: Ability to retrieve/integrate data from vendor API endpoints (REST / GraphQL), handling complex auth and pagination.SDLC: High standards for Git branching strategies, CI/CD pipelines, and documentation.Soft Skills: Curious about the sports/live entertainment industry; clear communicator who can perform data validation with external stakeholders.Salary/Rate Range:$110,000 – $120,000J-18808-Ljbffr