GCP Data Engineer

Job Title: GCP Data EngineerLocation: Phoenix, AZ (Hybrid)Job Type: Contract Long Term1. Business Division & Project SummaryBusiness Division: Enterprise Business Intelligence (EBI) – AMEXPosition supports AMEX’s Enterprise Business Intelligence (EBI) organization, specifically the Experience Analytics (XP) team.This division focuses on:Marketing analytics and campaign intelligenceBuilding data pipelines, ETL processes, and insight delivery mechanismsDelivering insights for:AMEX‑initiated campaignsMerchant‑partner campaignsCampaign creative journeys & customer experience pathwaysEnabling multiple reporting/insight delivery channels:Dashboards (Tableau)API‑based insightsReport distributionAudio‑layer reporting (narrative insights) Project Summary (New Workload Coming)A new upcoming initiative is driving the need for hiring. The details are not confirmed yet, but likely include:Creation of a completely new data pipelineDevelopment of new visualization/reporting layers for this pipelineWork within GCP ecosystem — BigQuery, Cloud Composer, DataProc, Spark, Python 2. Role Summary & ResponsibilitiesThe requirement is a hybrid role combining:A. Data Engineering (Primary – ~60–70%)Key responsibilities:Build and maintain ETL pipelinesWork within AMEX’s GCP ecosystem:BigQuery (primary analytics database)Cloud Composer (orchestration)DataProc (Spark/Python‑based ETL jobs)Data curation, aggregation, and transformation (SQL-heavy)Potential work with PySpark depending on pipeline designImplement AI‑powered data quality checks (future roadmap)Contribute to domain-specific datasets (marketing analytics)Tech stack mentioned:PythonPySparkSQLBigQueryGCP (Composer, DataProc)B. Data Visualization / BI Engineering (~30–40%)Responsibilities:Build dashboards for marketing analyticsVisualize campaign journeys, insights & trendsUse Tableau primarily (Power BI is deprioritized)Support multiple insight delivery formats:DashboardsAPI-based insight deliveryNarrative/Audio insightsConvert analytical output into consumable business insightsTools:Tableau(Optional) Power BIAPIs (for insight publishing) 3. Expectations & Role Fit CriteriaA. Core ExpectationsStrong data engineering foundationStrong SQL and BigQuery experienceHands-on with TableauGCP ecosystem familiarity (mandatory)Ability to manage both data pipelines & visualization layersPrior exposure to ETL, Spark, or Python desirable- AI/ML experienceB. Soft SkillsAbility to collaborate with global teams (India + US)Strong communication for requirements gatheringIndependence in handling end‑to‑end data + BI workflows