JOBSEARCHER

Data Architect

Job description: Location: Dallas, Texas OR Tampa, FlClient: Telecom Top Required Skills (Must Have)1. BigQuery (Expert): partitioning, clustering, materialized views, query tuning, execution plan analysis, slot and reservation management, cost optimization2. GCP (Strong hands-on): GCS, Dataproc, Airflow/Cloud Composer, IAM, and core GCP data services3. SQL (Advanced): complex analytical SQL and BigQuery SQL optimization4. Python: pipeline development and automationKey ResponsibilitiesGCP and BigQuery (Primary Focus)
  • Design and build end-to-end data pipelines on GCP using BigQuery, GCS, Dataproc, and Airflow
  • Model and tune BigQuery datasets for performance and cost using partitioning, clustering, and materialized views
  • Optimize slow or expensive queries using execution plans and INFORMATION_SCHEMA job metadata
  • Manage slot usage, reservations, and cost controls; track and report spend
  • Set BigQuery standards for schema design, query patterns, and data lifecycle
  • Lead migration of data and processing from Hadoop, Teradata, and Oracle into GCP and BigQueryData Engineering
  • Build batch and real-time pipelines using Spark, PySpark, Kafka, and Apache NiFi
  • Maintain and modernize Hadoop ecosystem workloads (HDFS, Hive, Sqoop, Oozie) during transition to GCP
  • Rewrite legacy Hive and SQL logic into efficient BigQuery SQL
  • Design data lake and warehouse models on GCPQuality and Delivery
  • Implement data quality checks and monitoring using DataBuck, Splunk, Grafana, Kibana, and Opsgenie
  • Automate builds and deployments with Jenkins, Docker, Kubernetes, Ansible, and Git
  • Troubleshoot pipeline failures and deliver lasting fixes
  • Document designs, data flows, and runbooksTechnical Leadership
  • Lead a team of data engineers while staying hands-on in design and code
  • Own GCP and BigQuery architecture decisions and set engineering standards
  • Review code, queries, and pipeline designs for performance and cost
  • Mentor engineers on BigQuery optimization and GCP best practices
  • Partner with architects, product owners, and business stakeholders on scope and deliveryAdditional SkillsAdditional Required Skills
  • Hadoop ecosystem: HDFS, Hive, Spark/PySpark, Kafka, Sqoop, Oozie
  • Apache NiFi
  • CI/CD and containers: Jenkins, Docker, Kubernetes
  • Databases: Teradata, Oracle, PostgreSQL
  • Shell scriptingNice to Have
  • GCP Professional Data Engineer certification
  • Scala
  • AWS (EC2, S3, IAM, ELB)
  • dbt or BigQuery BI Engine
  • Oracle BI/middleware (WebLogic, OBIEE, Essbase, ODI) Soft Skills
  • Leads by doing: writes code and reviews it, not just directs
  • Cost-conscious, performance-first mindset
  • Ownership from design through production
  • Clear communication with technical and business stakeholders
  • Mentors engineers and sets team standards