Data Architect
Job description:
Location: Dallas, Texas OR Tampa, FlClient: Telecom Top Required Skills (Must Have)1. BigQuery (Expert): partitioning, clustering, materialized views, query tuning, execution plan analysis, slot and reservation management, cost optimization2. GCP (Strong hands-on): GCS, Dataproc, Airflow/Cloud Composer, IAM, and core GCP data services3. SQL (Advanced): complex analytical SQL and BigQuery SQL optimization4. Python: pipeline development and automationKey ResponsibilitiesGCP and BigQuery (Primary Focus)
- Design and build end-to-end data pipelines on GCP using BigQuery, GCS, Dataproc, and Airflow
- Model and tune BigQuery datasets for performance and cost using partitioning, clustering, and materialized views
- Optimize slow or expensive queries using execution plans and INFORMATION_SCHEMA job metadata
- Manage slot usage, reservations, and cost controls; track and report spend
- Set BigQuery standards for schema design, query patterns, and data lifecycle
- Lead migration of data and processing from Hadoop, Teradata, and Oracle into GCP and BigQueryData Engineering
- Build batch and real-time pipelines using Spark, PySpark, Kafka, and Apache NiFi
- Maintain and modernize Hadoop ecosystem workloads (HDFS, Hive, Sqoop, Oozie) during transition to GCP
- Rewrite legacy Hive and SQL logic into efficient BigQuery SQL
- Design data lake and warehouse models on GCPQuality and Delivery
- Implement data quality checks and monitoring using DataBuck, Splunk, Grafana, Kibana, and Opsgenie
- Automate builds and deployments with Jenkins, Docker, Kubernetes, Ansible, and Git
- Troubleshoot pipeline failures and deliver lasting fixes
- Document designs, data flows, and runbooksTechnical Leadership
- Lead a team of data engineers while staying hands-on in design and code
- Own GCP and BigQuery architecture decisions and set engineering standards
- Review code, queries, and pipeline designs for performance and cost
- Mentor engineers on BigQuery optimization and GCP best practices
- Partner with architects, product owners, and business stakeholders on scope and deliveryAdditional SkillsAdditional Required Skills
- Hadoop ecosystem: HDFS, Hive, Spark/PySpark, Kafka, Sqoop, Oozie
- Apache NiFi
- CI/CD and containers: Jenkins, Docker, Kubernetes
- Databases: Teradata, Oracle, PostgreSQL
- Shell scriptingNice to Have
- GCP Professional Data Engineer certification
- Scala
- AWS (EC2, S3, IAM, ELB)
- dbt or BigQuery BI Engine
- Oracle BI/middleware (WebLogic, OBIEE, Essbase, ODI) Soft Skills
- Leads by doing: writes code and reviews it, not just directs
- Cost-conscious, performance-first mindset
- Ownership from design through production
- Clear communication with technical and business stakeholders
- Mentors engineers and sets team standards