Data Engineer and Architect
Role: Sr. Data Engineer and ArchitectLocation: Melville, NY (Long Island, NY) - in office 2-3 days/wk in client officeDesign end to end data architectures on GCP leveragingExperience architecting solutions in Cloud Data Engineering platform (eg: GCP, AWS, Azure)Have you worked closely with client enterprise architect?Have you acted as a mentor to technical offshore data analytics team?Client Management Experience:Experience work closely with client enterprise architect.Act as a mentor to technical offshore data analytics teamData Architecture experience:• Experience architecting solutions in Cloud Data Engineering platform (eg: GCP, AWS, Azure)• Design end to end data architectures on GCP leveraging BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Composer, Cloud Storage, and Looker.• Develop modern data lake, data warehouse, and lakehouse architectures using best practices and well architected frameworks in GCP and prefer to have experience in AWS, Azure & Databricks• Create logical and physical data models, data flow diagrams, integration patterns, and reference architectures.• Architect scalable ETL/ELT pipelines using Dataflow (Apache Beam), Dataproc (Spark), and/or Cloud Composer orchestrations.• Lead cloud-native modernization initiatives: migration from legacy platforms to GCP.2. Data Engineering & Development Oversight• Provide expert guidance to data engineering teams on standards, patterns, and reusable frameworks.• Optimize BigQuery performance including partitioning, clustering, materialized views, BI Engine, and storage optimizations.• Implement data quality, metadata management, observability, and lineage frameworks using tools like Dataplex and Data Catalog.• Ensure CI/CD adoption using Cloud Build, GitHub/GitLab pipelines, and infrastructure-as-code (Terraform).Data Governance & Security• Help define data governance standards including access models, encryption, retention, and data lifecycle management.• Implement IAM policies, VPC Service Controls, organizational policy constraints, and secure data sharing patterns.• Ensure compliance with GDPR, HIPAA, PCI, and internal corporate policies.