Data Engineer

Drishticon is a Silicon Valley-based IT consulting and technology solutions company specializing in enterprise ecommerce, cloud technologies, systems integration, digital transformation, and mission-critical business platforms. We partner with startups and Fortune 500 organizations to deliver innovative, scalable, and cost-effective technology solutions through onsite and offshore delivery models.We have immediate requirement for a Lead Data Engineer (US)– Data & AI, Supply Chain with our direct clients in Pleasanton CA. The position is a long term contract and onsite position.Candidate is expected to work onsite 3-4 days in Pleasanton CA.Looking for candidates who can work on W2Experience required: 6 to 10 yrsAbout the RoleClient is seeking an experienced Lead Data Engineer to join the Supply Chain Data & AI Organization. This role will support the design, development, and delivery of enterprise data products and analytics solutions across the Sourcing, Transportation, and Warehouse Management (WMS) domains.The ideal candidate is a hands-on technical leader with deep expertise in building modern cloud-native data platforms on Google Cloud Platform (GCP). You will collaborate with Product Managers, Solution Architects, Data Architects, Business SMEs, and engineering teams to develop scalable, high-quality data solutions that enable advanced analytics, and AI-driven decision making.Key Responsibilities• Design, develop, and implement scalable data pipelines and data products on Google Cloud Platform (GCP).• Build and optimize enterprise data solutions using Dataproc, BigQuery, SQL, and dbt.• Design robust and scalable data models that support analytical and operational reporting requirements.• Develop efficient ETL/ELT pipelines to ingest, transform, and publish data from multiple enterprise systems.• Collaborate with Product Managers, Business Analysts, Enterprise Solution Architects, Data Architects, and business stakeholders to translate business requirements into scalable technical solutions.• Lead technical design discussions and perform code reviews to ensure engineering quality and adherence to standards.• Optimize data processing performance, reliability, scalability, and cost across cloud-based data platforms.• Implement monitoring, testing, and operational best practices to support production workloads.• Contribute to reusable frameworks, engineering standards, and documentation that improve team productivity and solution consistency.• Support production issue resolution and continuous improvement initiatives.• Work effectively within Agile delivery teams and participate in sprint planning, estimation, and backlog refinement.• Mentor team membersRequired Technical Skills• 8+ years of experience in Data Engineering with demonstrated technical leadership on enterprise data projects.• Strong hands-on experience with Google Cloud Platform (GCP).• Expert-level proficiency in:o Dataproco BigQueryo SQLo dbt (Data Build Tool)• Strong understanding of modern ETL/ELT architecture and large-scale data processing.• Strong knowledge of data modeling techniques, including dimensional modeling, normalized data models, and analytical data warehouse design.• Experience building scalable and maintainable cloud-native data pipelines.• Experience with Git, CI/CD pipelines, and engineering best practices.• Strong analytical, troubleshooting, and problem-solving skills.• Excellent verbal and written communication skills with the ability to collaborate effectively across cross-functional teams.Preferred Technical Skills• Experience with Apache Airflow for workflow orchestration.• Experience integrating enterprise data platforms with Apache Kafka or other streaming technologies.• Working knowledge of PySpark for distributed data processing.• Proficiency in Python for data engineering, automation, and utility development.• Familiarity with data quality, metadata management, and data governance best practices.Domain Experience (Highly Desirable)Candidates with experience in one or more of the following areas will be strongly preferred:• Retail industry (Apparel)• Supply Chain data platforms• Transportation and Logistics• Warehouse Management Systems (WMS)• Distribution Center operationsDesired Attributes• Self-driven and able to work independently in a fast-paced environment.• Strong ownership mindset with a focus on delivering high-quality solutions.• Ability to balance technical excellence with business priorities.• Effective collaborator who can work seamlessly with business partners, architects, product managers, and engineering teams.• Passion for building scalable, reliable, and reusable data solutions that enable analytics and AI capabilities across the Supply Chain organization.Drishticon is an Equal Opportunity Employer committed to fostering an inclusive and diverse workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, age, or any other legally protected characteristic under applicable federal, state, or local laws.