Staff Data Engineer-GCP/Data Solutions (San Antonio, Austin or Dallas)
Staff Data Engineer Responsibilities As a Staff Data Engineer, you'll use an advanced analytical, data-driven approach to drive a deep understanding of our fast-changing business and answer real world questions. You'll work with stakeholders to develop a clear understanding of data and data infrastructure needs, resolve complex data-related technical issues, and ensure optimal data design and efficiency. Once you're eligible, you'll become an Owner in the company, so we're looking for commitment, hard work, and focus on quality and Customer service. 'Partner-owned' means our most important resources--People--drive the innovation, growth, and success that make H-E-B The Greatest Omnichannel Retailing Company. Do you have a: HEART FOR PEOPLE... you're willing to facilitate solutions with multiple engineers, provide upward communication, and mentor others? HEAD FOR BUSINESS... you consistently demonstrate and uphold the standards of coding, infrastructure, and process? PASSION FOR RESULTS... you're capable of high-velocity contributions in multiple technical domains?We are looking for:8+ years of experience related to data engineeringWhat is the work?Designs data patterns that support creation of datasets for analytics; implements calculations, cleanses data, ensures standardization of data, maps / links data from more than one sourcePerforms data validation and quality assurance on work of senior peers and write automated testsMaintains / streamlines / orchestrates existing data pipelines end to endBuilds / supports complex data warehousing pipelines into cloud platforms GCP/AWS, data integrations, data streaming solutions, predictive model implementations with prompt engineering for AI Models, building out data quality checks into data pipelines that are on BigQuery or DatabricksWorks with peer staff engineers to perform design reviews and swiftly change patterns according to latest tools and technologiesDesigns and develops real-time streaming requirements by using structured streaming from either pub-sub or another streaming table on datalakeBuilds / supports more complex data pipelines including application programming interfaces (APIs)Identifies complex data from upstream sources to enable new capabilities.Engages in testing of the technical solutions to ensure data integrity and system functionality of own work and broader system, E2EBuilds large-scale batch and real-time data pipelines with big data CDC processing frameworksDesigns / develops data integrations to support application engineering and system integrationDesigns / develops / maintains large data pipelines; diagnoses / solves production support issuesCreates documentation and training related to technology stacks and standards within assigned teamDesigns / implements monitoring capabilities based on business SLA and data qualityUses / contributes to refinement of Digital Engineering-related tools, standards, and trainingEngages / collaborates with external technical teams to ensure timely, high-quality solutionsEngages with shared services teams and vendors when necessaryWorks closely with Product, Data Science, Application, and Analytics teams to develop a clear understanding of data and data infrastructure needs; assists with data-related technical issues; ensures optimal data design and efficiencyPerforms full SDLC process, including planning, design, development, certification, implementation, and supportInteracts with Product, Business, Analyst stakeholders to confirm data quality, discuss requirements, and support data testingPeer reviews with team members; learns / adapts from peer review of own codeContributes to overall design, architecture, security, scalability, reliability, and performanceMentors / provides support to Senior Data EngineersBuilds more complex data models to deliver insightful analytics; ensures highest standard in data integrityHas knowledge in machine learning conceptsWhat is your background?A related degree or work experience, preferably a Bachelors degree in related work stream8+ years of experience related to data engineeringExperience in Lean Startup or Agile development methodologiesExperience working in large scale cloud infrastructure, large data sets, and mission critical SLAsExperience in Advanced SQL / Python.Have a data engineering certification from any of the cloud technologiesDo you have what it takes to be an H-E-B Staff Data Engineer?Advanced knowledge of Lean Startup / Agile methodsStrong understanding business intelligence, analytics and reporting, and application integrationKnowledge of data architectures such as data warehouse, data lake, and data mesh and when to applyStrong working understanding of data architecture and data modeling best practices and guidelines for various data and analytic platformsStrong working understanding of coding standards and design principles / patternsStrong prioritization skillsStrong verbal / written communication and data presentation skillsAbility to deliver on ambiguous projects with incomplete informationAbility / willingness to learn new technologies as they emergeAbility to calmly work under pressureAbility to work a flexible schedule as neededAbility to collaborate across multiple teams at multiple work locationsAbility to work within a team, and willingness to take feedback from peers and mentorsAbility to function in a fast-paced environment with the ability to work from home and / or officeWork extended hours; sit for extended periods