Walmart

We use cutting edge machine learning, data mining and optimization algorithms on this data.. Big Data Technologies: Expertise in big data technologies like Hadoop, Apache Spark, Apache Hive, or similar frameworks is crucial for efficiently processing and analyzing massive volumes of data.. Technologies: HDFS, Spark/Hive, Kafka, Apache Parquet, Avro, GCS, GCP, BigQuery, Python.. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting.. Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.

senior data engineer

Position Summary... What you'll do... About The Team Walmart's Advertising Technology group enables the connection between supplier brands and retail shoppers at unprecedented scale. We are a highly motivated group of engineers and data scientists, working in an agile group to solve sophisticated and high impact problems. We serve billions of ad requests every month with our high-performance ad servers. We build smart data systems that ingest, model, analyze and optimize the massive flow of data from online and store user activity and transactions. We use cutting edge machine learning, data mining and optimization algorithms on this data. Above all, we are laser focused on delivering experiences that our customers and advertisers love. This role is part of our Display Ads Server engineering team for Backend Services and will build the next generation omni-advertising platforms to deliver performance and value at scale. A successful person in this role will own major components of the display advertising solution, drive alignment with other teams, guide architecture and technology choices within the team and across WMC. This is a hands-on role and so we are looking with an exceptional and experienced coder first. What You'll Do Develop data pipelines to consolidate log data emitted by our various backend microservices.
Expand existing data pipelines and integrate new data sources to drive new insights.
Develop data quality checks to identify data gaps and notify upstream teams.
Build data quality dashboards to monitor data quality.
Driving projects of high visibility across the organization.
Mentoring and guiding mid-to-junior engineers.
Showing your chops as an exceptional and experienced coder. What You'll Bring Bachelor's/master's degree in computer science or a related field.
With 5+ years' experience in development of big data technologies/data pipelines
Expertise in one or more programming languages (Python, Java etc.)
Advanced Data Management: Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential. This includes knowledge of distributed file systems, data partitioning, and optimization techniques for handling large-scale data.
Big Data Technologies: Expertise in big data technologies like Hadoop, Apache Spark, Apache Hive, or similar frameworks is crucial for efficiently processing and analyzing massive volumes of data.
Data Integration: Skill in integrating data from multiple data sources is vital. This involves understanding various data formats, APIs, and protocols to effectively bring data together from diverse sources.
Data Modeling: Strong data modeling skills are necessary for designing a schema that can accommodate the evolution of data sources and facilitate seamless data joins across various datasets.
Database Management: Experience in working with large-scale databases is essential to handle the storage and retrieval of vast amounts of data efficiently.
Data Cleansing and Transformation: The ability to clean and transform data from different sources into a standardized format is crucial for accurate data analysis and effective data joins.
Query Optimization: Proficiency in optimizing queries to achieve better performance and reduce processing times is important when dealing with massive datasets.
Distributed Computing: Understanding the principles of distributed computing is vital for effectively utilizing resources across a cluster of machines to process and analyze large volumes of data.
Data Security and Privacy: Knowledge of data security and privacy best practices is essential to protect sensitive information when dealing with massive datasets from multiple sources.
Problem-Solving and Troubleshooting: Strong analytical and problem-solving skills are crucial for identifying and resolving issues that may arise during the data integration and schema evolution process.
Communication and Collaboration: Effective communication and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project.
Continuous Learning: The field of big data is ever evolving, so a willingness to learn and adapt to new technologies and techniques is essential for staying up to date with the latest advancements in data management and analysis.
Technologies: HDFS, Spark/Hive, Kafka, Apache Parquet, Avro, GCS, GCP, BigQuery, Python. Nice To Have Previous experience in the advertising domain About Walmart Global Tech Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That's what we do at Walmart Global Tech. We're a team of software engineers, data scientists, cybersecurity expert's and service professionals within the world's leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail. Flexible, Hybrid Work We use a hybrid way of working that is primarily in office coupled with virtual when not onsite. Our campuses serve as a hub to enhance collaboration, bring us together for purpose and deliver on business needs. This approach helps us make quicker decisions, remove location barriers across our global team and be more flexible in our personal lives. Benefits Benefits: Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more. Equal Opportunity Employer Walmart, Inc. is an Equal Opportunity Employer - By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing diversity- unique styles, experiences, identities, ideas, and opinions - while being inclusive of all people. The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process. At Walmart, we offer competitive pay as well as performance-based incentive awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more. You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable. For information about PTO, see https://one.walmart.com/notices . Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms. For information about benefits and eligibility, see One.Walmart at https://bit.ly/3iOOb1J . The annual salary range for this position is $117,000.00-$234,000.00 Additional Compensation Includes Annual Or Quarterly Performance Incentives. Additional compensation for certain positions may also include: Regional Pay Zone (RPZ) (based on location)
Stock equity incentives Minimum Qualifications... Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications. Option 1: Bachelor's degree in Computer Science and 3 years' experience in software engineering or related field. Option 2: 5 years' experience in software engineering or related field. Option 3: Master's degree in Computer Science and 1 year's experience in software engineering or related field. 2 years' experience in data engineering, database engineering, business intelligence, or business analytics. Preferred Qualifications... Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications. Master's degree in Computer Science or related field and 2 years' experience in software engineering or related field Primary Location... 840 W CALIFORNIA AVE, SUNNYVALE, CA 94086-4828, United States of America
#J-18808-Ljbffr

START NEW SEARCH