Western Digital

Develop, test, and deploy data integration pipeline jobs using chosen cloud based native tool according to Western Digital design principles.. Develop new pipelines using Java/Spark/Scala on AWS EMR platform and schedule using AirFlow. AWS developer certification will be preferred.. Passionate about working with BASH, Python and Java. Experience in running Spark/Scala programs, Java UDFs in AWS EMR platform is preferred.. Understanding of Semiconductor manufacturing related datasets and concepts preferred

data integration engineer

Job Description ESSENTIAL DUTIES AND RESPONSIBILITIES: Develop, test, and deploy data integration pipeline jobs using chosen cloud based native tool according to Western Digital design principles. Troubleshoot existing pipeline jobs based on BASH, Python, Java and modify jobs for performance improvements. Develop new pipelines using Java/Spark/Scala on AWS EMR platform and schedule using AirFlow Design data tables for faster load and optimal query performance Debug SQL statements and stored procedures in Postgres and Redshift databases. Use git-based source control system bit bucket and continuous integration tools like Jenkins and deployment using Ansible. Qualifications:
Qualifications REQUIRED EDUCATIONAL BACKGROUND Minimum of a bachelor’s degree in computer science or engineering. Master’s degree preferred. AWS developer certification will be preferred. Any certification on SDLC (Software Development Life Cycle) methodology, integrated source control system, continuous development and continuous integration will be preferred REQUIRED PROFESSIONAL BACKGROUND Minimum of 8+ years of working in Data Integration/Engineering using any cloud/on-premises ETL tools Passionate about working with BASH, Python and Java. Experience in running Spark/Scala programs, Java UDFs in AWS EMR platform is preferred. Understanding on Unix/Linux operating system like awk, ssh, crontab, etc., Ability to write transact SQL, develop and debug stored procedures and user defined functions in python. Working experience on Postgres and/or Redshift database is preferred. Concepts of MPP, Massively Parallel Processing well understood and practiced in solving business problems. Exposure to CI/CD tools like bit bucket, Jenkins, ansible, docker, etc. is preferred. Ability to understand relational database systems and its concepts. Understanding of Semiconductor manufacturing related datasets and concepts preferred REQUIRED PERSONAL BACKGROUND Passionate about working with large datasets Ability to read, write and speak in English clearly Ability to work as a team Ability to work in multiple projects and cope up with tight deadline and time constraints Ability to freely express his own view and accept well known methodologies. Additional Information Western Digital is committed to providing equal opportunities to all applicants and employees and will not discriminate based on their race, color, ancestry, religion (including religious dress and grooming standards), sex (including pregnancy, childbirth or related medical conditions, breastfeeding or related medical conditions), gender (including a person’s gender identity, gender expression, and gender-related appearance and behavior, whether or not stereotypically associated with the person’s assigned sex at birth), age, national origin, sexual orientation, medical condition, marital status (including domestic partnership status), physical disability, mental disability, medical condition, genetic information, protected medical and family care leave, Civil Air Patrol status, military and veteran status, or other legally protected characteristics. We also prohibit harassment of any individual on any of the characteristics listed above. Our non-discrimination policy applies to all aspects of employment. We comply with the laws and regulations set forth in the Equal Employment Opportunity is the Law poster. Western Digital thrives on the power and potential of diversity. As a global company, we believe the most effective way to embrace the diversity of our customers and communities is to mirror it from within. We believe the fusion of various perspectives results in the best outcomes for our employees, our company, our customers, and the world around us. We are committed to an inclusive environment where every individual can thrive through a sense of belonging, respect and contribution. Western Digital is committed to offering opportunities to applicants with disabilities and ensuring all candidates can successfully navigate our careers website and our hiring process. Please contact us at jobs.accommodations@wdc.com to advise us of your accommodation request. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying. #LI-AS1 Compensation & Benefits Details An employee’s pay position within the salary range may be based on several factors including but not limited to (1) relevant education; qualifications; certifications; and experience; (2) skills, ability, knowledge of the job; (3) performance, contribution and results; (4) geographic location; (5) shift; (6) internal and external equity; and (7) business and organizational needs. The salary range is what we believe to be the range of possible compensation for this role at the time of this posting. We may ultimately pay more or less than the posted range and this range is only applicable for jobs to be performed in California, Colorado, New York or remote jobs that can be performed in California, Colorado and New York. This range may be modified in the future. You will be eligible to participate in Western Digital’s Short-Term Incentive (STI) Plan, which provides incentive awards based on Company and individual performance. Depending on your role and your performance, you may be eligible to participate in our annual Long-Term Incentive (LTI) program, which consists of restricted stock units (RSUs) or cash equivalents, pursuant to the terms of the LTI plan. Please note that not all roles are eligible to participate in the LTI program, and not all roles are eligible for equity under the LTI plan. RSU awards are also available to eligible new hires, subject to Western Digital’s Standard Terms and Conditions for Restricted Stock Unit Awards. We offer a comprehensive package of benefits including paid vacation time; paid sick leave; medical/dental/vision insurance; life, accident and disability insurance; tax-advantaged flexible spending and health savings accounts; employee assistance program; other voluntary benefit programs such as supplemental life and AD&D, legal plan, pet insurance, critical illness, accident and hospital indemnity; tuition reimbursement; transit; the Applause Program, employee stock purchase plan, and the Western Digital Savings 401(k) Plan. Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, benefits, or any other form of compensation and benefits that are allocable to a particular employee remains in the Company's sole discretion unless and until paid and may be modified at the Company’s sole discretion, consistent with the law. Qualifications **REQUIRED EDUCATIONAL BACKGROUND** * Minimum of a bachelor’s degree in computer science or engineering. Master’s degree preferred.
* AWS developer certification will be preferred.
* Any certification on SDLC (Software Development Life Cycle) methodology, integrated source control system, continuous development and continuous integration will be preferred **REQUIRED PROFESSIONAL BACKGROUND** * Minimum of 8+ years of working in Data Integration/Engineering using any cloud/on-premises ETL tools
* Passionate about working with BASH, Python and Java. Experience in running Spark/Scala programs, Java UDFs in AWS EMR platform is preferred.
* Understanding on Unix/Linux operating system like awk, ssh, crontab, etc.,
* Ability to write transact SQL, develop and debug stored procedures and user defined functions in python.
* Working experience on Postgres and/or Redshift database is preferred. Concepts of MPP, Massively Parallel Processing well understood and practiced in solving business problems.
* Exposure to CI/CD tools like bit bucket, Jenkins, ansible, docker, etc. is preferred.
* Ability to understand relational database systems and its concepts.
* Understanding of Semiconductor manufacturing related datasets and concepts preferred **REQUIRED PERSONAL BACKGROUND** * Passionate about working with large datasets
* Ability to read, write and speak in English clearly
* Ability to work as a team
* Ability to work in multiple projects and cope up with tight deadline and time constraints
* Ability to freely express his own view and accept well known methodologies. Additional Information Western Digital is committed to providing equal opportunities to all applicants and employees and will not discriminate based on their race, color, ancestry, religion (including religious dress and grooming standards), sex (including pregnancy, childbirth or related medical conditions, breastfeeding or related medical conditions), gender (including a person’s gender identity, gender expression, and gender-related appearance and behavior, whether or not stereotypically associated with the person’s assigned sex at birth), age, national origin, sexual orientation, medical condition, marital status (including domestic partnership status), physical disability, mental disability, medical condition, genetic information, protected medical and family care leave, Civil Air Patrol status, military and veteran status, or other legally protected characteristics. We also prohibit harassment of any individual on any of the characteristics listed above. Our non-discrimination policy applies to all aspects of employment. We comply with the laws and regulations set forth in the [Equal Employment Opportunity is the Law](https://www.dol.gov/sites/dolgov/files/ofccp/regs/compliance/posters/pdf/eeopost.pdf) poster. Western Digital thrives on the power and potential of diversity. As a global company, we believe the most effective way to embrace the diversity of our customers and communities is to mirror it from within. We believe the fusion of various perspectives results in the best outcomes for our employees, our company, our customers, and the world around us. We are committed to an inclusive environment where every individual can thrive through a sense of belonging, respect and contribution. Western Digital is committed to offering opportunities to applicants with disabilities and ensuring all candidates can successfully navigate our careers website and our hiring process. Please contact us at [jobs.accommodations@wdc.com](mailto:jobs.accommodations@wdc.com) to advise us of your accommodation request. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying. \#LI-AS1 **Compensation & Benefits Details** * An employee’s pay position within the salary range may be based on several factors including but not limited to (1) relevant education; qualifications; certifications; and experience; (2) skills, ability, knowledge of the job; (3) performance, contribution and results; (4) geographic location; (5) shift; (6) internal and external equity; and (7) business and organizational needs.
* The salary range is what we believe to be the range of possible compensation for this role at the time of this posting. We may ultimately pay more or less than the posted range and this range is only applicable for jobs to be performed in California, Colorado, New York or remote jobs that can be performed in California, Colorado and New York. This range may be modified in the future.
* You will be eligible to participate in Western Digital’s Short-Term Incentive (STI) Plan, which provides incentive awards based on Company and individual performance. Depending on your role and your performance, you may be eligible to participate in our annual Long-Term Incentive (LTI) program, which consists of restricted stock units (RSUs) or cash equivalents, pursuant to the terms of the LTI plan. Please note that not all roles are eligible to participate in the LTI program, and not all roles are eligible for equity under the LTI plan. RSU awards are also available to eligible new hires, subject to Western Digital’s Standard Terms and Conditions for Restricted Stock Unit Awards.
* We offer a comprehensive package of benefits including paid vacation time; paid sick leave; medical/dental/vision insurance; life, accident and disability insurance; tax-advantaged flexible spending and health savings accounts; employee assistance program; other voluntary benefit programs such as supplemental life and AD&D, legal plan, pet insurance, critical illness, accident and hospital indemnity; tuition reimbursement; transit; the Applause Program, employee stock purchase plan, and the Western Digital Savings 401(k) Plan.
* Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, benefits, or any other form of compensation and benefits that are allocable to a particular employee remains in the Company's sole discretion unless and until paid and may be modified at the Company’s sole discretion, consistent with the law. #J-18808-Ljbffr

START NEW SEARCH