Data Engineer

RequirementsRequirements:4+ years of experience as Data developerStrong knowledge on Python , SQL , PySparkExperience working using AWS and its servicesExperience developing business applications using NoSQL/SQL databases.Experience working with Object stores(S3) and Avro/Parquet/JSONServerless application development using AWS Glue , Lambda and Step functionsResponsibilities:Designing, building and maintaining efficient, reusable, and reliable architecture and code.Ensure the best possible performance and quality of high scale web applications and services.Participate in the architecture and system design discussionsIndependently perform hands on development and unit testing of the applications;Collaborate with the development team and build individual components into complex enterprise web systems;Work in a team environment with product, frontend design, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle;Responsible to identify and resolve any performance issuesKeep up to date with new technology development and implementationParticipate in code review to make sure standards and best practices are metPlusSnowflake experienceAware of microservice architectureBasics of Machine learning algorithms (supervised/unsupervised)What You’ll Be Working OnPrudential’s Global Technology team is the spark that ignites the power of Prudential for our customers and employees worldwide. Our organization plays a critical and highly visible role in delivering customer-driven solutions across every area of the company. The Global Technology team is made up of diverse, agile-thinking, and highly-skilled professionals; we use our combined capabilities to enable the organization with innovation, speed, agility, scalability and efficiency.The Global Technology team takes great pride in our culture where digital transformation is built into our DNA. When you join the Global Technology organization at Prudential, you’ll unlock a challenging and impactful career – all while growing your skills and advancing your profession at one of the world’s leading financial services institutions.Data Tech team at Prudential Financials is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners.As a part of our CDO organization, you will work with our ML Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and scalable manner.Qualifications4+ years of experience as Data developerStrong knowledge on Python , SQL , PySparkBachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experienceExperience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprisesAWS Solutions Architect or AWS Big Data Certification preferredProgramming experience with Python and shell scriptingSolid experience of AWS services such as CloudFormation, S3, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.Solid experience implementing solutions on AWS based data lakes.Experience in AWS data lake/data warehouse/business analyticsExperience in system analysis, design, development, and implementation of data ingestion pipeline in AWSKnowledge of ETL/ELTWorking experience with Hadoop, HDFS, SQOOP, Hive, Python, and SparkExperience working on Agile projectsBase in the $120-$130k range. Up to 20% yearly bonus