Data Engineer
Job Title: Data EngineerLocation: NJ, USACompany Overview:Invictus Data is a leading provider of business solutions, specializing in Ecommerce, Marketing, Banking and Finance, Insurance, Transport, and more. In an era propelled by data, insights, and strategic decision-making, we empower businesses to leverage data effectively, enabling them to thrive in competitive markets. Our expertise spans across Data, Analytics, and Engineering, contributing to our commitment to excellence.Learn more about us: Invictus DataJob Description:Invictus Data is seeking a skilled web application developer to design, develop, test, document, and maintain robust, client applications using HTML5, CSS3 and JavaScript frameworks targeting hybrid mobile-apps, & dynamic web-apps.Key Responsibilities:Design complex and high-performance Data architecture.Develop and maintain strong relations with senior executives, providing insights into the client’s business model and pain points, and delivering actionable, high-impact results.Lead key engagements, developing plans and strategies for data management processes and IT programs for the business, providing hands-on assistance in data modeling, and technical implementation of big data solutions.Facilitate, guide, and influence clients and teams towards the right information technology architecture, becoming an interface between Business leadership, Tech leadership, and delivery teams.Lead and mentor other developers within the team.Identify performance bottlenecks and resolve them.Work effectively in a team, coordinating with developers, architects, stakeholders, and cross-functional teams within the organization.Skills and Qualifications:5+ years of experience in designing and implementing large-scale data processing systems.Proficient with Spark framework, GCP Big data services, and industry-standard frameworks.Ability to lead cross-functional teams and manage full life-cycle solutions.Strong command of Relational and MPP database platforms like GCP Bigquery/Hive/Cloud SQL.Deep understanding of Big Data Analytics platforms and ETL processes.Exceptional problem-solving, hands-on engineering skills, and effective communication.Familiarity with real-time analytics and active participation in the Software Development Life Cycle (SDLC).Technical Skills:Proficiency in a mix of the following technical skills::Hadoop: HDFS, MapReduce, Hive, Airflow.DW: Bigquery, Hive.Languages: Python, PySpark, Shell Scripting, SQL Scripting.Cloud: GCP Big data native services.Any RDBMS/DWBI technologies.Spark (Mandatory): Spark on GCP Dataproc.