Data Engineer

Description:As a DataEngineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine learning and artificial intelligence, and intuitive workflows that allow our users to derive insights from big data that in turn drive their businesses. You will have the opportunity to create high-performance analytic solutions based on data sets measured in the billions of transactions and front-end visualizations to unleash the value of big data. You will have the opportunity to develop data-driven innovative analytical solutions and identify opportunities to support business and client needs in a quantitative manner and facilitate informed recommendations/decisions through activities like building ML models, automated data pipelines, designing data architecture/schema, performing jobs in big data cluster by using different execution engines and program languages such as Hive/Impala, Python, Java, Kafka, Spark, R, etc.Responsibilities:Collaborate with cross-functional teams to understand business requirements and translate them into machine learning solutionsDesign and develop robust machine learning models and algorithms that solve complex business problemsDesign and develop data and analytics solutions that sit atop vast datasetsClean, preprocess, and analyze data to ensure its suitability for machine learning applicationsImplement end-to-end machine learning pipelines, from data collection and feature engineering to model training and deploymentSelect appropriate machine learning techniques and algorithms based on the problem's requirements and constraintsPerform exploratory data analysis and generate insights to guide model developmentEvaluate and fine-tune machine learning models for performance, accuracy, and reliabilityDeploy machine learning models into production environments, ensuring scalability and maintainabilityCollaborate with technical team to integrate machine learning solutions into applicationsStay up-to-date with the latest advancements in machine learning and recommend innovative approaches to enhance our capabilitiesDocument and communicate machine learning solutions, findings, and insights to technical and non-technical stakeholdersAdditional tasks as requiredMandatory Skills Description:Proven experience as a machine learning engineer, working on complex machine learning projectsSolid understanding of machine learning algorithms, deep learning frameworks, and statistical modeling techniquesHands-on experience with machine learning libraries such as TensorFlow, PyTorch, or scikit-learnProficiency in data preprocessing, feature engineering, and data visualizationExperience with cloud platforms such as AWS, Azure, or GCP for deploying machine learning modelsWorking proficiency in using Python/Scala, Spark (tuning jobs), SQL, Hadoop platforms to build Big Data products & platforms.Good programming skills in Java and spring boot and Junit.Familiarity with RESTful APIs and micro-services architecturesExperience in working with CI/CDExperience in working with SQL database like Postgres, OracleExperience with data pipeline and workflow management tools: NIFI, Airflow.Comfortable in developing shell scripts for automation.