JOBSEARCHER

Data engineer requirement

SkillsetData Engineer -5-8 years exp.Responsibilities:Analyze and understand existing Tidal job dependencies, schedules, and scripts.Develop shell scripts and Python-based workflows to replicate and enhance current Tidal processes in Airflow.Write and optimize SQL queries for Snowflake-based data transformations and validations.Collaborate with cross-functional teams to ensure data pipelines are robust, scalable, and well-documented.Work with AWS S3 for data ingestion and storage processes.Ensure high reliability and performance of data pipelines post-migration.Provide support during testing and post-migration validation. Required Skills: Shell scripting - strong experience requiredPython - strong experience requiredSQL - strong experience required, preferably with SnowflakeAWS S3 - hands-on experienceSolid Data Warehouse background and understanding of ETL/ELT best practices Preferred Skills (Nice to Have): Experience with Apache AirflowPrior experience with scheduling tool migrations, especially TidalFamiliarity with CI/CD practices and DevOps for data pipelines