JOBSEARCHER

Data Engineer with strong Data Analyst skills

Data Engineer with strong Data Analyst skillsKey QualificationsMUST HAVE:• Hands-on experience with writing Complex queries using – Joins, Self Joins, Views, Materialized Views, Cursor also Recursive, use of GROUP BY, PARTITION BY functions / SQL Performance tuning• Hands-on experience with ETL and Dimensional Data Modelling – Slowly Changing Dimensions (SCD – Type 1, 2, 3)o Good understanding of concepts like schema types, table types - fact-dimension etc. like how to design a dimension vs fact, design considerations factored etc.• Proficiency in Python scripting/programming – using Pandas, PyParsing, Airflow.o Pandas, Tableau server modules, Numpy, Datetime, Apache Airflow related modules, APIso Setting up Python scripts on DataLab, scheduling processes, connecting with DataLake (S3 etc )o Data Pipeline automationo Strong Python programming skillso Apache Kafka and Python (using client libraries like Confluent's librdkafka or kafka-python; to send (produce) and receive (consume) messages from Kafka topics.o Experience building streaming applications, data pipelines, and microservices etc.)• Good understanding on Snowflake Architecture - experience with designing and building solutions.o Architecture, design aspects, performance tuning, time travel, warehouse concepts - scaling, clustering, micro-partitioningo Experience with SnowSQL, Snowpipe• Good to Have - Experience with Snowflake performance optimization techniques• Experience with Vertica, Singlestore• Lead Experience - Experience interacting with business and independently develop and lead data projects. Collaborating with Offshore and owning overall project delivery.• Actively participating in discussions with business to understand requirements, perform thorough impact analysis and provide suitable solutions.