Data Engineer with python and date
Data Engineer (Python | Snowflake / Databricks)Role SummaryWe are looking for a skilled Data Engineer with strong expertise in Python, data processing, and modern cloud data platforms like Snowflake or Databricks. The role involves building scalable data pipelines, enabling analytics, and supporting data-driven decision-making across the organization.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines (ETL/ELT)Develop data workflows using PythonWork with large datasets in structured and unstructured formatsImplement data solutions using Snowflake or DatabricksOptimize data pipelines for performance, reliability, and costBuild and manage data models, data marts, and data lakesIntegrate data from multiple sources (APIs, databases, streaming)Ensure data quality, governance, and securityCollaborate with data analysts, scientists, and business teamsAutomate workflows using orchestration tools (Airflow, etc.)Required Skills & ExperienceProgramming & DataStrong proficiency in PythonExperience with:Pandas, NumPy, PySparkSolid understanding of:Data structures & algorithmsData processing techniquesData EngineeringHands-on with:ETL/ELT pipeline developmentData warehousing conceptsBatch & streaming data processingPlatformsExperience with at least one:SnowflakeDatabricksKnowledge of:Delta Lake (for Databricks)Snowflake features (streams, tasks, warehouses)DatabasesStrong SQL skillsExperience with:Relational DBs (PostgreSQL, MySQL)NoSQL (MongoDB – optional)Cloud (Preferred)Experience in:AWS (S3, Glue, Redshift)Azure (ADF, ADLS)Google Cloud Platform (BigQuery)ToolsApache Airflow / PrefectGit, CI/CD pipelinesDocker (good to have)Experience3–8+ years in Data Engineering or similar roleCertifications (Optional But Valuable)Snowflake SnowPro CertificationDatabricks Certified Data EngineerAWS / Azure Data certificationsNice To HaveExperience with real-time streaming (Kafka, Spark Streaming)Knowledge of data governance & catalog toolsExposure to Machine Learning pipelinesUnderstanding of data security & complianceSoft SkillsStrong analytical and problem-solving mindsetAbility to work with cross-functional teamsClear communication and documentation skillsTypical Use Cases In This RoleBuilding data pipelines for analytics dashboardsSupporting ML models with clean, structured dataMigrating legacy data warehouses to cloud platformsCreating scalable data lake architectures