Senior Data Engineer

Senior Data Engineer – 8+ Years ExperienceJob Type: Full-TimeWork Model: HybridExperience: 8+ YearsEmployment: Full-TimeJob SummaryWe are looking for an experienced Senior Data Engineer with 8+ years of hands-on experience designing, developing, and maintaining scalable data platforms and data pipelines. The ideal candidate will have strong expertise in Python, SQL, ETL/ELT, cloud platforms, data warehousing, and distributed data processing.The candidate will work closely with Data Scientists, Software Engineers, Business Analysts, and other stakeholders to build reliable, high-performance data solutions and enable data-driven decision-making.Key ResponsibilitiesDesign, develop, and maintain scalable ETL/ELT data pipelines. Build and optimize data processing workflows using Python and SQL. Develop data ingestion solutions from databases, APIs, files, and other sources. Design and maintain enterprise data warehouses, data lakes, and lakehouse architectures. Work with large datasets using distributed processing technologies such as Apache Spark/PySpark. Develop data models and optimize complex SQL queries for performance. Implement data quality, validation, monitoring, and error-handling frameworks. Integrate data from structured and unstructured sources. Build and maintain batch and real-time/streaming data pipelines. Work with cloud data platforms such as AWS, Azure, or GCP. Implement CI/CD and DevOps practices for data engineering workflows. Collaborate with cross-functional teams to understand business and technical requirements. Troubleshoot pipeline failures, performance issues, and data quality problems. Ensure data security, governance, scalability, and compliance. Mentor junior and mid-level data engineers and contribute to technical architecture decisions. Document data pipelines, architectures, processes, and technical solutions. Required Skills 8+ years of professional experience in Data Engineering or related roles. Strong programming experience with Python. Advanced SQL skills with experience in query optimization. Strong experience with ETL/ELT development and data pipeline architecture. Hands-on experience with Apache Spark / PySpark. Experience with cloud platforms such as:AWS – S3, Glue, Redshift, EMR, Lambda Azure – Data Factory, Databricks, Synapse, ADLS GCP – BigQuery, Dataflow, Cloud Storage Strong understanding of data warehousing and dimensional data modeling. Experience with relational databases such as SQL Server, PostgreSQL, Oracle, or MySQL. Experience with Databricks and/or Snowflake is highly desirable. Knowledge of Apache Kafka or other streaming technologies. Experience with workflow orchestration tools such as Airflow, Azure Data Factory, or AWS Glue. Familiarity with Git, CI/CD, Docker, and DevOps practices. Strong understanding of data quality, governance, security, and metadata management. Preferred QualificationsBachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field. Experience designing enterprise-scale data architectures. Experience with real-time data processing and streaming. Experience with Terraform or Infrastructure as Code. Familiarity with Kubernetes and containerized workloads. Experience working in Agile/Scrum environments. Strong communication, analytical, and problem-solving skills. Technical EnvironmentLanguages: Python, SQL, Scala/JavaBig Data: Apache Spark, PySpark, HadoopCloud: AWS / Azure / GCPData Warehousing: Snowflake, Redshift, Synapse, BigQueryDatabases: SQL Server, PostgreSQL, Oracle, MySQLETL/ELT: Databricks, AWS Glue, Azure Data FactoryStreaming: Kafka, Spark StreamingOrchestration: Apache AirflowDevOps: Git, Jenkins/GitHub Actions, Docker, CI/CDMethodology: Agile/ScrumWork ArrangementThis is a Full-Time Hybrid position. The selected candidate will be expected to work both remotely and from the designated office location based on business requirements.What We’re Looking ForWe are seeking a senior-level engineer who can independently own data engineering projects, contribute to architecture and design decisions, build production-grade pipelines, and collaborate effectively with technical and business teams.Skills: data,pipelines,sql,platforms,aws,processing,cloud,etl,azure,apache