Data Engineer
Job Title: Data EngineerJob SummaryWe are seeking a highly skilled Data Engineer with strong hands-on experience in Python and SQL to design, develop, and maintain scalable data solutions. The ideal candidate will have a strong understanding of data engineering principles, database technologies, data processing, ETL/ELT pipelines, and data quality.The candidate should be equally comfortable working with Python for data processing and automation and SQL for complex querying, data transformation, and analysis. This role requires strong problem-solving skills and the ability to work closely with application, analytics, and business teams.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL/ELT processes.Develop high-quality, reusable Python scripts and applications for data processing, automation, and integration.Write complex and optimized SQL queries, stored procedures, and data transformation logic.Perform data extraction, transformation, cleansing, validation, and loading across multiple data sources.Design and optimize relational databases, tables, views, and data models.Troubleshoot data pipeline failures, performance issues, and data quality problems.Implement data validation and quality checks to ensure accuracy, completeness, and consistency.Automate repetitive data engineering and operational processes using Python.Optimize SQL queries and data processing jobs for performance and scalability.Collaborate with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand data requirements.Develop and maintain technical documentation for data pipelines, processes, and data models.Monitor data pipelines and proactively identify and resolve production issues.Participate in code reviews, testing, deployment, and continuous improvement of data solutions.Required QualificationsStrong hands-on experience with Python and SQL.Strong understanding of data engineering concepts and ETL/ELT processes.Excellent SQL skills, including complex joins, subqueries, CTEs, window functions, aggregations, and query optimization.Strong Python programming skills with experience in data processing, automation, and scripting.Experience working with relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.Experience developing and supporting data pipelines.Strong understanding of data structures, data modeling, and database design.Experience with data cleansing, transformation, validation, and quality processes.Strong debugging, troubleshooting, and analytical skills.Experience working in an Agile/Scrum development environment.Strong communication and collaboration skills.Preferred QualificationsExperience with cloud data platforms such as AWS, Azure, or GCP.Experience with Spark/PySpark, Databricks, or similar distributed data-processing technologies.Experience with data orchestration tools such as Airflow.Experience with cloud databases/data warehouses such as Snowflake, Redshift, BigQuery, or Azure Synapse.Familiarity with Git, CI/CD, Docker, and Kubernetes.Experience working with APIs, JSON, REST services, and data integration.Experience with Kafka or other streaming technologies is a plus.Core SkillsMust Have:Python | SQL | Data Engineering | ETL/ELT | Data Pipelines | Database | Data Transformation | Data Quality | TroubleshootingGood to Have:AWS/Azure/GCP | PySpark | Databricks | Airflow | Snowflake | Kafka | Docker | Git | CI/CDIdeal CandidateThe ideal candidate is a hands-on Data Engineer who is exceptionally strong in both Python and SQL, understands how data moves through enterprise systems, and can independently develop, optimize, troubleshoot, and support production-grade data pipelines.