ETL DATA Engineer (Python & API Development) NEW
Design, develop, maintain, and support Python-based ETL pipelines and data integration solutions .Develop and maintainREST APIsfor data ingestion and system integration. Extract data from databases, APIs, flat files, cloud platforms, and other sources. Transform, cleanse, validate, and prepare data based on business requirements. Load data into data warehouses, operational databases, and reporting systems. Implement data validation, quality checks, error handling, logging, and performance optimization. Schedule and automate ETL workflows and monitor production processes. Troubleshoot ETL issues and optimize pipeline performance and reliability. Collaborate with business stakeholders, analysts, and development teams to deliver data solutions. Create technical documentation and support production deployments.
Required Qualifications:
- 8+ years of experiencein ETL development, data integration, and data engineering.
- Strong hands-on experience with
- Pythonfor ETL development and automation.
- Extensive experience designing, developing, and maintaining ETL pipelines.
- Proven experience building and consumingREST APIsfor data integration.
- StrongSQLskills with experience in Oracle, SQL Server, PostgreSQL, MySQL, or similar databases.
- Experience working withJSON, XML, CSV, and other structured/unstructured data formats.
- Experience with data validation, data quality, error handling, logging, and performance optimization.
- Experience scheduling and automating ETL workflows.
Preferred Qualifications:
- Experience with
- Apache Airflow, SSIS, Informatica, Talend, or similar ETL tools.
- Experience withAWS, Azure, or GCPcloud platforms.
- Knowledge of data warehousing and dimensional modeling concepts.
- Experience with
- Git, CI/CD pipelines, and Agile methodologies .