Data Engineer

Data Integration & Pipeline SupportSupport and enhance ETL and ELT pipelines Integrate data from diverse sources including databases, APIs, filesystems, streaming platforms, and cloud storage.Troubleshoot data flow failures, latency issues, and throughput constraints.Implement robust error handling, monitoring, and recovery mechanisms.Python & Custom DevelopmentUse Python for transformations, scripting, automation, and custom processor logic (where applicable).Governance, Security & OperationsApply best practices for secure data movement, authentication, authorization, and encryption.Assist with flow versioning, deployment processes, and operational runbooks.Collaborate with internal teams to ensure platform changes align with operational and compliance requirements.Advisory & CollaborationAct as a technical advisor to internal data and platform teams.Clearly document findings, recommendations, and implemented improvements.Provide knowledge transfer and guidance to ensure long-term sustainability.Required Experience & SkillsStrong knowledge of ETL/ELT concepts and modern data pipeline architectures.Proficiency in Python for data processing, scripting, and automation.Experience working with Linux-based systems and distributed environments.Ability to analyze existing implementations and deliver actionable optimization recommendations.Preferred ExperienceFamiliarity with CI/CD practices for data pipelines.Experience with monitoring and tuning distributed data platforms.Exposure to cloud and hybrid data architectures.Engagement ExpectationsDeliverables-focused, hands-on consulting role.Ability to work independently while collaborating with internal stakeholders.Clear written and verbal communication of technical findings and recommendations.