Lead Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Job Description:
We are seeking an experienced Technology Lead / Lead Data Engineer with strong hands-on expertise in Python, AWS, and SQL. The ideal candidate will lead data engineering initiatives, build scalable data processing pipelines, and collaborate closely with architecture and business teams in a client-facing environment. This role requires strong technical leadership, experience working in Agile delivery models, and prior exposure to enterprise or financial industry environments.
Key Responsibilities:
- Design, develop, and maintain scalable data engineering solutions using PythonBuild and optimize data processing, transformation, and orchestration pipelinesWork extensively with AWS cloud services for data storage, processing, and deployment
- Collaborate with architects, business analysts, and stakeholders to gather and refine requirements
- Translate business needs into technical solutions and system designs
- Participate in design discussions and provide technical leadership for data platforms
- Ensure data quality, performance, and reliability across pipelinesWork in an Agile/Scrum environment with distributed (onshore/offshore) teams
- Support integration of AI/ML-related initiatives where applicable
- Engage directly with client teams for requirement gathering and solution delivery
- Required Skills & Qualifications 10+ years of experience in Data Engineering or related field
- Strong hands-on experience in Python for data engineering
- Proven experience with AWS cloud services (e.g., S3, Glue, Lambda, EMR, Redshift, etc.)Strong proficiency in SQL and data modeling
- Experience in data transformation and orchestration frameworks
- Strong communication skills and client-facing experience
- Experience working in Financial Services or Banking domain preferred
- Ability to work onsite/hybrid in Irvine, CA