JOBSEARCHER

Lead Data Engineer

ARCHIVED

We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.

Job Title: Lead Data Engineer - Big Data & Cloud (AWS)(Python)
Location: New York, NY (Onsite)
Contract: 6 MonthsVisa Status: ONLY GC & USCStrong Python and Big Data expertiseJOB DESCRIPTION:We are seeking a Senior Data Engineer / Technology Lead with 10-15 years of experience to design and own scalable, production-grade data platforms supporting Agentic AI and LLM-based systems. The role focuses on building event-driven ETL/ELT pipelines, real-time data ingestion frameworks, and optimized retrieval layers using Elasticsearch on AWS.
Key Skills: AWS Cloud ServicesBig Data PlatformsPython (Data Engineering)ETL/ELT Data PipelinesElasticsearch (nice to have)
Responsibilities: Build autonomous, feedback-driven data pipelines for AI agentsEnsure data quality, governance, and observabilityArchitect scalable cloud infrastructure for AI-driven analyticsRequirements:8-10 years of data engineering experienceStrong Python and Big Data expertiseAWS experience; relevant certifications preferred