Technology Architect | Big Data - Data Processing | Spark
Client:
AppleDo you have a pre-identified candidate? New sourcing? Existing Subcon?- New sourcing Max Hourly Pay Rate to the candidate?: XXX/HrDo you have a preferred interview schedule?: YesWould you require the candidates to meet you for an in-person interview?: NoIs Skype/WebEx interview, OK?: YesWork Location with ZIP: Austin-TX-78753Is remote work an option?: NoIf remote work, please indicate how many days are required to be in the office and remote: 3 days in a week required to be in the office Chance to be perm?: YesPerformance Expectations: Technical Hiring Criteria (Must Haves) Top 3 Required skills: Spark, Kafka, DevOpsYears of experience in each of the must-have skills: 7+ YearsAny Certifications required: NoAny additional information you would like to share about the project specs/nature of work: NA
Job Description: Data Platform / Streaming Engineer (ARE Infra Onsite)
Role Overview:
We are looking for a proactive and technically strong Data Platform / Streaming Engineer to support and manage critical data infrastructure systems in an onsite role. The ideal candidate will combine hands-on experience in modern data technologies with strong communication and stakeholder management skills.
Required Skills & Experience
Technical / Infrastructure: Manage and support data streaming and processing platforms including:
- Apache KafkaApache Spark / FlinkWork extensively with Vertica / SQL-based systems for data querying, optimisation, and troubleshooting.
- Handle code versioning and collaboration using Git.
- Monitor, maintain, and troubleshoot production data pipelines and infrastructure.
- Support maintenance windows, deployments, and production stability.
- Operations & DevOps (Learning-Oriented)
- Participate in basic DevOps activities, including:
- Deployment coordination
- Environment handling
- Release support
- Assist in managing:
- Maintenance windows
- System upgrades and onboarding of new technologies
- Drive continuous improvement in operational efficiency and system reliability.
- Business & Stakeholder Engagement
- Act as a point of contact for internal users and stakeholders.
- Conduct and facilitate:
- Regular meetings and status discussions
- Issue resolution calls and follow-ups
- Ensure effective client communication and expectation management.
- Translate business needs into actionable technical requirements.
- Project Code: AiDP Marketing Project for CEP Starling