Big Data Engineer (Java Focused)
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
We are hiring for a Big Data Engineer (Java). The ideal candidate will have strong expertise in Java and Apache Spark, with proven experience designing and operating large-scale batch data processing systems in cloud environments. Exposure to GCP is highly preferred, along with experience in other cloud platforms such as AWS or Azure.
Key requirements include:
- Strong hands-on experience in Java for backend and data processing systems
- Deep expertise in Apache Spark (Java API) for building robust batch pipelines
- Experience working with cloud-based data platforms, preferably GCP (BigQuery, Cloud Storage)
- Solid understanding of data formats like Parquet, Avro, and JSONStrong background in ETL/ELT frameworks, large-scale data processing, and performance optimization
- Experience with CI/CD practices and secure data handling
- Good understanding of data modeling, OLTP vs OLAP concepts, and layered data architecture
- Ability to design scalable, reliable, and maintainable data platforms
In this role, you will:
- Own and drive the architecture of Java and Spark-based data platforms
- Act as a technical leader guiding design, best practices, and implementation
- Collaborate with cross-functional teams including cloud, security, and enterprise architecture
- Mentor engineering teams and contribute to overall platform maturity
- Ensure performance, scalability, reliability, and cost efficiency of solutions.
- Experience with GenAI-driven development, observability practices, and Spark performance tuning will be an added advantage.