JOBSEARCHER

GCP Data Engineer with Lumi (GCP) & Java Development

ARCHIVED

We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.

Job Title: GCP Data Engineer with Lumi (GCP) & Java DevelopmentLocation: Phoenix, AZJob DescriptionWe are seeking a highly skilled GCP Data Engineer with strong expertise in Google Cloud Platform (GCP), Lumi (GCP), Java development, APIs, and batch processing frameworks. The ideal candidate will be responsible for designing, developing, and maintaining scalable cloud-native data solutions, real-time and batch data pipelines, and enterprise APIs supporting large-scale analytics and business-critical applications.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP) using cloud-native services.Build and support enterprise data solutions leveraging Lumi (GCP), BigQuery, Cloud Storage, Dataproc, Pub/Sub, Dataflow, and Cloud Composer.Develop and maintain Java-based applications, RESTful APIs, microservices, and batch processing solutions to support data ingestion and transformation workflows.Design and implement batch processing frameworks using Java, Spring Boot, Spring Batch, and GCP services.Build and optimize real-time and batch ETL/ELT pipelines for processing structured, semi-structured, and unstructured data.Develop scalable APIs for data access, integration, and interoperability across enterprise platforms.Implement data quality checks, validation frameworks, and monitoring solutions to ensure data integrity and reliability.Collaborate with business analysts, architects, data scientists, and application teams to gather requirements and deliver scalable solutions.Optimize BigQuery queries, data models, and storage strategies for performance and cost efficiency.Integrate data from multiple sources including APIs, databases, messaging systems, and cloud applications.Utilize Pub/Sub, Kafka, or messaging platforms for event-driven architectures and streaming data processing.Build automated workflows and orchestration pipelines using Cloud Composer (Apache Airflow).Develop CI/CD pipelines and deployment automation using Git, Jenkins, GitHub Actions, or Cloud Build.Monitor and troubleshoot production pipelines, APIs, and cloud infrastructure issues.Implement security, governance, and compliance standards across GCP data platforms.Participate in architecture reviews, code reviews, and technical design discussions.Required SkillsStrong experience with Google Cloud Platform (GCP).Hands-on experience with Lumi (GCP) data platform.Expertise in Java development (Java 8/11/17).Experience building REST APIs, Microservices, and Batch Processing Applications.Strong experience with Spring Boot, Spring Batch, Spring MVC.Experience with BigQuery, Cloud Storage, Dataproc, Dataflow, Pub/Sub, Cloud Composer.Experience with Apache Spark, PySpark, Hadoop Ecosystem.Strong SQL and data modeling skills.Experience developing ETL/ELT pipelines and data integration solutions.Knowledge of distributed data processing frameworks such as Spark.Experience with Git, CI/CD, and Agile methodologies.Strong troubleshooting and performance tuning skills.