Apache Flink Engineer
Design, develop, and maintain real-time data processing pipelines using Apache Flink. Build streaming applications using Apache Kafka and Java/Python. Develop and optimize data pipelines for high-volume, low-latency data processing. Integrate data from relational and NoSQL databases into downstream data platforms. Implement event-driven architectures and real-time data ingestion solutions. Monitor, troubleshoot, and optimize Flink jobs for performance and reliability. Work with distributed systems, fault tolerance, checkpointing, and state management. Collaborate with cross-functional teams to design scalable data engineering solutions.
Required Skills:
Strong hands-on experience with Apache Flink.
Experience with Apache Kafka and real-time streaming.
Strong programming skills in Java and/or Python.
Knowledge of Spark, PySpark, and distributed data processing.
Experience with relational and NoSQL databases.
Knowledge of Cassandra is preferred.
Understanding of event-driven architecture, data integration, and ETL pipelines.
Experience with performance tuning and troubleshooting.