Upvote
Downvote
Data Architect (Big Data Architect)
Share Job
- Suggest Revision
Full-time
- Should have prior experience in working as a Data Warehouse/Big Data Architect.
- Experience in advanced Apache Spark processing framework, spark programming languages such as Scala/Python/Advanced Java with sound knowledge in shell scripting.
- Specifically, this experience must be in writing Big Data data engineering jobs for large scale data integration in AWS. Prior experience in writing Machine Learning data pipeline using Spark programming language is an added advantage.
- Knowledge of using, setting up and tuning resource management frameworks such as Yarn, Mesos or standalone spark.
- Experience in writing spark streaming jobs (producers/consumers) using Apache Kafka or AWS Kinesis is required.
Active Job
Updated 14 days agoSimilar Job
Relevance
Active