Are you an experienced Big Data Engineer with a track record in building scalable solutions? Have you used Spark in a commercial environment? Would you like to teach a multinational business about Big Data?
This global eCommerce business is at the beginning of their Big Data journey and is now looking for a Senior Big Data Engineer to drive a new Hadoop platform build up and scale out. They are specifically looking for someone who can advise them on, as well as implement solutions for the collection, storage and batch and near real-time processing of huge datasets.
As their new Senior Big Data Engineer you will work closely with the Head of Data Science to prepare and optimise their Big Data infrastructure according to best practice, ensuring no problems and monitoring performance of the integrated solutions you put in place. You’ll be responsible for developing, testing and maintaining data ingestion and integration pipelines, transforming business requirements into data models.
You’ll need to demonstrate previous experience of managing Hadoop cluster as well as stream processing with either Kafka or Spark Streaming. Prior experience with Impala, Hive or Pig would be beneficial. You’ll keep up with and investigate new technologies as their Big Data subject matter expert.
This is a unique opportunity to help shape the Big Data infrastructure of one of the fastest growing companies in the world. Sound like it could be fun?
Big Cloud is acting as an employment agency in relation to this vacancy.
Você tem que entrar na sua conta para poder candidatar-se a esta oferta.