The UK's Leading Data & Analytics Jobs Board

Senior Big Data Engineers x3 | Spark | Kafka | Flin

Advertiser
Harnham
Company
Harnham
Date Posted
16th October 2016
Reference
JW-BigDatax3
Category
Developer
Location
London
Benefits
bonus and benefits
Salary
£50,000 to £80,000 Per Annum
Contract Type
Permanent

Senior Big Data Engineers x3 | Hadoop | Spark | London | £50,000 to £80,000

An awesome company in the online gaming sector are going through a significant revamp of their Data department and are implementing a greenfield Hadoop & Spark platform, to create a high-performance way for their Data Scientists to introduce advanced analytics and machine learning techniques.

THE COMPANY AND TEAM

The Big Data Engineers will work as part of an exciting team on a world-class Big Data platform - they pride themselves on creating neat, efficient code and are looking for Engineers with a similar thinking.

They're currently working with data in the hundreds of terabytes range, and expect this to reach petabyte scale shortly. As an online company, they're looking to provide near real-time analytics with some genuinely innovative use cases.

THE ROLE

As the successful Big Data Engineer, your key responsibilities will be as follows:

  • Work closely with the new Head of Big Data & other senior stakeholders to analyse the best Big Data tech to use
  • Engineer a high-performance, greenfield Hadoop & Spark platform, including a combination of batch and real-time processing
  • Develop a near real-time pipeline with Spark, using Scala
  • Develop ETL processing (Hive/Flume)

YOUR SKILLS AND EXPERIENCE

The Big Data Engineers will have the following skills:

  • Significant hands-on Java/Scala programming background
  • Strong commercial experience with Hadoop and Spark, including writing complex MapReduce/Spark jobs
  • Background with a variety of tools in the Hadoop ecosystem, including Hive/Pig/Impala/Kafka/Sqoop/Flume
  • Ability to communicate with both technical and non-technical stakeholders
  • A passion for Big Data and an awareness of the impacts on the wider company

THE BENEFITS

  • A chance to work in an advanced environment with the latest technology, including Hadoop/Spark
  • The chance to work with large scale data issues
  • £50,000 to £75,000 plus great bonus and benefits

HOW TO APPLY

To be considered for this position, please click the Apply link on this page

CONTACT

For more information about this role or to enquire about others in the Big Data industry, please contact Jethro Willett at Harnham

KEYWORDS

Big Data, Senior Big Data Engineer, Hadoop Engineer, Spark Engineer, Big Data Developer, Big Data Software Engineer, Hadoop, Spark, MapReduce, Hive, Pig, Sqoop, Flink, Java, Scala, Python

Register and Apply

Login and Apply

Profile Options

Category(s) you would like to work in*:
Location(s) you would like to work in*:
Contract Type*:
Most Recent Position*:
Education/Qualification*:
Minimum Salary required*:
Willing to Relocate*:
By submitting this form you agree to our terms of use

Copyright © 2017 Big Data Jobs Board. SEO by SEMtelligence