This job has ended. Find similar jobs.

Big Data Engineer

Posted 24 January by Boom Technology Group Easy Apply Ended

Are you excited and involved in the buzz about big data? How about a new opportunity to help steer the development of a new big data solution? Yes? We’d love to hear from you! We're driving forward thinking technology solutions across the telematics industry and we know big data is going to play a key part in this! This role is an exciting new opportunity for a Big Data Developer to help steer the development of a new big data solution for the company, its customers and national research. We are looking for a contractor to start ASAP while we are also recruiting for a permanent role. Streaming telematics data from over 400,000 devices along with the collection third party data sources for enrichment ,we are looking to design and develop the ability for internal and third party analytic solutions as well as self service and business intelligence solutions to companies all over the world. Essential criteria:

  • Development experience with Spark Streaming / Batch processing - preferably in Scala
  • Development experience of Hive / Impala for data storage and presentation
  • Develop scripts and scheduled tasks
  • Administration of the Hadoop eco system - Cloudera CDH 5.2 and above
  • Linux (Centos7)
  • Ability to understand data design and modelling
  • Experience using Apache Sqoop (From SQL Server)
  • One or more recognized qualification in Big Data technologies
  • Excellent communicator, able to work as a team, able to produce technical and none technical documentation
  • Able to write unit tests for managed code
  • Knowledge of Source control tools, TFS preferred

Required skills

  • Big Data

Reference: 34312007

Bank or payment details should not be provided when applying for a job. reed.co.uk is not responsible for any external website content. All applications should be made via the 'Apply now' button.

Report this job