Data Engineer - Streaming - Spark tuning - Scala/Java/Kafka/Datasets/Linux - Contract

This role will be looking after the Core Datawarehouse Platform

Opportunity to do full end to end - make changes in the UI

Stream based

Sourcing data from Kafka

Webservices

UI

Principal Responsibilities

• Create/enhance/maintain Spark ETL data pipelines using Scala and Kafka

• Adding new data feeds, tuning, and supporting releases

• Application Profiling and Tuning

Qualifications/Skills Required

• 4+ years of Scala Spark Streaming development
• Automated testing: Unit testing, Integration/Performance testing
• Background in an OO language such as Java/C++/C#
• 2+ years of professional Database development experience (mixed technologies)

Scala Spark Experience at an Investment Bank or Hedge Fund is ESSENTIAL

Inside IR35 - office role - Central London based

By applying to this job you are sending us your CV, which may contain personal information. Please refer to our Privacy Notice to understand how we process this information. In short, in order to supply you with work finding services, we will hold and process your personal data, and only with your express permission we will share this personal data with a client (or a third party working on behalf of the client) by email or by upload to the Client/third parties vendor management system. By giving us permission to send your CV to a client, this constitutes permission to share the personal data that would be necessary to consider your application, interview you (Phone/video/face to face) and if successful hire you.

Scope AT acts as an employment agency for Permanent Recruitment and an employment business for the supply of temporary workers. By applying for this job you accept the Terms and Conditions, Data Protection Policy, Privacy Notice and Disclaimers which can be found at our website.