Consultant Task – Hadoop Kafka Consultant, Remote (18.05.2021)

For a customer we are looking for a Hadoop Kafka Consultant. You will join a financial company, where your primary responsibilities will be to:

  • Be a leading part in defining identifying points needed to be managed in Exploration Hub
  • Together with the rest of the team be responsible for data and information content, metadata management
  • Translating business needs to technical specifications
  • Build, maintain and improve data pipelines that retrieve data
  • Build, maintain and improve Data warehouses
  • Develop, maintain and manage current Kafka setup, local and in the cloud
  • Develop, maintain and manage current Big Data setup, local and in the cloud
  • Secure and improve on scalable infrastructure
  • Testing
  • Technical documentation
  • Make sure development is done according to the right principles and architect road map

Location: Remote or onsite in Stockholm
Workload: 100%
Start: ASAP
Duration: Rest of 2021
Language: English is required, Swedish is an advantage

Your qualifications

We are looking for a consultant with as many of the following competencies:

  • Experienced in Hadoop and Kafka
  • Experienced in sourcing in real time using Kafka and Hadoop platforms
  • Experience with Spark, SQL, Scala
  • Experience with managing Hadoop and Kafka platforms
  • Experienced in running and maintaining Airflow for automation and workflow
  • Experience with testing and testing methods
  • Experience with Terraform and Ansible
  • Jira would be an advantage

Are you interested?
If you have the right qualifications please forward your resume to Nicolai Nielsen at [email protected]