Consultant Task – Hadoop Kafka Consultant, Remote (18.05.2021)
For a customer we are looking for a Hadoop Kafka Consultant. You will join a financial company, where your primary responsibilities will be to:
- Be a leading part in defining identifying points needed to be managed in Exploration Hub
- Together with the rest of the team be responsible for data and information content, metadata management
- Translating business needs to technical specifications
- Build, maintain and improve data pipelines that retrieve data
- Build, maintain and improve Data warehouses
- Develop, maintain and manage current Kafka setup, local and in the cloud
- Develop, maintain and manage current Big Data setup, local and in the cloud
- Secure and improve on scalable infrastructure
- Testing
- Technical documentation
- Make sure development is done according to the right principles and architect road map
Location: Remote or onsite in Stockholm
Workload: 100%
Start: ASAP
Duration: Rest of 2021
Language: English is required, Swedish is an advantage
Your qualifications
We are looking for a consultant with as many of the following competencies:
- Experienced in Hadoop and Kafka
- Experienced in sourcing in real time using Kafka and Hadoop platforms
- Experience with Spark, SQL, Scala
- Experience with managing Hadoop and Kafka platforms
- Experienced in running and maintaining Airflow for automation and workflow
- Experience with testing and testing methods
- Experience with Terraform and Ansible
- Jira would be an advantage
Are you interested?
If you have the right qualifications please forward your resume to Nicolai Nielsen at [email protected]