KLANIK is an consulting compagny that supports its customers in their digital and technological projects. The KLANIK group now has more than 800 talents working in 16 agencies in Europe, North America, Africa and the Middle East. Committed, atypical and passionate experts, involved in strategic projects thanks to their high level of skills in Software, DevOps, Cloud, Agility, Cybersecurity & Data.
We are currently seeking a talented and experienced Data Engineer to join the Digital Data team of one of our client.
About the role
The Data Engineer is responsible for collecting, processing, and converting raw data into information that can be interpreted by data/business analysts. The Data accessibility is your ultimate goal, by enabling the Digital data users to utilize data for their business decisions. This role is more Pipeline-centric, for which you need in-depth knowledge of distributed systems and computer science.
Your key responsibilities on our Data platform (Spark environment, Scala language) will be
- Acquire datasets that align with business needs.
- Develop algorithms to transform data into useful, actionable information.
- Develop, construct, test, and maintain optimal data pipeline architectures.
- Create new data validation methods and data analysis tools.
- Ensure compliance with data governance and security policies.
- Identify ways to improve data reliability, efficiency, and quality.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Prepare data for predictive and prescriptive modeling.
- Work with data and analytics experts to strive for greater functionality in our data systems, which requires close collaboration with the other trains.
As part of the team, you will as well work as DevOps, releasing the software load to production, monitoring jobs and being involved in maintenance activities. Quality analyst activities are also handled by the Devs.
Our current data platform is a MapR architecture, and we are in the process of migrating the whole platform to the Azure cloud, which is one of the keys focuses for the team in the upcoming months.
Relevant Skills and work Experiences
- ~ Previous experience as a data engineer or in a similar role
- ~ Experience building and optimizing “big data” data pipelines, architectures and data sets.
- ~ Hands-on experience with Scala (
- ~2 years or a strong experience with Java/C++ with a good knowledge level of Scala)
- ~ Experience with big data tool: Spark, Kafka, MapR, Hadoop
- ~ Understanding extract, transform, and load ETL systems
- ~ Knowledge of cloud services: MS Azure
Soft skills
- English: professional level
- University degree in Computer Science, Software Engineering, or similar field; a data specialization is a plus
- Agile Mindset: must be comfortable working with Agile values and artifacts
- Fast learning: must be able to adapt quickly to the existing environment and new changes
- Analytical thinking and problem-solving mindset: must be able to quickly identify, implement work-around to solve incidents and work on long term data solutions
- Team spirit, knowledge sharing, Empathy: must be able to work in a team and to communicate clearly with the other team members and users
- Knowledge of airline business is a plus