Mid-Level Hadoop Developer – Spark & Scala

Accelerate financial intelligence — build scalable Big Data solutions that strengthen the future of banking!

Lisbon-based opportunity with a hybrid work model, including up to two remote days per week.

As a Mid-Level Hadoop Developer, you will be working for our client, a leading banking group, on an on-premises Cloudera Hadoop Big Data platform supporting the Finance and Risk Datalake. You will help develop scalable features, optimize the data architecture, and contribute to reliable solutions in a collaborative DevOps and Agile environment.

Your main responsibilities:

• Collaborate on the technical design of new features.
• Develop and enhance features for a scalable Big Data platform.
• Rationalize and reuse components to optimize the architecture.
• Participate in code reviews and contribute to overall code quality.
• Support deployments to test and production environments in a DevOps context.
• Manage component upgrades and perform associated testing.
• Create and maintain technical documentation.
• Participate in Agile ceremonies using Jira and Confluence.

You're ideal for this role if you have:

• At least 5 years of experience as a Data Engineer.
• Strong proficiency in Spark 3, including optimization techniques.
• Experience with Scala 2.
• Strong knowledge of the Hadoop ecosystem, including YARN, HDFS, Hive, and Kafka.
• Experience with CI/CD pipelines, including Jenkins, XL Deploy, and XL Release.
• Practical knowledge of Bitbucket Git, Jira, and Confluence.
• Experience with Control-M job scheduling.

It is a strong plus if you have:

• Knowledge of Hadoop security technologies, including Kerberos and Ranger.
• Experience with a functional programming framework such as ZIO or Cats.

Language Required for the role: Fluent English.

Eligibility for the role: Only candidates with an existing legal right to work in Europe will be considered for this role.

#MAKEYourCareerBETTER

Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.