Senior Big Data Engineer – Spark, Hadoop, Python, Kafka

Ignite Big Data Innovation — Power the Future of Financial Services!

Porto-based opportunity with a hybrid work model.

As a Senior Big Data Engineer, you will be working for our client in the financial services industry, collaborating closely with an international team to develop scalable data solutions. Your expertise will drive the integration and optimization of big data platforms, enabling data-driven decision-making and innovative financial products.

Your main responsibilities:

• Design, develop, and optimize large-scale data processing pipelines using Spark, Hadoop, Hive, and Kafka.
• Write efficient Python scripts for data manipulation and integration tasks.
• Implement and maintain robust CI/CD processes, ensuring smooth deployment and continuous improvement.
• Collaborate with cross-functional teams to enhance system performance and scalability.
• Manage source code using Git and support deployment through XL Release and XL Deploy.
• Utilize scheduling tools like CTRL-M to automate workflows.
• Contribute to DevOps practices and promote a culture of automation and efficiency.

You're ideal for this role if you have:

• At least 9 years of hands-on experience in big data engineering or related fields.
• Proven expertise with Spark, Hadoop, Python, Kafka, SQL, and Linux environments.
• Solid background in software development, CI/CD, and optimization techniques.
• Familiarity with DevOps concepts and tools like Git, XL Release, XL Deploy, and CTRL-M.
• Fluency in English (minimum B2 level).
• A positive, collaborative attitude with strong organizational and prioritization skills.
• Ability to work autonomously within an international, distributed team.
• Willingness to learn, share knowledge, and proactively contribute to innovative solutions.
• Knowledge of French is a highly valued plus but not mandatory.

It is a strong plus if you have:

• Certifications or experience in advanced data engineering or cloud platforms.

Language Required for the role:

• Fluent English (minimum B2 level).

Eligibility to work in:

• Only candidates with an existing legal right to work in Europe will be considered for this role.

#MAKEYourCareerBETTER

Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.