Senior Data Engineer – Java Spark Cloud-Native Applications

Unleash transformative data solutions — drive innovation at the forefront of cloud-native technologies!

Lisbon-based opportunity with hybrid work model (up to 3 days remote per week).

As a Senior Data Engineer, you will be working for our client, a leader in data-driven solutions, focusing on the conception and development of a robust Data Processing platform using Spark in a dynamic and multicultural environment. You will contribute to shaping scalable and efficient data pipelines that empower strategic decision-making and innovation.

Your main responsibilities:

• Design and develop high-performance data processing applications utilizing Apache Spark in batch mode.
• Implement solutions with Java 9+ and Spring frameworks, incorporating modern language features like lambdas, streams, and futures.
• Collaborate on cloud-native architectures using Docker and Kubernetes to ensure scalable deployment.
• Optimize performance and troubleshoot complex data workflows, ensuring stability and efficiency.
• Work with relational databases such as PostgreSQL and Oracle ExaCC, and manage object storage solutions like S3.
• Contribute to CI/CD pipelines using tools like Maven, GitLab, ArgoCD, and Liquibase to streamline development.
• Apply best practices in solution design, pattern implementation, and performance tuning.
• Participate in code reviews and knowledge sharing to foster continuous improvement.

You're ideal for this role if you have:

• At least 8 years of experience in Java/J2EE development, preferably in Data Processing contexts.
• Minimum of 1-year hands-on experience with Apache Spark.
• Strong proficiency with cloud-native applications, Docker, and Kubernetes.
• Solid understanding of modern Java features, including lambdas, streams, and futures.
• Experience with transactional SQL and Spark SQL.
• Knowledge of relational databases like PostgreSQL and Oracle ExaCC.
• Familiarity with CI/CD tooling such as Maven, GitLab, and Liquibase.
• Good command of English (fluent) and French (B2 level).

It is a strong plus if you have:

• Experience with Argo Workflow.
• French language skills at B2 level.

Language Required for the role:

• Fluent English and French.

Eligibility for the role:

• Only candidates with an existing legal right to work in Europe will be considered for this role.

#MAKEYourCareerBETTER
Interested? Apply now and include your CV in English or Polish, along with a statement confirming your consent to the processing and storage of your personal data.