Data Engineer

Unleash your potential in a role where big data and technology innovation intersect!!!

This is a hybrid Lisbon-based opportunity – 2x in the office

As a Big Data Developer for our client, you’ll be at the forefront of data solutions, crafting applications on cutting-edge platforms. Your work will help shape the data-centric strategy of a leading bank, with tools like Big Data Hadoop/Cloudera and advanced analytics at your disposal.

Your main responsibilities:

• Develop and maintain shell scripts to automate tasks related to Linux system administration and networking tools

• Design and implement database models to optimize data storage and retrieval

• Collaborate with development teams to effectively integrate Java, Python, and Scala into data processing pipelines

• Configure, monitor and optimize data processing frameworks such as Apache Hadoop, Spark, and Kafka to ensure optimal performance

• Participate in the design and implementation of ETL processes for data extraction, transformation, and loading into data warehouses

You’re ideal for the role if you have:

• 3 to 7 years of experience in big data development and a strong background in data architecture.

• Proficiency in SQL/NoSQL, Java, Python, and Spark, with expertise in Big Data technologies

• Excellent analytical, organizational, and communication skills

• Fluency in French (at least B1 level), enabling effective communication and collaboration within a diverse team

#GETREADY to meet with us!

We would like to meet you. If you are interested please apply and attach your CV in English or Portuguese, including a statement that you agree to our processing and storing of your data. You can always also apply by sending us an email at cv-recruitment@itdsportugal.com