Data Engineer

In this project you will be able to contact with one of the key players in banking in the EU and around the world. Thus, you will be part of a multicultural team that is spread across more than 50 countries and you will help develop solutions in one of these three areas: investments, business solutions or commercial/personal services.

We are looking for a Data Engineer to work in this project in Lisbon.

Requirements:

• 1+ years of experience in a similar position;
  
• Proficiency in Python, and SQL Querys;
  
• Good understanding of data modelling, data structures, and data management;
  
• Knowledge on Apache Spark, Apache Hadoop, Airflow, Presto and Apache Drill is a plus;
  
• Experience creating data sources on Data Visualization tools like Tableau or PowerBI;
  
• Fluent in English. 

Responsibilities:

• Design and maintain scalable and robust big data processing infrastructure, including data pipelines and ETL workflows;
  
• Design data ingestion pipelines to gather data from various sources such as databases, APIs and files;
  
• Design data processing pipelines to clean, filter and pre-process data for analysis;
  
• Setup and manage distributed computing clusters and frameworks to ensure efficient data processing and analytics;
  
• Implement and optimize secure data storage solutions to accommodate large volumes of structured and unstructured data;
  
• Optimize data pipelines, framework code, cluster utilization and configuration to ensure the best performance from pipelines;
  
• Design, maintain and enforce data governance and data catalogue;
  
• Maintain a coherent documentation of the framework, cluster and projects;
  
• Collaborate with data scientists, data analysts and stakeholders;
  
• Evaluate and recommend new tools, frameworks and techniques to improve data engineering projects and platform;
  
• Work in a continuous development framework with iterative deliveries, respecting deadlines and actively following tasks.

We offer:

• Health insurance;
  
• A personalized training plan, with a budget to spend on the training and technical books you find necessary;
  
• Constant feedback so you can grow professionally;
  
• Remote onboarding process;
  
• Team events every semester so you can live new adventures;
  
• Culture of proximity and transparency. Your ideas and needs are heard and valued by us!