Senior Data Engineer (Barcelona)

Barcelona - España 01/06/2021

Descripción de la oferta de empleo

Our client continued growth has led to a need for a dedicated Data Engineer to join the team in our new Data Hub in Barcelona.

There are a number of new projects about to start - including a complete re-write of our ETL pipeline and a restructuring of our reporting system - which requires a talented and passionate Data Engineer to contribute. This work will deliver enormous value to our product offering and position us as best in our industry. Our ETL gathers data from our own pixel trackers, and uses 3rd party data sources to build complete browsing histories of users. This data is then fed into our data lake and warehouse, where several processes extract value from it.

There is an ongoing modernisation and rewriting effort in this area, mainly focused on Spark and SQL. To give a sense of scale, we consume around 7 billion event lines each month. These need to be validated, cleaned, matched with identifiers and then stored. As you can imagine, it is a data logistics and data management challenge, where you can find plenty of room for learning and contributing as you grow into the role. You will work together with the lead data engineer and the rest of the data and engineering team to work in the areas mentioned above. You will help improve the design, optimise and model. You may write production level code in Scala, Python and SQL, interacting with our data lake (AWS S3, Databricks, Delta Lake), Kafka and our data warehouse (AWS Redshift) to clean, structure and populate data going into the DW and from the DW to the reporting subsystems. You will also be working extensively with AWS - we are heavy users of their services. If you are starting in any of these technologies, you will be mentored and trained.

What we need from you
Having worked professionally in a data-intensive, large scale ETL environment or having extensive experience as a software engineer and wanting to grow into the data space. Programming abilities, with an eye for testing and validation. Knowledge of either Scala or Python would be a plus, but you would be trained if you didn´t know something. Good knowledge of SQL (up to types of joins, indexing and basic optimisation) is a strong requirement. You would be trained on any additional use case (columnar storage, windowing, key distribution). A basic understanding of Agile principles (we work using a full Scrum environment). Open to collaboration and willing to learn.

What you´ll get from us
Being able to work with large scale datasets. Getting to know a wide variety of technologies: we always try to use the best tool for the job. Experience with cloud-based technologies. Learn from a senior Agile team, Grow into your responsibilities over time: become an expert. Working in our Barcelona office´s data hub, and interacting with our distributed team (mainly in London but with offices in the US, Singapur and Australia).

Conditions: (Perm Contract with end client) Fix Salary + Health Insurance + Gym Pass + Homeoffice full time

Otros detalles de la oferta

CVs inscritos en el proceso: 3

Comparte esta Oferta
Datos principales de la oferta
  • Catalunya, Barcelona - Barcelona
  • Big Data
  • Jornada completa
  • 1 año
  • Indefinido
    Tipo contrato
  • Scala Python SQL

¿No tienes cuenta en

Regístrate como candidato en y vincula tu CV a las ofertas de empleo.

Crea tu cuenta gratis
Amplía tu formación con estos cursos recomendados