Core Technologies | Data & AI

Data Engineer (with Spark, Python)

Remote

Job Description

As part of our Artificial Intelligence Team, you will help out shaping the future of our software.

You will develop, test and also maintain data architectures to keep this data accessible and ready for analysis. Among your tasks, you will do Data Modelling, ETL (Extraction Transformation and Load), Data Architecture Construction and Development and also Testing of the Database Architecture.

Daily responsibilities

  • Create and maintain optimal data pipeline architecture

  • Assemble large, complex data sets that meet functional / non-functional business requirements

  • Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Cloud ‘big data’ technologies.

  • Build/use analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics

  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Real impact one step at a time 

The impact will imply the project's context and will also go beyond this, with the Competence Area community that you will be part of, with a strong focus on your technical skills. 

Professional Opportunities

You will have access to AI Community trainings and programs emphasizing skills on the technical and tactical side, while you will be engaged within new projects and opportunities landing in our business line.

Community insights

The community consists of Data Scientists and Machine Learning Engineers, along with Data Engineers sharing knowledge and projects' insights on a regular basis. We engage in projects pertaining to Computer Vision, NLP, Advanced Analytics, Preventions and Trends Analysis.

Qualifications

Must have

  • 3+ years of professional experience 

  • Experience working in Agile teams

  • Experience building and optimizing ‘big data’ data pipelines, architectures and data sets

  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

  • Strong analytic skills related to working with unstructured datasets

  • Build processes supporting data transformation, data structures, metadata, dependency and workload management

  • Technical experience with:

  1. Big data tools: Spark

  2. Object-oriented languages: Python

  3. Visualization tools: PowerBI, etc

  4. Relational Databases: Postgres

Nice to have:

  • Experience in working directly with customer stakeholders

  • Knowledge of manipulating, processing and extracting value from large disconnected datasets

  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores

  • Technical experience with

  1. Big Data tools: Databricks

  2. Data pipeline and workflow management tools: Airflow.

  3. Stream-processing systems: Storm, Spark-Streaming, etc.

BENEFITS

Physical Wellbeing

Our wellbeing program includes medical benefits, gym support, and personalised fitness options for an active lifestyle, complemented by team events and the Healthy Habits Club.

  • Private medical package for both employees and their kids

  • Eyeglasses reimbursement

  • Vouchers for sports equipment 

  • In-house fitness trainer

  • Sports classes, nutrition counselling and tailored training plans

  • Sports clubs subscription

  • SPA vouchers

Work-Life Fusion

In very dynamic industries such as IT, the line between our professional and personal lives can quickly become blurred. Having a one-size-fits-one approach gives us the flexibility to define the work-life dynamic that works for us.

  • Tenure loyalty gifts

  • Holidays celebration gifts

  • Unlimited home office days

  • Exclusive deals and discounts

  • Travel Insurance

  • Home Office furniture

  • 3rd Pillar Pension

  • Online shopping vouchers

  • Parenting & financial workshops, dedicated sessions for kids and even pet owners

Emotional Wellbeing

We believe that to maintain our overall health, we need to invest in our mental wellbeing just as much as we do in our physical health, social connections or in achieving work-life balance.

  • Therapy sessions

  • Dedicated webinars or workshops with subject matter experts (topics such as rewarding relationships, managing emotions, and many more)

Social Wellbeing

As a growing community in a hybrid environment, we want to ensure we remain connected not just by the great work we do every day but through our passions and interests.

  • Virtual activities (cooking sessions or beer tours)

  • Personalised online webinars with different expert matters

  • Seasonal parties 

  • Coffee shop benefits

Video Careers TechConf 2023

Recruitment LPv

APPLY FOR THIS JOB

We use Smart Recruiters for our application process, ensuring the security of your information. Your data is safe with us.

polygon

4.3

4.3

81% of our employees would recommend the company to a friend

Read our reviews on glassdoor