Data Engineer

Description:

The main purpose of this role is to contribute to the growth and maintenance of our data infrastructure and pipelines. The Data Engineer is responsible for writing high-integrity code to retrieve data from various sources and transform and load them into the data warehouse.

This role will interact with the Business Intelligence team to provide automation for various reports and extend the data warehouse schema with new fact and dimension tables as needed.

The Data Engineer is also responsible for ensuring the pipelines are monitored, alerts are put in place, and the quality of outputs is maintained for data integrity and correctness.

This would suit an experienced Data Engineer with a strong technical background, who is proficient in ETL pipelines, automation, and AWS databases, with an established history of working with BI teams.

Key Skills & Experience

· 1.5+ years in a Data Engineer role

· Strong Python ETL experience with knowledge of End-to-End Data Engineering pipeline architecture

· Advanced SQL knowledge and experience with Redshift, MySQL, Postgresql, and SQL Server

· Appreciation and knowledge of monitoring, alerting, and metrics

· Track record of building and optimizing data pipelines, architectures, and ETLs

· Experience with AWS cloud services: Redshift, RDS, EC2, Lambda, Glue

. Working knowledge of APIs and Data extraction from multiple APIs.

. Experience with Google Analytics APIs, Firebase, etc for user-level analytics

Desirable Skills & Experience

· AWS or Azure (Preferably ETL and Data Warehousing)

· BI tools, preferably Power BI or Google Data Studio

. Databases, preferably Postgres, SQL Server, MySQL

Responsibilities:

· Creating and maintaining ETL pipelines and End-to-End Implementation from Ingestion to monitoring

· Implementing monitoring and alerting

· Setting up warehouse from Consolidated data and Creating new fact and dimension aggregated tables

· Making data-related changes to our main software platform

. Being good at Tekken and cards would be a plus point too because when our analysts aren't mining actionable intelligence, you might find them trying to battle it out in Tekken.