Data Engineer

 

Description:

· Design and optimization of database solutions that sit upstream of main production environment.

· Creation of optimized upstream database systems, e.g. consolidated/standardized clinical trial or pricing database (across multiple geographies);

· Pulling, processing and structuring new data sets, from public and private sources, e.g. research abstracts;

· Automate data pipelines using Airflow, dbt and AWS serverless compute services;

· Develop & maintain data publication and synchronization processes, supporting Tableau;

· Productionising Tableau data transforms.

 

𝐖𝐇𝐀𝐓 𝐈𝐓 𝐓𝐀𝐊𝐄𝐒

· Bachelor degree in Computer Science, similar technical field of study or equivalent practical experience;

· Excellent SQL querying skills and stored procedure creation skills;

· Experience handling large data sets in formats such as XML, JSON and CSV;

· Building data pipelines (using common tools such as Snowflake Snowpipes);

· Good Python knowledge, with a focus on data manipulation;

· AWS Data services (S3, Glue, MWAA);

· Superior communication skills, friendly approach to business and the ability to grow and adapt as business does;

· Finger on the pulse with new & emerging technologies.

Organization Macrosoft Pakistan
Industry IT / Telecom / Software Jobs
Occupational Category Data Engineer
Job Location Islamabad,Pakistan
Shift Type Morning
Job Type Full Time
Gender No Preference
Career Level Intermediate
Experience 2 Years
Posted at 2024-03-28 12:20 am
Expires on 2024-05-12