Data Quality Engineer

 

Description:

We are building a real time data intelligence engine that transforms the web into a structured, queryable database for groundbreaking healthcare research. We need a meticulous Data Quality Engineer to implement and manage the systems that safeguard the accuracy and reliability of our mission critical data.

 

Your Mission

Execute and uphold our data quality standards through automated checks and proactive monitoring. You will be responsible for implementing data validation processes, identifying issues and working with the engineering team to maintain the high quality data our AI models depends on.

 

Your Core Responsibilities:

*Implement and manage automated data quality checks within our data pipelines, following established SOPs.

 

*Develop and execute data validation scripts using Python to identify inconsistencies and ensure data accuracy.

 

*Proactively monitor data health using the ELK Stack (Elasticsearch, Logstash, Kibana) to track quality metrics like completeness, uniqueness and timeliness.

 

*Collaborate with Data Engineers to diagnose the root cause of data issues and implement corrections.

 

*Document data quality processes and findings to ensure clarity and support compliance requirements.

 

*Identify opportunities for improvement in our data quality procedures and tools.

 

 

What You Bring to the Table:

*A Bachelor's or Master’s degree in Data Science, Computer Science, IT or a related field.

 

*Proven experience in a data focused quality role with a strong track record of implementing and running automated data quality checks.

 

*Strong programming skills in Python for data validation and automation

 

*A solid understanding of data profiling, metrics and root cause analysis.

 

*Expert hands on proficiency with the ELK Stack (Elasticsearch, Logstash, Kibana) is a must.

 

*A disciplined approach to following Standard Operating Procedures (SOPs) and handling sensitive/confidential data with care.

 

*Practical experience with project management tools, particularly Trello.ee