Data Engineer

Description:

We are seeking a motivated and skilled Data Engineer with 0-1+ years of hands-on experience to join our dynamic team. This is an exciting onsite opportunity based in Karachi. The ideal candidate will have a strong foundation in cloud platforms (AWS, GCP, Azure), along with expertise in Spark, SQL, SparkSQL, and Python.

Responsibilities:

• Design, develop, and maintain scalable data pipelines across cloud platforms (AWS, GCP, Azure).

• Build and optimize data processing frameworks using Apache Spark and SparkSQL.

• Write complex SQL queries for data extraction, transformation, and loading (ETL) processes.

• Develop Python scripts to automate data workflows and processing tasks.

• Work with structured and semi-structured data across various cloud storage systems.

• Collaborate with data analysts, data scientists, and business teams to ensure data availability and accuracy.

• Optimize existing pipelines and troubleshoot data issues promptly.

• Maintain documentation for data processes, systems, and standards.

Requirements:

• Experience: 0-1+ years of professional experience as a Data Engineer or in a similar role.

• Cloud Expertise: Hands-on experience with AWS, GCP, and Azure environments.

• Technical Skills:

• Proficiency in Apache Spark and SparkSQL.

• Strong command of SQL (query writing, optimization, and troubleshooting).

• Proficiency in Python for scripting and automation.

• Solid understanding of data warehousing concepts and ETL best practices.

• Familiarity with distributed computing concepts and big data tools.

• Strong problem-solving abilities and attention to detail.