Data Engineer

Description:

What You’ll Do:

🔍 Data Sourcing & Extraction

• Research and identify valuable real estate, government, and public data sources
• Scrape data from complex websites using Python tools like BeautifulSoup, Scrapy, Selenium, Playwright

🔄 Data Transformation & Integration

• Clean & transform raw data into structured, usable formats with Pandas or Dask
• Integrate data into AWS services like S3, Lambda, EC2, RDS

⚙️ Automation & Orchestration

• Design automated workflows with Apache Airflow, Luigi, or Prefect
• Create and maintain CI/CD pipelines using GitHub Actions and AWS CodePipeline

💬 Collaborate & Document

• Work closely with AI/ML engineers, data analysts, and backend developers
• Document all processes, pipelines, and transformations for internal use

What We’re Looking For:

💻 Expert in Python for web scraping, automation, and transformation

🌐 Web Scraping Tools experience (BeautifulSoup, Scrapy, Selenium, Playwright)

📊 Data Transformation experience with Pandas, Dask, or similar tools

☁️ AWS Services expertise (S3, EC2, Lambda, RDS, Glue)

🔧 Orchestration Tools experience (Airflow, Luigi, Prefect)

⚙️ CI/CD Pipelines knowledge using GitHub Actions and AWS CodePipeline

🗣️ Clear Communication for documenting processes and collaborating across teams

Perks:

• Competitive Salary
• Collaborative and Growth-Oriented Environment
• Hands-on Experience with Cutting-Edge Tech
• Opportunity to work with a forward-thinking team