Job Description
Svitla Systems Inc. is looking for a Senior Data Engineer for a full-time position (40 hours per week) in Colombia, Mexico.
You'll take full ownership of a Python/Scrapy-based legal/regulatory data ingestion pipeline. This role combines large-scale data engineering, advanced web scraping against hostile sources, complex legal document processing, and cost-efficient cloud infrastructure design. It also includes maintenance of a React frontend application.
Requirements
- 5+ years of experience in data engineering or backend development, with a focus on production pipelines.
- Strong experience in Python, including production web scraping (Scrapy or equivalent) and structured-data processing.
- Practical understanding of defeating or working around anti-bot measures (rate limiting, Cloudflare, paywalled/gated legal databases) within legal and ethical bounds.
- Understanding of relational and non-relational databases; sch...