Job Description
Overview
Job Role: Data Engineer
Duration: 5 Months (4 days need to onsite)
Location: Toronto, ON
You'll design and maintain high-performance data pipelines as a core member of our technology transformation team. Your focus: migrating legacy SAS processes to Python and PySpark, while optimizing data processing across HDFS/Hive and AWS S3 platforms. This hands-on technical position offers the opportunity to drive scalability, efficiency, and accuracy improvements in solutions that directly impact credit risk management across the organization.
Responsibilities
- Build and optimize scalable data pipelines in Python and PySpark, ensuring reliability and performance across HDFS/Hive and AWS S3 environments.
- Lead migration initiatives transforming legacy SAS processes into modern, cloud-ready Python/PySpark solutions.
- Architect data workflows that support credit risk analytics and business intelligence at scale. <...