Job Description
Duration: 5 Months (4 days need to go onsite)
Location: Toronto, ON
You’ll design and maintain high-performance data pipelines as a core member of our technology transformation team. Your focus: migrating legacy SAS processes to Python and PySpark, while optimizing data processing across HDFS/Hive and AWS S3 platforms. This hands‑on technical position offers the opportunity to drive scalability, efficiency, and accuracy improvements in solutions that directly impact credit risk management across the organization.
What will you do?
- Build and optimize scalable data pipelines in Python and PySpark, ensuring reliability and performance across HDFS/Hive and AWS S3 environments.
- Lead migration initiatives transforming legacy SAS processes into modern, cloud‑ready Python/PySpark solutions.
- Architect data workflows that support credit risk analytics and business intelligence at scale.
- Write production‑grade code with r...