Job Description
Join Seaspan Corporation as a Databricks Developer in our Data Development team. Implement scalable data pipelines and enhance analytics capabilities using Apache Spark and Databricks.
As an experienced Databricks Developer, you will report to the Team Lead and design robust data solutions for enterprise analytics. Your skills in SQL, PySpark, and Azure Data Factory will be vital in developing efficient ETL pipelines and managing performance on Delta Lake. You will work cross-functionally to ensure data quality and governance, contributing to high-quality datasets.
Key Responsibilities:
• Design and maintain scalable data pipelines with Databricks
• Develop ETL/ELT pipelines using Azure Data Factory
• Integrate and transform large datasets into analytics-ready outputs
• Optimize Spark jobs for improved performance
• Collaborate with Data Scientists and Analysts for data delivery
Requirements:
• 5+ years in data engineering or big data development
• Bachelo...
As an experienced Databricks Developer, you will report to the Team Lead and design robust data solutions for enterprise analytics. Your skills in SQL, PySpark, and Azure Data Factory will be vital in developing efficient ETL pipelines and managing performance on Delta Lake. You will work cross-functionally to ensure data quality and governance, contributing to high-quality datasets.
Key Responsibilities:
• Design and maintain scalable data pipelines with Databricks
• Develop ETL/ELT pipelines using Azure Data Factory
• Integrate and transform large datasets into analytics-ready outputs
• Optimize Spark jobs for improved performance
• Collaborate with Data Scientists and Analysts for data delivery
Requirements:
• 5+ years in data engineering or big data development
• Bachelo...