Job Description
About the Job We are seeking a skilled Data Engineer to architect, build, and optimise scalable data platforms on cloud infrastructure. The role involves close collaboration with cross-functional teams to deliver robust, secure, and high-performance data solutions that support analytics and business operations. Core Responsibilities - Design, develop, and maintain scalable ETL/ELT pipelines, data lakes, and data warehouse solutions.
- Build and optimize data ingestion frameworks for batch and real-time processing.
- Develop and deploy containerised applications using Docker, Amazon ECR, and Amazon ECS.
- Design and implement RESTful APIs for system integrations using modern frameworks (e.G., FastAPI).
- Implement Infrastructure as Code (IaC) using Terraform and AWS CloudFormation.
- Establish and maintain CI/CD pipelines for automated build, test, and deployment workflows.
- Ensure adherence to data security, governance, and compliance standards (e.G...
- Build and optimize data ingestion frameworks for batch and real-time processing.
- Develop and deploy containerised applications using Docker, Amazon ECR, and Amazon ECS.
- Design and implement RESTful APIs for system integrations using modern frameworks (e.G., FastAPI).
- Implement Infrastructure as Code (IaC) using Terraform and AWS CloudFormation.
- Establish and maintain CI/CD pipelines for automated build, test, and deployment workflows.
- Ensure adherence to data security, governance, and compliance standards (e.G...