Job Description
Urgent requirement of AWS Data Engineer - Contract - Sydney Requirements Key Responsibilities: Design and implement scalable data pipelines using Python or PySpark, and boto3 Integrate with Amazon Redshift for data warehousing and perform data ingestion and transformation tasks Work with Amazon S3 to architect and manage data lakes Build and manage batch processing jobs using AWS Glue, EMR, and Lambda Support streaming data workflows using Amazon Kinesis Leverage AWS Secrets Manager and KMS for secure data handling and encryption Write efficient SQL for data querying, transformations, and performance tuning Collaborate with data engineering, product, and DevOps teams to deliver end-to-end solutions Participate in code reviews, debugging, and testing activities to ensure high-quality software delivery Use Git for version control and follow best practices in CI/CD Continuously explore and recommend improvements to enhance system performance, scalability, and maintainability Required Skil...