Job Description
We are seeking a highly skilled Data Engineer with extensive experience in Azure Data Lake to contribute to our dynamic team at Creative Chaos. The ideal candidate will be responsible for architecting, developing, and optimizing data pipelines that will facilitate the efficient processing of large datasets.
Responsibilities:
- Designing and implementing robust data pipeline solutions within Azure Data Lake.
- Integrating and transforming data from various sources to enable comprehensive analytics and reporting.
- Ensuring data quality and integrity, implementing data governance practices.
- Collaborating with cross-functional teams to understand data requirements and develop scalable solutions.
- Monitoring and optimizing data processing workflows for performance and reliability.
- Documenting processes and architecture to ensure maintainability and scalability.
- Staying abreast of new Azure technologies ...