Job Description
We are looking for a Databricks Architect with strong experience in building and optimizing ETL pipelines on cloud platforms like AWS or Azure. This role involves working on large scale data processing real time pipelines and leading data engineering initiatives.
Build and optimize ETL pipelines using Databricks and Spark
Work with SQL Python PySpark and Delta Lake for data processing
Implement CI CD pipelines using Azure DevOps and manage workflows with Airflow
Integrate data using APIs and support real time streaming solutions
Lead data engineering projects and collaborate with cross functional teams
Must Have Skills
Strong Databricks and Spark experience
SQL, Python and ETL pipeline development
Experience with cloud platforms AWS or Azure
Experience with Delta Lake and data processing
#J-18808-Ljbffr
Build and optimize ETL pipelines using Databricks and Spark
Work with SQL Python PySpark and Delta Lake for data processing
Implement CI CD pipelines using Azure DevOps and manage workflows with Airflow
Integrate data using APIs and support real time streaming solutions
Lead data engineering projects and collaborate with cross functional teams
Must Have Skills
Strong Databricks and Spark experience
SQL, Python and ETL pipeline development
Experience with cloud platforms AWS or Azure
Experience with Delta Lake and data processing
#J-18808-Ljbffr