Job Description
Job Description
Must-Have Skills & Qualifications
- Strong hands‑on experience with Databricks and Apache Spark (PySpark/Scala).
- Experience in SQL and data transformation techniques.
- Knowledge of ETL tools and data pipeline development.
- Experience working with cloud platforms (Azure/AWS/GCP).
- Strong Azure cloud background
- Understanding of data warehousing concepts.
- Strong problem‑solving and analytical skills.
- Hands on Experience with Azure Databricks or Delta Lake, in building ETLPipelines: batch (autoloader) and Spark structured streaming
- Knowledge of data modelling and performance tuning in Spark.
- Exposure to CI/CD pipelines and DevOps practices.
- Familiarity with data governance and security practices.
- Strong hands‑on working experience of Unity catalog:
- Hands on exposure to Creating end to end environments : creating catalogs,schemas,...