Job Description:

• Minimum 6 to 9 years with deep understanding of Databricks architecture and Apache Spark in Azure
• Design, develop, and optimize Spark-based data pipelines
• Collaborate with teams to align solutions with business needs
• Strong proficiency in SQL, Python and Spark, with hands-on experience developing ETL processes and data pipelines
• Must have good work experience in ADLS, ADF & Data processing in Azure cloud and other RDBMS/appliances
• Knowledge of Data Modelling techniques (Data Vault 2.0), dimensional modelling and data warehousing concepts
• Understanding of RBAC.
• Experience in Query Optimization techniques.