Azure Data Bricks

Please find the below JD   Below is the updates data.

Skill: Azure Databricks

Location: Pan India

Experience: 5 to 9 years

Shift timings: 9 AM to 6PM

Notice period : Immediate or Serving Notice Period Only

Skills:

5+ yrs. in Azure Databricks technologies.
• Good understanding of ETL , BI and DW technologies.• Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.• Work together with data scientists and analysts to understand the needs for data and create effective data workflows.• Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.• Utilizing Azure Data Bricks to create and maintain ETL (Extract, Transform, Load) operations.• Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.• Improve the scalability, efficiency, and cost-effectiveness of data pipelines.• Monitoring and resolving data pipeline problems to guarantee consistency and availability of the data.• Experience in PySpark or Spark.• Good communication skills Oral & Written

Here are the additional points provided by the panel, in addition to the JD. Please make sure that candidates have relevant experience in these areas and that this is highlighted in the project summary.

Please fine below Core ADB skills

• Hands on experience on Azure databricks skills & not Azure Data Factory, usually both go hand in hand, but client need Databricks skills
• Should have used or worked on ADB for data transformation using ADB notebooks with PySpark or spark programming.
• Experience in dealing with Json or XML processing and data flattening.
• Experience in handling SCD type 1 and 2
• Experience in loading dimension & fact and data modelling
• Communication skills - oral & written