Data Engineer (Databricks)

You will work at iOSYS Software India Pvt. Ltd, a company providing Digital Marketing, Mobile Applications & IT Development Solutions. Your role as a Data Engineer (Databricks) will involve the following responsibilities: - Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks. - Create ETL pipelines using ADF. - Establish and maintain a Lakehouse architecture in ADLS / Databricks. - Perform data preparation tasks like cleaning, normalization, deduplication, and type conversion. - Collaborate with the DevOps team to deploy solutions in production environments. - Monitor data processes and rectify errors when identified. - Contribute as a key member of the global Analytics team, offering solutions and insights into data-related issues. - Work closely with Data Science and Business Intelligence teams globally to share knowledge and promote best practices. - Lead projects involving team members and participate in projects led by others. - Utilize change management tools for upgrades, changes, training, communication, and documentation management. As a Data Engineer, you must possess the following skills: Must Have Skills: - Pyspark - Azure - ADF - Databricks - ETL - SQL Good To Have Skills: - Change Management tool - DevOps You will be based in Gurugram, Bengaluru, or Hyderabad, with 2 days of work at the client location. The experience level required for this position is 5 - 8 years, and the work mode is hybrid. The immediate notice period is considered for this role. Your expertise should include: - Azure Databricks - Azure Data Factory - PySpark - Spark - SQL - ADLS,