Data Engineer (Databricks)

iOSYS Software India Pvt. Ltd offers Digital Marketing, Mobile Applications & IT Development Solutions to startups, SMBs, and enterprises. Their services include end-to-end enterprise mobility solutions such as Native Applications Development, Web-Based Applications Development, Responsive Web Design, package deployment, integration, support, and maintenance services. As a leading IT solution developer, iOSYS focuses on analyzing and understanding clients" needs to deploy innovative solutions that add value to their business and enhance the experience for end-users. They specialize in providing cost-effective solutions for clients to address challenges in the marketing and technology landscape, offering industry-leading mobile applications and responsive web design solutions. Position: Data Engineer (Databricks) Location: Gurugram, Bengaluru, Hyderabad Experience Level: 5 - 8 Years Office Mode: Hybrid NP Range to Consider: Immediate Skills Required: - Excellent communication skills - 2 days work from client location - Pyspark - Azure - ADF (Azure Data Factory) - Databricks - ETL - SQL Primary Responsibilities: - Design and construct data pipelines using Spark-SQL and PySpark in Azure Databricks. - Develop ETL pipelines using Azure Data Factory. - Establish and manage a Lakehouse architecture in ADLS / Databricks. - Perform data preparation tasks including cleaning, normalization, deduplication, and type conversion. - Collaborate with the DevOps team for deploying solutions in production environments. - Monitor data processes and rectify errors promptly. - Contribute actively to the global Analytics team by providing data-related solutions and insights. - Coordinate with Data Science and Business Intelligence teams globally to share knowledge and promote best practices. - Lead projects involving team members and participate in cross-functional projects. - Implement change management tools for upgrades, changes, and data migrations including training, communication, and documentation. Required Skills: - Azure Databricks - Azure Data Factory - PySpark - Spark-SQL - ADLS Good To Have Skills: - Change Management tools - DevOps expertise This role at iOSYS Software India Pvt. Ltd requires a Data Engineer experienced in Databricks, Azure, ADF, ETL, and SQL. The successful candidate will be responsible for designing and managing data pipelines, collaborating with cross-functional teams, and implementing best practices in data management and analytics.,