Sr. Data Engineer or Data Bricks Engineer

As a Data Engineer at this company, your role will involve the following responsibilities and qualifications: **Role Overview:** You will be responsible for developing and maintaining data pipelines and workflows using SQL, ETL Tools, ADF, ADB, SSIS, and Reporting Tools. Your expertise in RDBMS (SQL Server) will be crucial for SQL query writing, object creation, performance optimization, and management of DB/DWH operations. Additionally, you will need to have a good understanding of Transactional and Dimensional Data Modeling, ETL concepts, and tools like Azure Data Factory and Azure Databricks. **Key Responsibilities:** - Demonstrate expert-level knowledge in RDBMS (SQL Server) for SQL query writing, object creation, and performance optimization. - Understand Transactional and Dimensional Data Modeling, Star Schema, Facts/Dimensions, and Relationships. - Utilize ETL concepts and tools such as Azure Data Factory, Azure Databricks, and Airflow. - Develop scalable data pipelines, orchestrate workflows, implement dynamic pipelines, and optimize data transformations using Azure Data Factory and Databricks. - Work with Databricks Unity Catalog for centralized data governance, access control, auditing, and managing data assets securely. - Contribute to at least one development lifecycle of an end-to-end ETL project involving the mentioned ETL tools. - Write and review test cases, test code, and validate code. - Understand SDLC practices like source control, version management, Azure DevOps, and CI/CD practices. **Qualifications Required:** - 2 to 6 years of experience in Data Engineering. - Proficiency in SQL, ETL Tools, ADF, ADB, SSIS, and Reporting Tools. - Knowledge of Transactional and Dimensional Data Modeling, ETL concepts, and tools like Azure Data Factory and Azure Databricks. - Experience in developing data pipelines, orchestrating workflows, and optimizing data transformations. - Ability to work closely with customers, convert requirements into processes/models, and provide consultative options for project execution. - Skills in project scoping, estimating, and timeline management. - Preferred skills include knowledge of Python, SSIS, Azure DevOps, and Source Control/Repos. This company values your expertise and offers a full-time, permanent position with a day shift schedule from Monday to Friday at their Chennai office.,