Data Engineering Lead

Job Description

Job Location: Hyderabad, Indore and Ahmedabad (India) What You Will Do: Following are high level responsibilities that you will play but not limited to: · Develop and maintain data pipelines using Azure Data Factory (ADF) /Databricks for data integration and ETL processes. · Design, implement, and optimize Power BI /Fabric reports and dashboards to deliver actionable business insights. · Collaborate with data analysts, business users, and other teams to understand data requirements and deliver solutions using ADF and Power BI. · Extract, transform, and load (ETL) data from various sources into cloud-based storage systems such as Azure Data Lake or Azure SQL Database. · Work with large datasets and optimize queries and pipelines for performance and scalability. · Ensure data quality, integrity, and availability throughout the data lifecycle. · Automate repetitive data tasks, ensuring timely and accurate reporting. · Monitor and troubleshoot data pipelines, addressing any performance or data issues promptly. · Support data visualization and reporting tools, including Power BI, to enable business stakeholders to make data-driven decisions. · Write clear, efficient, and maintainable code for data transformations and automation. Required Qualifications: · Bachelor's degree in computer science, Information Technology, Engineering, or a related field. · 8+ years of hands-on experience in Data Engineering, BI Developer or a similar role. · Proficiency with Azure Data Factory (ADF), including the creation of data pipelines and managing data flows. · Strong experience in Power BI, including report creation, dashboard development, and data modeling. · Experience with SQL and database management (e.g., Azure SQL Database, SQL Server). · Knowledge of cloud platforms, especially Microsoft Azure. · Familiarity with data warehousing concepts and ETL processes. · Experience working with cloud-based data storage solutions (e.g., Azure Data Lake, Azure Blob Storage). · Strong programming skills in languages such as Python, SQL, or other relevant languages. · Ability to troubleshoot and optimize data pipelines for performance and reliability. Preferred Qualifications: · Familiarity with data modeling techniques and practices for Power BI. · Knowledge of Azure Databricks or other data processing frameworks. · Knowledge of Microsoft Fabric or other Cloud Platforms. What we need? · B. Tech computer science or equivalent. Why join us? · Work with a passionate and innovative team in a fast-paced, growth-oriented environment. · Gain hands-on experience in content marketing with exposure to real-world projects. · Opportunity to learn from experienced professionals and enhance your marketing skills. · Contribute to exciting initiatives and make an impact from day one. · Competitive stipend and potential for growth within the company. · Recognized for excellence in data and AI solutions with industry awards and accolades.