Data Engineering Lead

As a Data Engineer, you will be responsible for developing and maintaining data pipelines using Azure Data Factory (ADF) and Databricks for data integration and ETL processes. Your role will involve designing, implementing, and optimizing Power BI and Fabric reports and dashboards to provide actionable business insights. Collaboration with data analysts, business users, and other teams will be essential to understand data requirements and deliver solutions using ADF and Power BI. Additionally, you will be extracting, transforming, and loading data from various sources into cloud-based storage systems such as Azure Data Lake or Azure SQL Database. Working with large datasets, you will optimize queries and pipelines for performance and scalability, ensuring data quality, integrity, and availability throughout the data lifecycle. Automation of repetitive data tasks will be key to ensuring timely and accurate reporting. Monitoring and troubleshooting data pipelines to address performance or data issues promptly will also be part of your responsibilities. Supporting data visualization and reporting tools, including Power BI, to enable business stakeholders to make data-driven decisions will be crucial. Lastly, you will be writing clear, efficient, and maintainable code for data transformations and automation. Qualifications Required: - Bachelor's degree in computer science, Information Technology, Engineering, or a related field. - 8+ years of hands-on experience in Data Engineering, BI Developer, or a similar role. - Proficiency with Azure Data Factory (ADF) for creating data pipelines and managing data flows. - Strong experience in Power BI, including report creation, dashboard development, and data modeling. - Experience with SQL and database management, such as Azure SQL Database and SQL Server. - Knowledge of cloud platforms, especially Microsoft Azure. - Familiarity with data warehousing concepts and ETL processes. - Experience with cloud-based data storage solutions, like Azure Data Lake and Azure Blob Storage. - Strong programming skills in languages such as Python, SQL, or other relevant languages. - Ability to troubleshoot and optimize data pipelines for performance and reliability. What we need: - B. Tech in computer science or equivalent. Join us to work with a passionate and innovative team in a fast-paced, growth-oriented environment. Gain hands-on experience in content marketing with exposure to real-world projects. Benefit from the opportunity to learn from experienced professionals and enhance your marketing skills. Contribute to exciting initiatives and make an impact from day one. Enjoy a competitive stipend and potential for growth within the company. Recognized for excellence in data and AI solutions with industry awards and accolades.,