Senior Data Engineer (Azure)

As a Senior Data Engineer (Azure) at our company, you will play a crucial role in designing, building, and maintaining data solutions on the Azure cloud platform. Your primary responsibility will be to collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient data pipelines and architectures. Here is a breakdown of what will be expected from you: Responsibilities: - Design, develop, and deploy data solutions on the Azure cloud platform, utilizing services such as Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics. - Collaborate with analysts and other stakeholders to comprehend business requirements and translate them into technical solutions. - Construct and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data. - Optimize data storage, retrieval, and processing techniques to ensure high performance and cost efficiency. - Monitor and troubleshoot data pipelines to identify and resolve performance issues and bottlenecks. - Document data solutions, including architecture diagrams, technical specifications, and operational procedures. - Be actively involved in the analysis and design phases of projects, participate in application design sessions, and provide solution recommendations. - Work cooperatively in a team environment and remain adaptable to changing workloads. Qualifications: - BE/BTech/MCA degree in computer science or a related field. - Minimum 5-10 years of experience in data engineering, focusing on designing and building data solutions on the Azure cloud platform. - Hands-on experience with Azure services like Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and Azure Data Lake. - Proficiency in programming languages such as C# and Python for data processing and automation. - Experience using DBT (Data Build Tool) for building and managing data pipelines and transformations in a data warehouse environment. - Familiarity with data warehousing concepts, dimensional modeling, data modeling, and ETL/ELT processes. - Knowledge of data migration to Dynamics CRM using SSIS Kingsway Soft or ADF. - Proficiency in SQL and working experience with relational databases like SQL Server or MySQL and non-relational databases like Cosmos DB. - Hands-on experience with SSIS components such as Control Flow tasks, Data Flow transformations, Connection Managers, and Event Handlers. - Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment. - Proficient in Azure DevOps (ADO) practices including Boards, Git Repos, CI/CD pipelines. - Demonstrated analytical, problem-solving, organizational, and interpersonal communication skills. Preferred Qualifications: - Microsoft Azure Data Engineer Associate, MCSD, Power BI Analyst certification. - Knowledge of the Automobile, Online Auctions, and Classifieds industry would be advantageous.,