Data Engineer with Fabric

As a Data Engineer with Fabric, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to ensure accurate, timely, and accessible data for driving data-driven decision-making and supporting company growth. Key Responsibilities: - Design, develop, and implement data pipelines using Azure Data Factory and Databricks for ingestion, transformation, and movement of data. - Develop and optimize ETL processes to ensure efficient data flow and transformation. - Maintain Azure Data Lake solutions for efficient storage and retrieval of large datasets. - Build and manage scalable data warehousing solutions using Azure Synapse Analytics for advanced analytics and reporting. - Integrate various data sources into MS-Fabric to ensure data consistency, quality, and accessibility. - Optimize data processing workflows and storage solutions to improve performance and reduce costs. - Manage and optimize SQL and NoSQL databases to support high-performance queries and data storage requirements. - Implement data quality checks and monitoring to ensure accuracy and consistency of data. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver actionable insights. - Create and maintain comprehensive documentation for data processes, pipelines, infrastructure, architecture, and best practices. - Identify and resolve issues in data pipelines, data lakes, and warehousing solutions, providing timely support and maintenance. Qualifications: - Experience: 2-4 years of experience in data engineering or a related field. - Technical Skills: - Proficiency with Azure Data Factory, Azure Synapse Analytics, Databricks, and Azure Data Lake. - Experience with Microsoft Fabric is a plus. - Strong SQL skills and experience with data warehousing concepts (DWH). - Knowledge of data modeling, ETL processes, and data integration. - Hands-on experience with ETL tools and frameworks (e.g., Apache Airflow, Talend). - Knowledge of big data technologies (e.g., Hadoop, Spark) is a plus. - Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and associated data services (e.g., S3, Redshift, BigQuery). - Familiarity with data visualization tools (e.g., Power BI) and experience with programming languages such as Python, Java, or Scala. - Experience with schema design and dimensional data modeling. - Analytical Skills: Strong problem-solving abilities and attention to detail. - Communication: Excellent verbal and written communication skills, with the ability to explain technical concepts to non-technical stakeholders. - Education: Bachelor's degree in computer science, Engineering, Mathematics, or a related field. Advanced degrees or certifications are a plus. Interested candidates can share their CV at sulabh.tailang@celebaltech.com.,