5 Synapse Pipelines Jobs

You should possess 8-10 years of Data and Analytics experience, including at least 5 years in Azure Data Factory and a minimum of 2 years in Databricks. Your communication and presentation skills should be excellent. It is required to have mastery in Data Engineering and Data Analysis, along with being Data Bricks Certified. You should have expertise in ETL/ELT processes, specifically in Azure Data Factory, Synapse Pipelines, and data transformation tasks like deduplication, filtering, sorting, etc. Proficiency in SQL and programming languages like Python is expected. As part of your skill set, you should be proficient in Azure Data Engineering Tools such as ADLS, SQL DB, Data Factory, Databricks, and Key Vault. Experience in job scheduling, automation, and orchestration using Azure Logic Apps, Functions, or any other ETL scheduler is essential. Designing and developing production data pipelines within a big data architecture, using Python, Scala, and having a good understanding of Delta Lake is crucial. Experience in building and delivering data analytics solutions using Azure is required. You should be familiar with project delivery methodologies like Waterfall, Agile, Scrum, and have experience in managing both internal and external stakeholders. Additionally, working experience with reporting tools like Power BI, Tableau, etc., will be an advantage.,

As a Microsoft Azure Data Engineer based in the APAC region, your primary role will involve designing, developing, and maintaining data solutions for APAC Advisory products. Your responsibilities will include ensuring data quality, security, scalability, and performance of data products. Collaborating with product managers, developers, analysts, and stakeholders is essential to understand business requirements and translate them into data models and architectures. You will have the opportunity to work closely with Data Architects, Engineers, and Data Scientists within the organization to support the development and maintenance of various data products. Your expertise will contribute significantly to enhancing product effectiveness and user experiences. Leveraging the organization's data assets for decision-making, analytics, and operational efficiency will be a key focus of your role. Your main responsibilities will revolve around designing, implementing, and managing data pipelines and architectures on the Azure Synapse platform. Utilizing tools such as PySpark, Synapse pipelines, and API integrations, you will be instrumental in developing robust data solutions that align with our business needs. Implementing the Medallion Architecture framework, including Bronze, Silver, and Gold layers, will be crucial for efficient data processing and storage. Key Responsibilities: - Design and implement data pipelines using PySpark Notebooks. - Manage and optimize data storage and processing with the Medallion Architecture framework. - Develop and maintain ETL processes for data ingestion, transformation, and loading. - Integrate APIs to facilitate data exchange between systems. - Create and manage table views for data visualization. - Ensure data quality, consistency, and security across all layers. - Collaborate with stakeholders to understand data requirements and deliver solutions. - Monitor and troubleshoot data pipelines to ensure reliability and performance. - Stay updated with the latest Azure technologies and best practices. Qualifications: - Bachelor's degree in computer science, Information Technology, or a related field. - Proven experience as a Data Engineer focusing on Azure technologies. - Proficiency in PySpark notebooks and Synapse pipelines with a minimum of 2 years of demonstrable experience. - Experience with Medallion Architecture and data management through different layers. - Familiarity with API integration and master data management tools like Profisee. - Ability to create and manage table views for data visualization. - Strong problem-solving skills, attention to detail, and communication skills. - Ability to thrive in a fast-paced, dynamic environment. Preferred Qualifications: - Azure certifications, such as Azure Data Engineer Associate. - Experience with other Azure services like Azure Databricks, Azure Synapse Analytics, and Azure SQL Database. - Knowledge of data governance and security best practices. - Familiarity with additional master data management tools and techniques. INCO: Cushman & Wakefield,

You will be joining YASH Technologies, a leading technology integrator focused on helping clients enhance competitiveness, optimize costs, and drive business transformation in an increasingly virtual world. As a Microsoft Fabric Professional, you will be responsible for working with cutting-edge technologies in Azure Fabric, Azure Data factory, Azure Databricks, Azure Synapse, Azure SQL, and ETL processes. Your key responsibilities will include creating pipelines, datasets, dataflows, Integration runtimes, and monitoring pipelines in Azure. You will be extracting, transforming, and loading data from source systems using Azure Databricks and creating SQL scripts for complex queries. Additionally, you will develop Synapse pipelines to migrate data from Gen2 to Azure SQL and work on data migration pipelines to Azure cloud (Azure SQL). Experience in using Azure Data Catalog and Big Data Batch Processing Solutions, Interactive Processing Solutions, and Real-Time Processing Solutions will be beneficial for this role. While certifications are considered good to have, YASH Technologies provides an inclusive team environment where you are empowered to create a career path aligned with your aspirations. The workplace culture is grounded on principles like flexible work arrangements, emotional positivity, trust, transparency, open collaboration, and all necessary support for realizing business goals. Join us at YASH Technologies for stable employment and a great atmosphere with an ethical corporate culture.,

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, you will be part of a team of bright individuals working with cutting-edge technologies. Our purpose is to bring about positive changes in an increasingly virtual world that transcend generational gaps and future disruptions. We are currently seeking Data Warehouse Professionals in the following areas: Senior Data Engineer As a Senior Data Engineer, your role will involve supporting the European World Area utilizing the Windows & Azure suite of Analytics & Data platforms. The primary focus of this position is on the technical aspects and implementation of data gathering, integration, and database design. Your responsibilities in this role will include: - Collaborating with Product Owners and analysts to understand data requirements and developing data pipelines for ingesting, transforming, and integrating data from various sources into Azure Data Services. - Migrating existing ETL packages to Synapse pipelines. - Designing and implementing data models, data warehouses, and databases in Azure Synapse Analytics, Azure Data Lake Storage, and other Azure services. - Developing ETL processes using tools like SQL Server Integration Services (SSIS) and Azure Synapse Pipelines for data preparation. - Implementing data quality checks and governance practices to ensure the accuracy, consistency, and security of data assets. - Monitoring and optimizing data pipelines and workflows for performance, scalability, and cost efficiency. - Maintaining comprehensive documentation of processes, including data lineage, data dictionaries, and pipeline schedules. - Collaborating with cross-functional teams to understand data needs and deliver solutions accordingly. - Staying updated on Azure data services and best practices to recommend and implement improvements in data architecture and processes. To be successful in this role, you will need: - 3-5 years of experience in Data Warehousing with On-Premises or Cloud technologies. - Strong practical experience with Synapse pipelines/ADF, SSIS, and T-SQL or other RDBMS variants. - Graduate degree in computer science or a relevant subject. - Strong analytical, problem-solving, and communication skills. - Willingness to work flexible hours based on project requirements. - Proficiency in technical documentation and fluent in English. Preferred qualifications that set you apart include: - Oracle PL/SQL. - Experience with Azure Synapse Analytics, Azure Data Lake, and Azure DevOps. - Knowledge of Agile and/or Scrum methods. - Proficiency in languages like French, Italian, or Spanish. - Agile certification. As a Senior Data Engineer at YASH, you are expected to prioritize internal customer relationships, seek out emerging technologies, focus on goals, and contribute to an inclusive and supportive workplace. We offer competitive benefits, flexible work arrangements, and opportunities for growth and development. Our global volunteer employee resource groups promote diversity, inclusion, and community engagement. Join us at YASH and take charge of your career in an environment that values continuous learning, collaboration, and personal growth. Our workplace is built on principles of flexibility, positivity, trust, and support to help you achieve your professional goals in a stable and ethical environment.,

As a Microsoft Fabric Professional at YASH Technologies, you will be responsible for working with cutting-edge technologies to bring about real positive changes in an increasingly virtual world. You will have the opportunity to contribute to business transformation by leveraging your experience in Azure Fabric, Azure Data factory, Azure Databricks, Azure Synapse, Azure Storage Services, Azure SQL, ETL, Azure Cosmos DB, Event HUB, Azure Data Catalog, Azure Functions, and Azure Purview. With 5-8 years of experience in Microsoft Cloud solutions, you will be involved in creating pipelines, datasets, dataflows, Integration runtimes, and monitoring Pipelines. Your role will also entail extracting, transforming, and loading data from source systems using Azure Databricks, as well as preparing DB Design Documents based on client requirements. Collaborating with the development team, you will create database structures, queries, and triggers while working on SQL scripts and Synapse pipelines for data migration to Azure SQL. Your responsibilities will include data migration pipeline to Azure cloud, database migration from on-prem SQL server to Azure Dev Environment, and implementing data governance in Azure. Additionally, you will work on data migration pipelines for on-prem SQL server data to Azure cloud, along with utilizing Azure data catalog and experience in Big Data Batch Processing Solutions, Interactive Processing Solutions, and Real-Time Processing Solutions. To excel in this role, mandatory certifications are required. At YASH Technologies, you will have the opportunity to create a career path tailored to your aspirations within an inclusive team environment. Our Hyperlearning workplace is built on principles of flexible work arrangements, free spirit, emotional positivity, agile self-determination, trust, transparency, open collaboration, support for business goals realization, stable employment, and ethical corporate culture. Join us to embark on a journey of continuous learning, unlearning, and relearning in a dynamic and evolving technology landscape.,