1066 Azure Synapse Jobs - Page 5

As a Lead Data Warehouse Engineer, your role is to architect, manage, and evolve the enterprise data warehouse. You will lead the data engineering team, drive best practices in data modeling and ETL development, and ensure high-performance data solutions supporting business intelligence and analytics. **Key Responsibilities:** - Design and set up the data warehouse from scratch ensuring scalability, reliability, and alignment with business goals. - Lead the design of dimensional models (facts and dimensions) and enforce data governance standards. - Oversee the development and optimization of ETL pipelines using SSIS, Python, and cloud-native tools. - Monitor and tune database performance, in...

Role Overview: You will serve as the Senior Analytics Engineer at Lennox, taking on the responsibility of designing, developing, and supporting the Azure Databricks platform and Power BI Dashboards & reports. Your key focus will be on independently gathering requirements, designing and building models and reports. You will also be required to interact with various levels of business audiences to clearly define the necessary data to support strategic and tactical decision making. In collaboration with the Data Engineering team, Business Users, and other stakeholders, you will design and deploy end-to-end Analytics solutions to meet business needs. Your involvement in the project will span acr...

Role Overview: As a Senior Data Analytics Engineer on the Data Analytics Data Platform (DADP) team, you will be responsible for analyzing, developing, and delivering business intelligence solutions using the Microsoft Analytics stack. Your expertise will be utilized to ensure client expectations and business decision-making tool needs are met. Your role will involve using analytical and problem-solving skills to create scalable and reliable data solutions through data analytics solution development. Key Responsibilities: - Lead and participate in the development of high-quality software solutions for client projects, utilizing modern programming languages and frameworks. - Contribute to syst...

As an Associate Manager - Data Engineering at EY, your main objective will be to support cloud and on-prem platform analytics and data engineering projects initiated across engagement teams. You will be responsible for conceptualizing, designing, developing, deploying, and maintaining complex technology solutions to help EY solve business problems for clients. Your role will involve working closely with technical architects, product and business subject matter experts, back-end developers, and other solution architects, and you will also have on-shore facing interactions. **Key Responsibilities:** - Evaluating and selecting data warehousing tools for business intelligence, data population, m...

Please find below for reference. Key Qualifications: 10+ years of ETL/data engineering experience, with at least 3+ years on Azure Strong experience with Azure Data Factory, Synapse, ADLS Gen2, and Databricks (PySpark) Solid SQL skills and deep understanding of data modelling (dimensional, star/snowflake) Experience with CI/CD tools (e.g., Azure DevOps), source control, and infrastructure as code for data workflows Familiarity with Azure security features (Key Vault, Managed Identity, RBAC) Proven ability to troubleshoot and optimize large-scale data pipelines Strong documentation and communication skills Preferred (Nice to Have): Experience with real-time data ingestion (Kafka/Event Hubs) A...

As a Microsoft Fabric Professional at YASH Technologies, you will be responsible for: - Experience in Azure Fabric, Azure Data factory, Azure Databricks, Azure Synapse, Azure SQL, ETL - Creating Pipelines, datasets, dataflows, Integration runtimes, and monitoring Pipelines, and trigger runs - Extracting Transformation and Load Data from the source system and processing the data in Azure Databricks - Creating SQL scripts to perform complex queries - Creating Synapse pipelines to migrate data from Gen2 to Azure SQL - Implementing Data Migration pipeline to Azure cloud (Azure SQL) - Handling database migration from on-prem SQL server to Azure Dev Environment using Azure DMS and Data Migration A...

Role Overview: As a Data Architect at DATAECONOMY, you will be responsible for leading the design and implementation of scalable, secure, and high-performance data solutions. Your expertise in data architecture, cloud platforms, and modern data frameworks will be crucial in guiding clients and teams in building next-generation data platforms. Key Responsibilities: - Lead end-to-end design and architecture of enterprise-scale data solutions across cloud and hybrid environments. - Define and implement data strategies, governance, and architecture best practices aligned to business needs. - Architect and optimize data pipelines, ETL/ELT frameworks, and real-time data processing solutions. - Pro...

Senior Data Engineer Hyderabad, Telangana IT Description Company Overview: Join a leading Revenue Cycle Management (RCM) company dedicated to transforming healthcare data into actionable insights. We leverage cutting-edge technology to streamline financial and operational processes, improving efficiency and patient outcomes. We are looking for a Senior Data Engineer to help optimize data pipelines and build a next-generation data infrastructure incorporating technologies such as Microsoft Fabric, Azure Synapse, Databricks, and Snowflake. Job Summary: As a Senior Data Engineer, you will play a crucial role in designing, building, and maintaining robust data pipelines and architectures. You wi...

Role & responsibilities • Experience in ADF • Experience in SQL Server • Ready to work in Shift (We have 24 X 7 Shift) • Maintaining and monitoring of Data Pipelines • Ability to understand the issues with pipelines and perform root cause analysis • Monitor data quality pillars like uniqueness, completeness, correctness, timeliness, consistency, availability • Good documenting skills for capturing issue logs, sequence of events, root cause analysis and short term, long term fix details • Updating wiki page for each pipeline enhancement or change. • Assisting partner teams on information related to data issues so as to arrive at issue resolution • Send regular updates on status of open issues...

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

Job description Job Summary: We are seeking a talented Data Engineer with strong expertise inAzure , Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. Youll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity Catalog. Key Responsibilities: Design and implement ETL/ELT pipelines using Databricks and PySpark. Work with Unity Catalog to manage data governance, access controls, lineage, and auditing across data assets. Develop high-performance SQL queries and optimize Spark jobs. Collaborate with data scientists, analysts, and business stakeholders to understand data needs. Ensure data qualit...

Role Overview: On Team Xbox, you will be part of the Xbox Platform Data Intelligence Team, aiming to empower the world's 3 billion gamers by shaping the next generation of data and analytics capabilities for Xbox. Your role will involve working closely with engineering and product management to design, implement, and evolve innovative capabilities that will drive analytics and insights on engineering features. You will play a crucial part in influencing data-driven decision-making across Xbox Leadership, Finance, Business Planning, and Engineering teams. Key Responsibilities: - Work within and across teams to solve complex technical challenges. - Develop engineering best practices by continu...

We are looking for an experienced Data Engineer with strong hands-on expertise in PySpark , Azure Databricks , and Fabric development. The ideal candidate should have solid development experience (not support) in building and optimizing scalable data solutions within a fast-paced financial domain environment. Roles and Responsibilities Design, develop, and implement scalable data pipelines using PySpark , Azure Databricks , and Fabric . Work extensively on SQL for data transformations, optimization, and performance tuning. Collaborate with cross-functional teams to translate business requirements into efficient data engineering solutions. Ensure data quality, integrity, and compliance with o...

Job Title Databricks Engineer- CHRTN Job Description Design, build, and maintain scalable and efficient ETL/ELT pipelines in Azure Databricks to process structured, semi-structured, and unstructured insurance data from multiple internal and external sources. • Collaborate with data architects, modellers, analysts, and business stakeholders to gather data requirements and deliver fit-for-purpose data assets that support analytics, regulatory, and operational needs. • Develop, test, and optimize data transformation routines, batch and streaming solutions (leveraging tools such as Azure Data Factory, Data Lake Storage Gen2, Azure Event Hubs, and Kafka) to ensure timely and accurate data deliver...

Role & responsibilities - Design and implement robust data pipelines using Azure Data Factory, Azure Databricks, and Azure SQL Database. - Work with large datasets to ingest, process, and analyze data from various sources. - Utilize Azure services for data storage and processing, ensuring optimal performance and scalability. - Collaborate with data scientists and business analysts to understand data needs and deliver solutions that meet requirements. - Ensure data quality, security, and compliance by implementing best practices in data governance. - Troubleshoot and resolve data-related issues, providing support for end-users and stakeholders. - Stay up-to-date with the latest Azure technolo...

Azure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc implemented using Azure Data Bricks would be preferred. - Azure Databricks integration with other services - Read and write data in Azure Databricks - Best practices in Azure Databricks Synapse Analytics: - Import data into Azure Synapse Analytics with and without using PolyBase - Implement a Data Warehouse with Azure...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Data Services Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in pr...

Greetings from TCS !!! TCS presents an excellent opportunity for Pyspark Developers Experience (Yrs) : 6-12 years Location: Chennai/Bangalore Mode of interview : Virtual Key Responsibilities: Develop, optimize, and maintain big data pipelines using PySpark on distributed computing platforms. Design and implement ETL workflows for ingesting, processing, and transforming large datasets in Hive . Work with structured and unstructured data sources to ensure efficient data storage and retrieval. Optimize Hive queries and Spark jobs for performance, scalability, and cost efficiency. Implement best practices for data engineering, including data governance, security, and compliance. Monitor, trouble...

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

Azure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc implemented using Azure Data Bricks would be preferred. - Azure Databricks integration with other services - Read and write data in Azure Databricks - Best practices in Azure Databricks Synapse Analytics: - Import data into Azure Synapse Analytics with and without using PolyBase - Implement a Data Warehouse with Azure...

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skills.

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skills.

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

Azure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc implemented using Azure Data Bricks would be preferred. - Azure Databricks integration with other services - Read and write data in Azure Databricks - Best practices in Azure Databricks Synapse Analytics: - Import data into Azure Synapse Analytics with and without using PolyBase - Implement a Data Warehouse with Azure...