3649 Azure Databricks Jobs - Page 37

We are looking for a skilled and motivated Azure Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience in designing, building, and maintaining scalable data pipelines and storage solutions on Microsoft Azure . You will work closely with data analysts and business stakeholders to ensure reliable and efficient data workflows. Key Responsibilities: Design, implement, and maintain data pipelines for ingestion, processing, and transformation using Azure technologies. Collaborate with analysts and business teams to understand data requirements and build effective workflows. Develop and manage data storage solutions including Azure SQL Database , Azure D...

We are hiring Lead design,development & delivery of Azure-based data analytics solutions. Drive data modeling, warehousing, visualization(Power BI).Mentor teams, optimize ETL, ensure quality, and innovate using Python, ML, and big data technologies.

Job Responsibilities: 1. Understanding and Perform analysis off source systems data 2. Estimation and delivery of adhoc and new Tableau MIS 3. Design and develop advanced & visually compelling Tableau dashboards and visualizations tailored to business needs in the Lending domain - Deliver in data visualization best practices, Tableau BI functionalities, and data storytelling 4. Collaborate with business stakeholders to gather requirements and translate them into effective data visualizations. 5. Optimize Tableau workbooks for performance and scalability. 6. Integrate and process large datasets using Databricks (Spark-based platform) 25 % 7. Build and maintain data transformation notebooks in...

As a Software Engineer - Cloud Data Platform (Azure) at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics. You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team t...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Microsoft Azure Data Services Good to have skills : Python (Programming Language), Microsoft Azure Databricks, Microsoft Fabric Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform...

About The Role Project Role : Data Platform Architect Project Role Description : Architects the data platform blueprint and implements the design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Microsoft Azure Data Services Good to have skills : Python (Programming Language), Microsoft Azure Databricks, Microsoft Fabric Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Architect, you will be responsible for architecting the data platform blueprint and implementing...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating communication among stake...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Microsoft Azure Databricks Good to have skills : PySpark, Snowflake Data Warehouse, AWS Architecture Minimum 18 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect, you will define the data requirements and structure for the application. Your typical day will involve modeling and designing the application data structure, storage, and integration, ensuring that the architecture aligns with business ne...

About the job : Role : Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience : 8-15 years Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs - Help joiner team members to resolve issues and technical challenges. - Drive technical discu...

Role : Senior Databricks Engineer / Databricks Technical Lead/ Data Architect. Experience : 8-15 years. Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. - Ability to provide solutions that are forward-thinking in data engineering and analytics space. - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues. - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs. - Help joiner team members to resolve issues and technical challenges. - Drive technical discussion with...

About the job : Role : Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience : 8-15 years Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs - Help joiner team members to resolve issues and technical challenges. - Drive technical discu...

Experience : 8-15 years. Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. - Ability to provide solutions that are forward-thinking in data engineering and analytics space. - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues. - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs. - Help joiner team members to resolve issues and technical challenges. - Drive technical discussion with client architect and team members. - Orchestrate the data pipelines in schedul...

Education/Experience: Bachelor's degree in computer science or equivalent training required. Big Data Engineer: 4-6 Years Experience in developing Big Data processing applications on Azure Databricks. Profound experience with developing Big Data applications using Spark and Scala/Python. Good experience in working with Databricks components, Infrastructure as Code tools like Terraform. Good experience in Airflow and Kubernetes. Develop highly scalable and extensible Big Data platform which enables collection, storage, modelling, and analysis of massive data sets from numerous data sources. Should have very good knowledge on SQL Programming and ETL Data Warehousing concepts. Good understandin...

Azure Data Factory (ADF): Deep knowledge and experience in using ADF for data orchestration and transformation. SQL: Advanced proficiency in SQL for database management and data manipulation. Programming Languages: Experience with programming languages like Python, Scala, or PowerShell for data engineering tasks and automation. Cloud Services: Strong understanding of the Microsoft Azure cloud platform, including data storage, database, and analytics services. Cloud Integration: Working with other Azure services such as Azure Data Lake Storage, Azure SQL Database, Azure Synapse Analytics, and Azure Databricks. Data Warehousing/Modeling: Familiarity with data warehousing concepts and data mode...

Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs - Help joiner team members to resolve issues and technical challenges. - Drive technical discussion with client architect and team members - Orchestrate the data pipelines in scheduler via Airflow Skills And Qual...

Role & responsibilities Mandate skills - Pyspark + Azure DataBricks + Azure Data Factory Experience- 8+ years We are looking for an experienced and hands-on Data Engineering Lead to guide and mentor a team of data engineers in delivering scalable and reliable data solutions. This role demands strong technical expertise in Azure Databricks, Azure Data Factory, and PySpark, along with proven experience in leading data projects, managing stakeholders, and driving data platform best practices. As a Data Lead, you will play a critical role in architecting and executing the organizations data strategy while fostering a high-performance team culture. Key Responsibilities: Lead the design and implem...

Notice Period-Immediate Joiner or Max 10 days (Do not share long notice period profile.) Permanent Payroll - Anlage Infotech Client - Orion Innovation Location- Kochi, Chennai, Coimbatore, Pune - HYBRID (2/3 days in a week) Role & responsibilities Work Location: Kochi, Chennai, Coimbatore, Pune Hybrid Mode Mandate skills - Pyspark + Azure DataBricks + Azure Data Factory + MS Fabric Experience- 5+ years We are seeking a skilled and experienced Senior Data Engineer with a strong background in Azure Data Services, particularly Azure Databricks, Azure Data Factory, PySpark and MS Fabric. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and...

As a Data Engineer, you will be responsible for designing and implementing data pipelines using Azure Fabric, Azure Data Factory, Azure Databricks, and Synapse Analytics. Your primary focus will be on developing robust and scalable pipelines to ensure efficient data processing. Key Responsibilities: - Implement data solutions using the Medallion Architecture (Bronze, Silver, Gold data layers) to maintain data quality and consistency. - Design and execute data ingestion processes for structured and unstructured data from diverse sources into Azure Data Lake. - Utilize Azure services such as Azure Data Lake, Azure Data Factory, Azure Databricks, and Synapse Analytics for data processing. - App...

As a Data Engineer with over 5 years of experience in data analysis, engineering, and science, your role will involve the following key responsibilities: - Proficiency in Azure Data Factory, Azure DataBricks, Python, PySpark, SQL, and PLSQL or SAS. - Designing, developing, and maintaining ETL pipelines using Azure Data Bricks, Azure Data Factory, and other relevant technologies. - Managing and optimizing data storage solutions using Azure Data Lake Storage (ADLS). - Developing and deploying data processing workflows using Pyspark and Python. - Collaborating with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality. - Implementing data inte...

As an Azure Databricks Specialist at Cygnus Professionals Inc., a global IT company specializing in Business-IT Transformations, you will be responsible for handling projects related to Azure Databricks. Your role will involve working on data processing, analytics, and machine learning tasks. Additionally, you will collaborate with cross-functional teams to efficiently deliver solutions. Key Responsibilities: - Working on data processing, analytics, and machine learning tasks - Collaborating with cross-functional teams to efficiently deliver solutions Qualifications Required: - Proficiency in data processing, analytics, and machine learning - Experience working with Azure Databricks, Pyspark...

Role Overview: As a member of Periscope's technology team based in either Bengaluru or Gurugram, you will play a crucial role in developing and deploying core enterprise products, ensuring that McKinsey's technology remains at the forefront of innovation. Your responsibilities will include building and enhancing deployment scripts and toolsets for cloud-based solutions on AWS and Azure platforms, with a focus on database management, Kubernetes cluster setup and monitoring, performance tuning, and continuous delivery. Key Responsibilities: - Spend approximately 80% of your time on software development projects, actively engaging in hands-on tasks. - Explore new open-source libraries, adopt un...

As a Data Engineer, your primary responsibility will be to design and build production data pipelines within a hybrid big data architecture. You will use languages such as Scala, Python, and Talend to create efficient pipelines from data ingestion to consumption. Additionally, you will contribute to the entire data life-cycle, focusing on coding, debugging, and testing processes. Troubleshooting and optimizing ETL pipelines will also be a key aspect of your role, along with thorough documentation of each process. - Design and build production data pipelines using Scala, Python, and Talend within a hybrid big data architecture. - Gather and address technical and design requirements. - Refacto...

Coforge is hiring for competent Azure Data Engineer with below details. If interested , please share profile at surabhi.seth@coforge.com Job Title: Azure Data Engineer Experience Required: 6-9.5 years Location : Greater Noida Notice Period : Immediate to 15 Days only Job Summary: We are seeking an experienced Azure Data Engineer to design, implement, and manage data solutions on the Microsoft Azure platform. The ideal candidate will have extensive experience with Azure Databricks, Pyspark, SQL and Data Lake. Key Responsibilities: Develop and maintain robust data pipelines using Azure Data Factory for ETL/ELT processes. Perform data transformation and analytics using Azure Databricks and Spar...

As a Data Engineer with Azure Databricks in Gurgaon, you will be responsible for the following: - Hands-on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions. - In-depth knowledge of relational database design, data warehousing, and dimensional data modeling concepts. - Working experience with Python, Spark, and Pyspark. You are required to have a minimum of 3 to 14 years of experience in the field.,