3651 Azure Databricks Jobs - Page 43

We are looking for a skilled professional with 12-16 years of experience to join our team as an Azure Data Engineer in Bengaluru. The ideal candidate will have expertise in writing terraform code to deploy Azure Data Services on the Azure Platform. Roles and Responsibility Design, develop, and implement data pipelines using Azure Data Factory. Deploy and manage Azure DataLake and Azure Databricks services. Develop and maintain terraform templates and modules for data infrastructure. Collaborate with cross-functional teams to ensure seamless integration of data systems. Troubleshoot and resolve issues related to data quality and performance. Ensure compliance with security and governance stan...

Experience:8+ Years Skill:Snowflake Notice Period:Immediate Employment Type: Contract Work Mode: WFO/Hybrid Job Description : Snowflake Data Warehouse Lead (India - Lead 8 to 10 yrs exp): Lead the technical design and architecture of Snowflake platforms ensuring alignment with customer requirements, industry best practices, and project objectives. Conduct code reviews, ensure adherence to coding standards and best practices, and drive continuous improvement in code quality and performance Provide technical support, troubleshooting problems, and providing timely resolution for Incidents, Services Requests and Minor Enhancements as required for Snowflake platforms and its related services. Dat...

Job Details: Skills:Solution Analyst- MLOPS Experience: 6+ Years Location:PAN INDIA Job type: Contract to Hire Work Model: Hybrid Job Description:- Mandatory skill : MLOps with Azure Databricks Devops A person who has exposure to Models/MLOps eco-system having exposure to Model Life Cycle Management, with primary responsibility being ability to engage with stakeholders around requirements elaboration, having them broken into stories for the pods by engaging with architects/leads for designs, participation in UAT and creation of user scenario testings, creation of product documentation describing features, capabilities etc. we basically not looking for a Project Manager who will track things.

Experience: 5+ Years Skill: ITSS- Senior Azure Developer / Data Engineer Notice Period:Immediate. Employment Type: Contract Working Mode: Hybrid Job Description Loc - Bangalore , Hyd, Chennai and Noida Experience: Mid-Level Primary Skillsets: Azure (ADF/ADLS/Key vaults) Secondary Skillsets: Databricks Good to have Skillsets: Ability to communicate well Experience in cloud applications, especially in Azure (basically things covered in Primary skillsets listed below) Work in agile framework Experience in ETL, SQL, PySpark Run with a task without waiting for direction all the time Experience with git repository and release pipelines. Any certifications on Azure Any certification on Databricks w...

Notice Period: Immediate Joiners Job Description: Must have skills Azure DataBricks, Python And Pyspark, Spark. Please find the JD In the mail chain Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on experience in Azure Databricks , Data Factory, Data Lake store/Blob storage, SQL DB Experience in creating Big data Pipelines with Azure components Hands on programing with Python Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming Experience with messaging systems, such as Kafka or RabbitMQ Good understanding of...

6+ years of experience in Data engineering projects using COSMOS DB- Azure Databricks (Min 3-5 projects) Strong expertise in building data engineering solutions using Azure Databricks, Cosmos DB Strong T-SQL programming skills or with any other flavor of SQL Experience working with high volume data, large objects, complex data transformations Experience working in DevOps environments integrated with GIT for version control and CI/CD pipeline. Good understanding of data modelling for data warehouse and data marts Strong verbal and written communication skills Ability to learn, contribute and grow in a fast phased environment Nice to have: Expertise in Microsoft Azure is mandatory including co...

***We are hiring for Azure Databricks Cognizant technology solution*** Skill - Azure Databricks Experience- 7- 12 Years Location- India Interview mode - Video discussion followed by F2F Job Description: Minimum 7+ years of experience in Databricks would be preferable. Must have hands on Databricks experience on design, and development of the batch and real-time extraction, load, transform (ELT) processes, and the setup of the data integration framework, while promoting adherence to best practices during the integration development. Good experience in Azure Databricks, data factory, ADLS. Working Knowledge in Azure DevOps will be plus. Disclaimer: Please ignore this message if you are directl...

We are looking for a skilled Data Engineer with 5-9 years of experience to join our team in Kolkata, Vizag, and Bhubaneswar. The ideal candidate will have expertise in Databricks, Azure Data Factory, and Python. Roles and Responsibility Design and develop data pipelines using Databricks and Azure Data Factory. Implement structured and unstructured data solutions. Develop data migration strategies and data warehousing solutions. Process and analyze large datasets using Hadoop, Java, Spark, Scala, and Hive. Work with NoSQL data stores and ensure data quality and integrity. Collaborate with cross-functional teams to identify and prioritize project requirements. Job Requirements Strong skills in...

We are looking for a skilled Azure Big Data Engineer with expertise in PySpark to join our team in Chennai, Bangalore, Pune, Mumbai, Noida, and Hyderabad. The ideal candidate will have 6-10 years of experience in data engineering and cloud technologies. Roles and Responsibility Design and develop scalable big data solutions using Azure, Spark, and PySpark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Optimize data processing workflows for performance and efficiency. Ensure data quality and integrity through robust testing and validation procedures. Participate in code reviews and co...

What success looks like in this role: Good knowledge and skill set on Azure CloudOps and Azure Infra. Design, develop, and maintain infrastructure as code (IaC) using tools such as Terraform, Bicep, or ARM templates. Design, implement, and manage CI/CD pipelines using Azure DevOps. Collaborate with development, operations, and security teams to define and implement infrastructure requirements. Automate the provisioning and management of cloud resources across multiple environments. Ensure security and compliance best practices are followed in the DevOps processes. Troubleshoot and resolve issues related to build, deployment, and infrastructure. Continuously improve and document DevOps proces...

As an experienced and motivated BI Team Lead with 6-8 years of experience in business intelligence tools such as Power BI, Tableau, and Azure Databricks, your role will involve leading and mentoring a team of BI developers and analysts to deliver high-quality dashboards, reports, and analytics solutions. Your responsibilities will include overseeing daily operations of BI production support, collaborating with cross-functional teams to deliver solutions aligned with business goals, managing and optimizing reporting solutions, and handling incident, change, and problem management in alignment with ITIL best practices. Key Responsibilities: - Lead and mentor a team of BI developers and analyst...

Job Description: As a Data Engineer at CDM Smith, you will be part of the Data Technology group within the Digital Engineering Solutions team. You will play a key role in driving strategic Architecture, Engineering, and Construction (AEC) initiatives by leveraging cutting-edge data technologies and analytics to deliver actionable business insights and robust solutions for AEC professionals and client outcomes. Your responsibilities will include assisting in the design, development, and maintenance of scalable data pipelines, automating workflows for efficiency, testing data quality and integrity, monitoring and troubleshooting data pipeline performance, collaborating with stakeholders to del...

You will be responsible for implementing architecture and design from the definition phase to the go-live phase by working with business analysts and subject matter experts to understand current priorities. You will define conceptual and low-level models using AI technology and review designs to ensure alignment with architecture. Additionally, you will be involved in hands-on development of AI-led solutions. Key Responsibilities: - Implement the entire data pipeline including data crawling, ETL, creating Fact Tables, and data quality management - Integrate with multiple systems using API, Web Services, or data exchange mechanisms - Build interfaces to gather data from various sources such a...

Role Overview: As a Senior Azure Data Engineer, you will utilize Azure technologies to facilitate data transformation, analytics, and machine learning. Your primary responsibility will involve designing scalable Databricks data pipelines using PySpark to convert raw data into actionable insights. Additionally, you will be tasked with constructing, deploying, and managing machine learning models using MLlib or TensorFlow, all while optimizing cloud data integration from various Azure sources such as Blob Storage, Data Lake, and SQL/NoSQL databases. Your role will also encompass executing large-scale data processing using Spark Pools and fine-tuning configurations for efficiency. Key Responsib...

Role Overview: As an Azure Data Architect at Hitachi Solutions, you will be responsible for designing and implementing end-to-end data solutions on Microsoft Azure. Your role will involve developing scalable and efficient data architectures to support large-scale data processing and analytics workloads. You will work closely with business and technical teams to understand data needs and translate them into robust data architecture solutions. Additionally, you will optimize cloud-based data infrastructure for performance, cost-effectiveness, and scalability. Key Responsibilities: - Design and implement end-to-end data solutions on Microsoft Azure, including data lakes, data warehouses, and ET...

Role & responsibilities 4-8 Years Experience in developing Big Data processing applications on Azure Databricks. 2. Profound experience with developing Big Data applications using Spark and Scala/Python. 3. Good experience in working with Databricks components, Infrastructure as Code tools like Terraform. 4. Good experience in Airflow and Kubernetes. 5. Develop highly scalable and extensible Big Data platform which enables collection, storage, modelling, and analysis of massive data sets from numerous data sources. 6. Should have very good knowledge on SQL Programming and ETL Data Warehousing concepts. 7. Good understanding of CI/CD process, Git, Jenkins." Preferred candidate profile

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Responsibilities: Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes. Create the data integration and data diagram documentation. Lead the data validation, UAT and regression test for new data asset creation. Create and maintain data models, including schema design and optimization. Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency. Qualifications and Skills: Strong knowledge on Python and Pyspark Expectation is to...

Responsibilities: Design, develop & optimize data pipelines using Azure Data Factory, Databricks & Synapse. Collaborate with cross-functional teams on project delivery within Azure DevOps. UK Shift

We are looking for a skilled Sr. Data Engineer with 12 to 17 years of experience to join our team in Bangalore, Hyderabad, Chennai, and Pune. Roles and Responsibility Design and develop scalable data pipelines using Public Cloud and Azure cloud technologies. Implement Snowflake ELT methodologies, including Snowpark, streams, and tasks. Develop and maintain ETL processes on Azure, ensuring data quality and integrity. Collaborate with cross-functional teams to design and implement data management solutions. Automate data processing tasks using Python, Scala, or other programming languages. Ensure compliance with industry standards and best practices for data engineering. Job Requirements Stron...

We are looking for a skilled Fullstack DevOps professional with 10-15 years of experience to join our team in Hyderabad. The ideal candidate will have expertise in Microsoft WPF/WCF frameworks and experience with Mongo DB. Roles and Responsibility Design, develop, and deploy scalable and efficient full-stack applications using Microsoft WPF/WCF frameworks. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain high-quality code that meets industry standards and best practices. Troubleshoot and resolve technical issues efficiently. Participate in code reviews and contribute to the improvement of the overall codebase quality. Stay updated ...

We are looking for a skilled Azure Synapse Analyst with 10-15 years of experience to join our team in [location to be specified]. The ideal candidate will have a strong background in Azure Synapse and excellent analytical skills. Roles and Responsibility Design, develop, and implement Azure Synapse solutions to meet business requirements. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain complex data models and ETL processes using Azure Synapse. Troubleshoot and resolve technical issues related to Azure Synapse. Provide expert-level support for Azure Synapse-related projects. Stay up-to-date with the latest trends and technologies i...

We are looking for a skilled Azure Data Engineer with 7 to 10 years of experience. The ideal candidate will have expertise in Azure Data Analytics, Synapse, DevOps, and programming languages such as Python, SQL, Py-Spark, Spark-SQL, Azure: ADLS, Synapse, Stream Analytics, SQL DW, Analysis Services, Serverless Architecture, ARM Templates. Roles and Responsibility Design and develop scalable data pipelines using Azure Data Analytics and Synapse. Collaborate with cross-functional teams to implement DevOps practices and ensure smooth deployment of data engineering solutions. Develop and maintain large-scale data architectures using Azure services such as ADLS, Synapse, Stream Analytics, SQL DW, ...

We are looking for a skilled Data Engineer with expertise in Python/Pyspark to join our team at Krazy Mantra HR Solutions Pvt. Ltd, located in Bangalore. The ideal candidate will have 8+ years of experience in a Data Engineer role and be available to join immediately. Roles and Responsibility Design and develop data pipelines using Azure Data Factory, Stream Analytics, and Databricks. Collaborate with cross-functional teams to integrate data from various sources into a unified platform. Develop and maintain large-scale data warehouses using Azure Data Lake Storage and NoSQL databases. Implement serverless architecture using Azure Functions and ARM Templates. Optimize data processing workflow...

We are looking for a skilled professional with 3-5 years of experience to join our team in the GRC Process domain. The ideal candidate will have a strong background in Azure Databricks, Tableau Desktop and or Server, Power BI, SQL, PANDAS, Python, databases like Oracle, Snowflake, Redshift, CosmosDB, and SQLServer. Roles and Responsibility Collaborate with cross-functional teams to design and implement GRC solutions. Develop and maintain data models using Azure Databricks and other tools. Analyze and visualize data using Tableau Desktop and or Server and Power BI. Design and implement database architectures using Oracle, Snowflake, Redshift, and CosmosDB. Ensure compliance with industry stan...

We are looking for a skilled professional with 5-10 years of experience to join our team as a Databricks expert in Pune, Chennai, Coimbatore, and Bangalore. Roles and Responsibility Design and develop data pipelines using Azure Data Bricks and Azure Data Factory. Collaborate with cross-functional teams to integrate data from various sources into a unified data warehouse. Develop and maintain ETL processes using PySpark and SQL. Implement data modeling principles to optimize data storage and retrieval. Troubleshoot and resolve issues related to data quality and performance. Ensure compliance with industry standards and best practices for data management. Job Requirements Strong experience in ...