2404 Azure Databricks Jobs - Page 9

As an Azure Data Engineer, you will play a crucial role in optimizing and redesigning data pipelines to support the modernization of the data platform. Your responsibilities will include: - Designing and building scalable and reliable data pipelines using the latest tech stack. - Facilitating real-life actionable use cases by leveraging data with a user- and product-oriented mindset. - Assisting teams without data engineers in building decentralized data solutions and product integrations. - Conceptualizing, designing, and implementing improvements to ETL processes and data through independent communication with data-savvy stakeholders. - Designing, building, and operating a Data Lake or Dat...

Role Overview: As an Azure Data Engineer, you will be responsible for leveraging your proven experience in data engineering with a focus on Azure cloud technologies. Your primary focus will be on utilizing Azure SQL Database, Azure Data Lake, Azure Data Factory, and Azure Databricks to create and manage data pipelines for data transformation and integration. Your proficiency in programming languages such as Python will be essential for this role. Key Responsibilities: - Utilize Azure Data Factory to create efficient data pipelines for seamless data transformation and integration processes. - Demonstrate strong hands-on knowledge of Azure cloud services related to data and analytics, includin...

As a Lead Data Engineer - Azure and Microsoft Fabric at Srijan Technologies PVT LTD, your role involves: Role Overview: You will be responsible for designing and developing data pipelines within Microsoft Fabric, optimizing and monitoring these pipelines, collaborating with cross-functional teams, sharing knowledge through documentation, and leveraging your expertise in the Microsoft Fabric platform to build scalable solutions integrated with Business Intelligence layers. Key Responsibilities: - Design and Develop Data Pipelines: Develop scalable data pipelines within Microsoft Fabric, utilizing fabric-based notebooks, Dataflows Gen2, Data Pipelines, and Lakehouse architecture. Build robust ...

Job Role Key Tasks & Responsibilities Development of highly performant public facing REST API's and associated system integrations in an Azure hosted environment. Documentation of API's conforming to the Open API 3.x framework. Participating in code reviews, design workshops, story/ticket elaboration, etc. Review existing legacy implementations and input from the architecture team, and aid in designing and building appropriate solutions on the new platform following best practices. Ensure that the new platform is developed, tested and hosted in the most secure, scalable manner. Aid in the automation of testing and deployments of all deliverables. Required Skills C#, Microsoft SQL Server or A...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : Microsoft Azure Data Services, PySpark Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating ...

Key Skills & Competencies Advanced SQL development (joins, CTEs, window functions, optimization) Experience with ETL/ELT processes and tools Data modeling (dimensional and normalized Familiarity with version control (e.g., Git) and CI/CD practices Understanding of DWH architectures and data integration patterns Ability to work with large datasets and performance-tune queries Platform-agnostic mindset with readiness to adapt to Azure or AWS

Role & responsibilities Position : ETL Production Support Exp: 6 Yrs, Relevant :4 +yrs QUALIFICATIONS, EXPERIENCE, SKILLS Level of educational attainment required: Bachelors or Masters Computer Science or Any Engineering Professional qualifications and accreditations/memberships required: Expert Knowledge on MS Tech-Stack ADB, ADF, ADO Working knowledge on ETL or Middleware tools Talend or Informatica Certification on any ETL tools is preferred Additional knowledge on SQL, database management is good to have Excellent Communication and Problem-Solving skills Expert knowledge in ADB & ADF Strong knowledge on debugging skills Admin. knowledge on tools strongly preferred Ability to understand a...

Experience: 6-12 yrs Work location : Bangalore Work Mode : 5 DAYS WFO Shift timings : 12:30pm - 9:30pm Primary skills : Azure DATABRICKS, ADF , Pyspark, SQL , Secondary skills : Azure synapse Face to Face - 20th Sep, 25 - Bangalore Location

Work Flexibility: Hybrid What You Will Do: Design, build, and maintain end-to-end MLOps pipelines for ML model training, testing, and deployment. Collaborate with Data Scientists to productionize ML models in Azure ML and Azure Databricks. Implement CI/CD pipelines for ML workflows using Azure DevOps, GitHub Actions, or Jenkins. Automate infrastructure provisioning using IaC tools (Terraform, ARM templates, or Bicep). Monitor and manage deployed models using Azure Monitor, Application Insights, and MLflow. Implement best practices in model versioning, model registry, experiment tracking, and artifact management. Ensure security, compliance, and cost optimization of ML solutions deployed on A...

Role & responsibilities This role is responsible for the design, development, and maintenance of data integration and reporting solutions. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles. The position requires leading a team and working with a large US client, building new Data engineering solutions ground up.

Job Summary As a Microsoft Fabric Data Engineer/Developer, you will play a vital role in designing, developing, and implementing robust and scalable data solutions within the Microsoft Fabric ecosystem. You will collaborate closely with data architects, business stakeholders, and cross-functional teams to transform raw data into actionable insights, driving informed decision-making across the organization. If you are passionate about data engineering, possess a strong technical background, and excel in collaborative environments, we invite you to join our growing data team. Career Level - IC2 Responsibilities Microsoft Fabric Development : Design, develop, and deploy end-to-end data solution...

Responsibilities: * 5+ Yrs of exp in Design, develop, test & maintain ADF solutions using Azure Data Factory, Azure Databricks & SQL Azure. * Collaborate with cross-functional teams on project delivery * Can Join in 2 weeks in Bangalore Provident fund Health insurance

Role Overview: We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS . The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data. Required Skills and Experience: 8+ years of experience in data architecture or engineering roles, with at least 3+ years specializing in cloud-based big data solutions. Hands-on expertise with Databricks on Azure or AWS . Dee...

One Azure backend expert (Strong SC or Specialist Senior) Should have hands-on experience of working with ADLS, ADF and Azure SQL DW Should have minimum 3 Years working experience of delivering Azure projects. Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract, Transform, Load) processes. Knowledge of data modeling and data warehousing concepts. Implement best practices for data pipelines, i...

Power Bi and AAS expert (Strong SC or Specialist Senior) Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis Service Should be able to write and test Dex queries. Should be able generate Paginated Reports in Power BI Should have minimum 3 Years working experience in delivering projects in Power Bi Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract...

Job Summary We are seeking a skilled Azure Data Engineer with 4 years of overall experience , including at least 2 years of hands-on experience with Azure Databricks (Must) . The ideal candidate will have strong expertise in building and maintaining scalable data pipelines and working across cloud-based data platforms. Key Responsibilities Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse. Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS). Collaborate with data scientists, analysts, and engineering teams to design and deliver end-to-end data solutions. Develop...

Azure Data Engineer Data Engineers will be responsible for developing and maintaining the data pipelines that populate and process data within the existing Azure Data Lake They will need to ensure that data is properly ingested transformed and made accessible for analytics reporting and realtime insights Key Skills Azure Data Factory ADF Proficiency in building data pipelines using Azure Data Factory particularly for ETLELT processes from D365 FO and other systems to the data lake o Linked Services Connecting ADF with D365 FO other databases and external sources o Data Flows Implementing complex data transformations using ADFs data flow capabilities RealTime Data Integration Experience with ...

Greetings from Aspire Systems!!! Currently hiring for Data Engineer - ADF with Python and TSQL Exp: 7+ Years Location: Chennai/ Bangalore. Notice : Immediate to 30 days Immediate joiners pls Share CV to safoora.imthiyas@aspiresys.com Interview Mode: L1, L2 Virtual HR Interview In person - F2F Mandatory Job Summary: We are seeking a skilled and experienced Azure Data Engineer with 7+ years of hands-on experience in designing, developing, and maintaining scalable data solutions using Azure Data Factory, Azure Databricks, Azure SQL, and SQL-based databases. The ideal candidate will have a strong understanding of data integration, transformation, and analytics within the Azure ecosystem. Key Res...

Azure backend expert (ADLS, ADF and Azure SQL DW)4+Yrs/Immediate Joiners only One Azure backend expert (Strong SC or Specialist Senior) Should have hands-on experience of working with ADLS, ADF and Azure SQL DW Should have minimum 3 Years working experience of delivering Azure projects. Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract, Transform, Load) processes. Knowledge of data modeling...

Power Bi and AAS expert (Strong SC or Specialist Senior) Should have hands-on experience of Data Modelling in Azure SQL Data Warehouse and Azure Analysis Service Should be able to write and test Dex queries. Should be able generate Paginated Reports in Power BI Should have minimum 3 Years working experience in delivering projects in Power Bi Must Have:- 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data integration and transformation. Optimize and tune Databricks jobs for performance and scalability. Experience with Scala and/or Python programming languages. Proficiency in SQL for querying and managing data. Expertise in ETL (Extract...

Job Summary: This individual contributor is primarily responsible for assisting in the translation of business requirements and functional specifications into software solutions, assisting in the implementation and maintenance of business software solutions, and supporting systems integration testing and user acceptance testing. Essential Responsibilities: Completes work assignments by applying up-to-date knowledge in subject area to meet deadlines; following procedures and policies, and applying data and resources to support projects or initiatives; collaborating with others, often cross-functionally, to solve business problems; supporting the completion of priorities, deadlines, and expect...

Greetings from NAM Info!!! Key Responsibilities: Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Synapse, and Databricks. Develop and optimize large-scale data processing jobs using PySpark and Spark SQL on Azure Databricks. Please share your resume to payal.kumari@nam-it.com

Position: Sr. Data Engineer / Data Architect Your team You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics. You will be closely working directly with senior stakeholders of the clients designing and implementing data strategy in finance space which includes multiple use cases viz. controllership, FP&A and GPO. You will be responsible for developing technical solutions to deliver scalable analytical solutions leveraging cloud and big data technologies. You will also collaborate with Business Consultants and Product Owners to design and implement technical solutions. Communication and organisation sk...

As an App Automation Eng Specialist at Accenture, you will be responsible for designing and developing end-to-end RPA automation solutions using A360 tools & technologies. Your role will involve anticipating, identifying, tracking, and resolving technical issues and risks affecting delivery. It is essential for you to have a deep understanding of the Automation Anywhere RPA platform, its features, capabilities, and best practices. Your proficiency in designing and implementing automation workflows that optimize business processes will be crucial for success in this role. **Key Responsibilities:** - Lead the team to develop automation bots and processes using the A360 platform. - Utilize A360...

As a Data Modeler at our company, you will play a crucial role in designing conceptual, logical, and physical models for Azure Databricks and Azure Data Lake to support structured, semi-structured, and unstructured data. Your responsibilities will include: - Utilizing your 6+ years of experience in data modeling, with a preference for insurance industry datasets such as policies, claims, customer, or actuarial data. - Demonstrating advanced skills in data modeling tools like Erwin, ER/Studio, PowerDesigner, or Microsoft Visio, and version control using GitHub. - Applying deep understanding of relational, dimensional, and data lake modeling techniques optimized for Databricks/Spark-based proc...