2404 Azure Databricks Jobs - Page 10

As a Lead Data Engineer at Srijan Technologies PVT LTD, you will play a crucial role in designing and developing scalable data pipelines within Microsoft Fabric. Your responsibilities will include: - Designing and Developing Data Pipelines: Develop and optimize scalable data pipelines within Microsoft Fabric using fabric-based notebooks, Dataflows Gen2, Data Pipelines, and Lakehouse architecture. Build robust pipelines for batch and real-time processing. Integrate with Azure Data Factory or Fabric-native orchestration for seamless data movement. - Microsoft Fabric Architecture: Implement scalable, governed data architectures within OneLake and Microsoft Fabric's unified compute and storage p...

We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem . The ideal candidate will have a strong foundation in data integration, transformation, and migration , along with a passion for working on complex data migration projects . Job Title: Azure Data Engineer Location: Remote Work Timings: 5:00 PM 2:00 AM IST No of Openings: 3 Please Note: This is a pure Azure-specific role . If your expertise is primarily in AWS or GCP , we kindly request that you do not apply . Roles and responsibilities: Lead the migration of large-scale SQL workloads from on-premise environments to Azure, ensuring high data integrit...

We are looking for a skilled and experienced Data Engineer with hands-on expertise in Azure Data Services to join our growing team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and enterprise-grade data solutions using modern Azure tools and technologies. Azure Data Engineer Job Title : Azure Data Engineer Location : Pune Experience : 8+ years Key Responsibilities: Design, develop, and maintain scalable data pipelines using Azure Data Factory , Azure Synapse Analytics , Databricks , and Azure Data Lake Storage (ADLS) . Implement data ingestion, transformation, and integration processes from various sources (on-premises/cloud). Cre...

You will be responsible for designing and building ETL pipelines in Azure Databricks (PySpark, Delta Lake) to load, clean, and deliver data across Bronze, Silver, and Gold layers. Your role will also involve implementing Data Lakehouse Architecture on Azure Data Lake Gen2 with partitioning, schema management, and performance optimization. Additionally, you will need to develop data models (dimensional/star schema) for reporting in Synapse and Power BI. Integration of Databricks with Azure services like ADF, Key Vault, Event Hub, Synapse Analytics, Purview, and Logic Apps will be a part of your tasks. Building and managing CI/CD pipelines in Azure DevOps (YAML, Git repos, pipelines) will also...

Role Overview: As a Revenue Automation Senior Associate at PricewaterhouseCoopers Acceleration Centre (Kolkata) Private Limited, your main responsibility will be to perform revenue system implementation and data conversion for the revenue automation consulting area. You will play a critical role in supporting clients by ensuring compliance with accounting standards, implementing revenue recognition systems and data conversion, optimizing revenue recognition processes, and driving cross-functional collaboration to achieve business objectives. You will work as part of a team of problem solvers to help clients solve their complex business issues from strategy to execution. You will report to an...

As an MLOps Engineer, you will play a crucial role in designing, building, and maintaining end-to-end MLOps pipelines for ML model training, testing, and deployment. Your responsibilities will include collaborating with Data Scientists to productionize ML models in Azure ML and Azure Databricks. Additionally, you will implement CI/CD pipelines for ML workflows using Azure DevOps, GitHub Actions, or Jenkins and automate infrastructure provisioning using IaC tools such as Terraform, ARM templates, or Bicep. Monitoring and managing deployed models using Azure Monitor, Application Insights, and MLflow will also be part of your daily tasks. Implementing best practices in model versioning, model r...

Job Application Link: https://app.fabrichq.ai/jobs/e1003d62-f76d-4ee1-b787-da40ce6f717f Job Summary: You will act as a key member of the Data consulting team, working directly with partners and senior stakeholders. You will design and implement big data and analytics solutions. Communication and organisational skills are key for this position. Key Responsibilities Develop data solutions within a Big Data Azure and/or other cloud environments Working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams Build and design Data Architectures using Azure Data factory, Databricks, Data lake, Synapse Liaising with CTO, Product Owners and other Operations t...

Responsibilities: Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Synapse, and Databricks. • Develop and optimize large-scale data processing jobs using PySpark and Spark SQL on Azure Databricks or Synapse Spark pools. • Manage and work with large datasets stored in data lakes (ADLS Gen2) and integrate with enterprise data warehouses (e.g., SQL Server, Synapse). • Implement robust data transformation, cleansing, and aggregation logic to support analytics and reporting use cases. • Collaborate with BI developers, analysts, and data scientists to provision clean, reliable, and timely datasets. • Optimize data flows for performance and cost effic...

Overview of 66degrees 66degrees is a leading consulting and professional services company specializing in developing AI-focused, data-led solutions leveraging the latest advancements in cloud technology. With our unmatched engineering capabilities and vast industry experience, we help the world's leading brands transform their business challenges into opportunities and shape the future of work. At 66degrees, we believe in embracing the challenge and winning together. These values not only guide us in achieving our goals as a company but also for our people. We are dedicated to creating a significant impact for our employees by fostering a culture that sparks innovation and supports professio...

Position Overview: The Microsoft Cloud Data Engineer role is ideal for a highly capable and motivated Microsoft Cloud Data Engineer to design, build, and maintain cloud-based data solutions using Microsoft Azure technologies. This role is key for developing robust, scalable, and secure data pipelines and supporting analytics workloads that power business insights and data-driven decision-making. Key Responsibilities: Design and implement ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure Data Lake Storage. Develop and manage data integration workflows to ingest data from multiple sources including APIs, on-prem systems, and cloud services. Optimi...

About Client Hiring for One of the Most Prestigious Multinational Corporations Job Title : Azure Databricks Qualification : Any Graduate or Above Experience : 6 to 16 Yrs Location : pan india Skill required - Azure Databricks, Azure Data Factory, Azure SQL with Data Bricks Professional certificate must. Key Responsibilities: Design and build scalable and robust data pipelines using Azure Databricks, PySpark, and Spark SQL. Integrate data from various structured and unstructured data sources using Azure Data Factory,ADLS, Azure Synapse, etc. Develop and maintain ETL/ELT processes for ingestion, transformation, and storage of data. Collaborate with data scientists, analysts, and other engineer...

Experience on CICD - Azure DevOps & GitLab Exp in Azure Cloud Platform foundational resources ( AKS, Azure Databases, Virtual Networks, Function App, Webapp, etc ) Experience in implementing Azure Data lake with Azure Data Factory, Azure Databricks (Python Spark), ADLS, Azure SQL Database Sound Knowledge on Azure Data Lake Storage, Storage Accounts & File Shares Experience on Azure PowerShell , Azure CLI commands and knowledge of ARM templates to create resources Configured, deployed and managed centrally provided common cloud services e.g., Virtual machine, Azure Data Lake-Services, Azure Data Factory, SQL, Azure Key Vaults. Worked on synchronizing version updates between Gitlab and Azure D...

Role: Data Scientist Artificial Intelligence Location: Bengaluru, Chennai, Hyderabad, Pune & Noida Type: Full-Time Relevant Experience: 7+ Years Job Description We’re hiring an experienced Data Scientist – AI to design, develop, and deploy advanced ML solutions and production-ready AI systems on cloud platforms. Key Responsibilities Build, train & optimize ML/statistical models Perform Exploratory Data Analysis (EDA) for actionable insights Develop end-to-end AI pipelines (data prep deployment monitoring) Deploy and scale solutions on Azure / other cloud frameworks Collaborate in Agile/DevOps teams to deliver enterprise AI projects Drive best practices in data governance & value realization ...

Greetings from Aspire Systems!!! Currently hiring for Data Engineer - ADF with Python and TSQL Exp: 6+ Years Location: Chennai/ Bangalore. Notice : Immediate to 30 days Immediate joiners pls Share CV to safoora.imthiyas@aspiresys.com Interview Mode: L1, L2 Virtual HR Interview In person - F2F Mandatory Job Summary: We are seeking a skilled and experienced Azure Data Engineer with 56 years of hands-on experience in designing, developing, and maintaining scalable data solutions using Azure Data Factory, Azure Databricks, Azure SQL, and SQL-based databases. The ideal candidate will have a strong understanding of data integration, transformation, and analytics within the Azure ecosystem. Key Res...

**Job Title: Data Architect** **Company: Happiest Minds** **Location: Bangalore **Experience Required: 10 - 13 years** --- **About Happiest Minds:** Happiest Minds is a leading digital transformation and IT services company that helps businesses integrate technologies that drive growth and innovation. We specialize in providing services that span across cloud, data, enterprise IT, and digital solutions. Our goal is to simplify and accelerate digital transformation for our customers. **Position Overview:** We are seeking a highly skilled and experienced Data Architect to join our dynamic team. The ideal candidate will have a strong background in data architecture, cloud computing, and emergin...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are...

About The Role Skill required: Data Management - Microsoft Azure Data Factory Designation: Data Eng, Mgmt & Governance Assoc Mgr Qualifications: BE/BTech Years of Experience: 10 to 14 years What would you do? Data & AIDemonstrate skills in building data orchestration and pipeline using Azure Data Engineering What are we looking for? Microsoft Azure Data Engineering Alteryx Ability to perform under pressure Problem-solving skills Prioritization of workload Strong analytical skills Ability to manage multiple stakeholders Roles and Responsibilities: In this role you are required to do analysis and solving of moderately complex problems Typically creates new solutions, leveraging and, where need...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Databricks Good to have skills : Microsoft Azure Analytics Services Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, an...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team through the development process. You w...

About The Role Project Role : Application Designer Project Role Description : Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. A typical day involves collaborating with cross-functional teams to gather insights, analyzing user needs, and translating them into fun...

**Job Title: Senior Data Engineer** **Company: Happiest Minds** **Location: Bangalore **Experience Required: 4 to 8 years** --- **About Happiest Minds:** Happiest Minds is a leading technology consulting and services company dedicated to helping businesses leverage technology to achieve their goals. We pride ourselves on fostering a culture of innovation, collaboration, and continuous learning. --- **Job Description:** We are seeking a highly skilled **Senior Data Engineer** to join our dynamic team. The ideal candidate will have a strong background in data engineering, particularly with Azure Databricks, and will be responsible for designing, building, and optimizing data pipelines and arch...

Department : Platform Engineering Summary : We are seeking a highly skilled Data Engineer with expertise in ontology development and knowledge graph implementation. This role will be pivotal in shaping our data infrastructure and ensuring the accurate representation and integration of complex data sets. You will leverage industry best practices, including the Basic Formal Ontology (BFO) and Common Core Ontologies (CCO), to design, develop, and maintain ontologies, semantic and syntactic data models, and knowledge graphs on the Databricks Data Intelligence Platform that drive data-driven decision-making and innovation within the company. Responsibilities : Ontology Development : - Design and ...

Experience : 6+ years as Azure Data Engineer including at least 1 E2E Implementation in Microsoft Fabric. Responsibilities : - Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses. - Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions. - Ensure data integrity, quality, and governance throughout Microsoft Fabric environment. - Collaborate with stakeholders to translate business needs into actionable data solutions. - Troubleshoot and optimize existing Fabric implementations for enhanced performance. Skills : - Solid foundational knowledge in data warehousing, ETL/ELT processes...

We at Blackstraw.ai. are organizing a Walk-in Interview Drive for Data Scientist with minimum 4 years exp in Data Engineer Mini 4 Years Exp in PySpark, Spark, Machine Learning, Azure Data Bricks Python Mini 4 Years Strong experience in Python, Flask, RestAPI, Fast API, Job Requirements Minimum of 5+ years working experience with Spark, Hadoop eco systems. Minimum of 4+ years working experience on designing data streaming pipelines. Should have experience in Data Ingestion and Integration into data lake using hadoop ecosystem tools such as Sqoop, Spark, SQL, Hive, Airflow, etc.. Should have experience optimizing (Performance tuning) data pipelines. Create and maintain a scalable infrastructur...

The Solution Architect Data Engineer will design, implement, and manage data solutions for the insurance business, leveraging expertise in Cognos, DB2, Azure Databricks, ETL processes, and SQL. The role involves working with cross-functional teams to design scalable data architectures and enable advanced analytics and reporting, supporting the company's finance, underwriting, claims, and customer service operations. Key Responsibilities: Data Architecture & Design: Design and implement robust, scalable data architectures and solutions in the insurance domain using Azure Databricks, DB2, and other data platforms. Data Integration & ETL Processes: Lead the development and optimization of ETL p...