2403 Azure Databricks Jobs - Page 3

10 to 12 + years of experience in data architecture, data engineering, or related roles. Strong expertise in streaming data technologies like Apache Kafka, Flink, Spark Streaming, or Kinesis. Strong experience in Architect, Design and Develop real-time data ingestion, transformation, and delivery pipelines for analytics, operational intelligence, and decision-making systems. Proficiency in programming languages such as Python, Java, Scala, or Go Hands-on experience with cloud platforms like Azure, Synapse, Fabric etc, or Google Cloud (Pub/Sub, Big query/ Spanner / Dataflow). AWS (Kinesis, Redshift /MSK), Experience with big data tools like Hadoop, Hive, and data warehouses such as Snowflake,...

As a Microsoft Fabric Developer at EY, you will play a pivotal role in designing, developing, and managing innovative business intelligence (BI) solutions with a strong emphasis on leveraging Microsoft Fabric. Your deep understanding of data warehousing, ETL processes, data modeling, and the Microsoft Fabric ecosystem will be crucial in translating business needs into technical specifications, creating effective BI solutions, and driving the utilization of information management systems. Key Responsibilities: - Design, develop, and deploy business intelligence solutions using Microsoft Fabric. - Translate business needs into technical specifications. - Design, build, and deploy BI solutions ...

Role Overview: You will have the opportunity to contribute technically to Risk Assurance client engagements and internal projects at EY. Your role will involve assisting fellow Seniors & Managers, identifying risks within engagements, and ensuring high-quality work. Additionally, you will be part of a cross-functional team responsible for the full software development life cycle, aiding in the growth of a new service offering. Key Responsibilities: - Design, architect, and develop solutions using Azure cloud to process and analyze data sets. - Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and Azure Data Lake Storage. - Design and build data...

As a highly skilled and strategic Data Architect with expertise in the Azure Data ecosystem, your role at Lexmark will involve defining and driving the overall Azure-based data architecture strategy aligned with enterprise goals. You will architect and implement scalable data pipelines, data lakes, and data warehouses using Azure Data Lake, ADF, and Azure SQL/Synapse. Providing technical leadership on Azure Databricks for large-scale data processing and advanced analytics use cases is crucial. Your day-to-day tasks will include integrating AI/ML models into data pipelines and supporting the end-to-end ML lifecycle including training, deployment, and monitoring. Collaboration with cross-funct...

As a Data Engineer, you will be responsible for designing and building efficient data pipelines using Azure Databricks (PySpark). You will implement business logic for data transformation and enrichment at scale, as well as manage and optimize Delta Lake storage solutions. Additionally, you will develop REST APIs using FastAPI to expose processed data and deploy them on Azure Functions for scalable and serverless data access. Key Responsibilities: - Design and build efficient data pipelines using Azure Databricks (PySpark) - Implement business logic for data transformation and enrichment at scale - Manage and optimize Delta Lake storage solutions - Develop REST APIs using FastAPI to expose p...

Responsibilities: Design, develop, and maintain Azure data solutions. Optimize performance and ensure data security. Collaborate with cross-functional teams on project delivery. Monitor and report on key metrics. Remote Job Full time Freelancing UK Shift

As an Azure PySpark Solution Architect, your role involves designing and implementing scalable data solutions on Microsoft Azure. Your expertise in Azure services, PySpark, and enterprise-grade solution architecture will be crucial in driving efficient data processing and analytics workflows. Key Responsibilities: - Design and implement end-to-end data solutions using Azure Data Services and PySpark. - Develop high-performance ETL pipelines leveraging Azure Databricks, Azure Data Factory, and Synapse Analytics. - Architect scalable, secure, and cost-efficient cloud solutions aligned with business goals. - Collaborate with data engineers, data scientists, and stakeholders to define technical ...

As an Azure Architect at Fractal, you will be part of a dynamic team in the Artificial Intelligence space dedicated to empowering human decision-making in the enterprise. You will contribute to the development and delivery of innovative solutions that assist Fortune 500 companies in making strategic and tactical decisions. Fractal is renowned for its cutting-edge products such as Qure.ai, Cuddle.ai, Theremin.ai, and Eugenie.ai, which leverage AI to drive business success. Your responsibilities will include: - Actively participating in client engagements - Developing end-to-end solutions for large projects - Utilizing Software Engineering principles to deliver scalable solutions To excel in t...

As a member of the Providence team, you will be part of a large not-for-profit healthcare system dedicated to providing high-quality and compassionate healthcare to all individuals. Our vision, "Health for a better world," emphasizes health as a fundamental human right. With a network of 51 hospitals, 1,000+ care clinics, senior services, supportive housing, and various health and educational services, we aim to offer affordable quality care and services to everyone. Joining our Technology Engineering and Ops (TEO) team, you will contribute to the foundational infrastructure that enables caregivers, patients, physicians, and community technology partners to fulfill our mission. Your role wil...

As a software engineer at PwC, you will play a crucial role in developing innovative software solutions to drive digital transformation and enhance business performance. Your responsibilities will include designing, coding, and testing cutting-edge applications that revolutionize industries and deliver exceptional user experiences. Key Responsibilities: - Lead in alignment with our values and brand. - Develop new ideas, solutions, and structures; drive thought leadership. - Solve problems creatively and encourage others to do the same. - Balance long-term and short-term perspectives, detail-oriented and big picture thinking. - Make strategic choices and drive change by addressing system-leve...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data Lake Storage. Collaborate with cross-functional teams to gather requirements for data processing needs and design solutions that meet business objectives. Develop complex SQL queries to optimize database performance and troubleshoot issues in SQL Azure databases. Implement big data analytics solutions using PySpark on Spark Cluster or SCALA clusters. Ensure high availability of cloud resources by monitoring usage patterns and implementing cost optimization strategies. Desired Candidate Profile 5-7 years of...

Azure Data Engineer Permanent Chennai / Bangalore / Pune / Hyderabad / Delhi NCR Exp Range: 6 to 9 years(Relevancy of min 5 years in Data engineering) Location( Current & Preferred): Chennai/ Bangalore / Hyderabad Level : SDE( Senior Data Engineer) EXPERTISE AND QUALIFICATIONS * 5+ years of overall technical experience, with a minimum of 2 years of hands-on experience with Microsoft Azure and Databricks. * Proven experience delivering at least one end-to-end Data Lakehouse solution on Azure Databricks using the MedallionArchitecture. * Strong working knowledge of the Databricks ecosystem, including: PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables, Workflows, and SQ...

Exp- 8-15 years 3+ years of hands on experience in Azure Data Engineering development project 2+ years of experience in Databricks development 2+ years of experience in PySpark. 2+ years of experience in SQL Proficient in SQL 2+ years of experience in leading at least a 5+ member team in data engineering delivery Must be fluent in communication Role & responsibilities Preferred candidate profile

Required Skills : Data Engineer, Azure, Azure Databricks, Azure Datafactory, Apache Spark, Data Modeling, Data Warehousing, BI tools, Git, Python, SQL

Role & responsibilities Job Title: On-Premise Data Engineer Job Summary: We are looking for a skilled On-Premise Data Engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining scalable data pipelines, data lakes, and databases on on-premise infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure efficient data processing and availability across the organization. Key Responsibilities: Data Infrastructure Design and Management: Design, build, and maintain on-premise data pipelines, ETL processes, and data integration frameworks. Set up and manage on-premise databases, data warehouses, and data la...

Hi all, We are hiring for the role Senior Azure Data Engineer and Analyst Experience: 8-10 Years Location: Bangalore Notice Period: Immediate - 15 Days Skills: Job Summary: Role: Senior Azure Data Engineer and Analyst Experience: 8-10 years (minimum 5+ years in data warehouse management) Must-Have Skills: Strong expertise in Azure Data Factory, SQL Server, and Power BI 1-2 years of experience in Azure Synapse Analytics or Azure Databricks Hands-on experience with PowerShell scripting and Power Automate Domain Expertise: Knowledge of Active Directory and Microsoft 365 Preferred Skills: Familiarity with PowerApps If you are interested drop your resume at mojesh.p@acesoftlabs.com Call: 97019717...

Data Engineer(Azure Databricks, Snowflake & Hadoop)_Contract Role Type - Contract Work Mode - WFO NP - 0 to 15days Location - Bangalore Data Engineer Key Responsibilities: We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. You will play a crucial role in our data ecosystem by working with cloud technologies to enable data accessibility, quality, and insights across the organization. This role requires expertise in Azure Databricks, Snowflake, and DBT. Requirements: • Bachelors in Computer Science, Data Engineering, or related field. • Proficiency in Azure Databricks for data processing and pipeline orchestration. • Experience wit...

Hi all, We are hiring for the role Azure Data Engineer Experience: 3 - 6 Years Location: Bangalore Notice Period: Immediate - 15 days Skills: Description: 1. Design, develop, and maintain data pipelines using Azure Data Factory 2. Create and manage data models in PostgreSQL , ensuring efficient data storage and retrieval. 3. Optimize query performance and database performance in PostgreSQL , including indexing, query tuning, and performance monitoring. 4. Strong knowledge on data modeling and mapping from various sources to data model. 5. Develop and maintain logging mechanisms in Azure Data Factory to monitor and troubleshoot data pipelines. 6. Strong knowledge on Key Vault, Azure Data lake...

Overall, 7 to 9 years of experience in cloud data and analytics platforms such as AWS, Azure, or GCP • Including 3+ years experience with Azure cloud Analytical tools is a must • Including 5+ years of experience working with data & analytics concepts such as SQL, ETL, ELT, reporting and report building, data visualization, data lineage, data importing & exporting, and data warehousing • Including 3+ years of experience working with general IT concepts such as integrations, encryption, authentication & authorization, batch processing, real-time processing, CI/CD, automation • Advanced knowledge of cloud technologies and services, specifically around Azure Data Analytics tools o Azure Function...

Hi all, We are hiring fore the Data Architecture Experience: 6 - 9 years Location: Bangalore Notice Period: Immediate - 15 Days Skills: Data Architecture Azure Data Factory Azure Data Bricks Azure Cloud Architecture If you are interested drop your resume at mojesh.p@acesoftlabs.com Call: 9701971793

Job Title: Data Engineer Experience Range: 6-9 years Location : Bengaluru Notice period : immediate - 15 days Job Summary: We are looking for a skilled Data Engineer to design, build, and maintain robust, scalable data pipelines and infrastructure. This role is essential in enabling data accessibility, quality, and insights across the organization. You will work with modern cloud and big data technologies such as Azure Databricks , Snowflake , and DBT , collaborating with cross-functional teams to power data-driven decision-making. Key Responsibilities: For External Candidates: Data Pipeline Development: Build and optimize data pipelines to ingest, transform, and load data from multiple sour...

Share resume to : sowmya.v@acesoftlabs.com Hiring Now: Azure Data Engineer (36 Years) – Immediate Opportunity! Location : Bangalore Experience : 3–6 Years Key Responsibilities: Design and build scalable data solutions using Azure Data Factory, Azure Databricks, and Azure Synapse . Develop ETL/ELT pipelines for structured and unstructured data from various sources and formats. Write efficient SQL queries, stored procedures, functions , and dynamic SQL for data transformation and analysis. Implement data lake architecture and optimize data ingestion using Apache Spark with Scala or Python . Handle and maintain Delta Tables within the Databricks environment. Collaborate with DevOps team to supp...

Minimum Requirements: 5+ years of experience overall in IT Current - 2+ years of experience on Azure Cloud as Data Engineer Current - 1.5+ years of hands-on experience on Databricks/Azure Databricks Proficient in Python/PySpark Proficient in SQL/TSQL Proficient in Data Warehousing Concepts (ETL/ELT, Data Vault Modelling, Dimensional Modelling, SCD, CDC) Primary Skills: Azure Cloud, Databricks, Azure Data Factory, Azure Synapse Analytics, SQL/TSQL, PySpark, Python Technical Expertise: ETL/ELT Pipelines: Design, implementation, and optimization. Azure ADF and Synapse: Proficiency in creating pipelines, developing notebooks, and performing data transformations. Databricks: Hands-on experience w...

Minimum Requirements: 9+ years of experience overall in IT Current - 4+ years of experience on Azure Cloud as Data Engineer Current - 4+ years of hands-on experience on Databricks/Azure Databricks Proficient in Python/PySpark Proficient in SQL/TSQL Proficient in Data Warehousing Concepts (ETL/ELT, Data Vault Modelling, Dimensional Modelling, SCD, CDC) Logistics domain experience Primary Skills: Azure Cloud, Databricks, Azure Data Factory, Azure Synapse Analytics, SQL/TSQL, PySpark, Python Technical Expertise: ETL/ELT Pipelines: Design, implementation, and optimization. Azure ADF and Synapse: Proficiency in creating pipelines, developing notebooks, and performing data transformations. Databri...

DMI Innovations a Encora company is seeking a full-time Lead Data Engineer who has expertise with Logistic domain to support our manufacturing clients large scale digital transformation. The Lead Data Engineer is responsible for ensuring the day-to-day leadership and guidance of the local, India-based, data team. This role will be the primary interface with the management team of the client and will work cross functionally with various IT functions to streamline project delivery. Duties and Responsibilities: Work with a distributed team with primary focus on the management of resources, team assignments, and fostering career growth Input into the hiring of team members for the locally based ...