2404 Azure Databricks Jobs - Page 42

Job Title: Senior Azure Data Engineer Location: Remote Experience Required: 5+ years About the Role: We are seeking a highly skilled Senior Azure Data Engineer to design and develop robust, scalable, and high-performance data pipelines using Azure technologies. The ideal candidate will have strong experience with modern data platforms and tools, including Azure Data Factory, Synapse, Databricks, and Data Lake, as well as expertise in SQL, Python, and CI/CD workflows. Key Responsibilities: Design and implement end-to-end data pipelines using Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure Data Lake Storage Gen2. Ingest and integrate data from various sources such as S...

It is exciting to be a part of a company where the employees truly believe in the mission and values of the organization. At Fractal Analytics, we are dedicated to bringing passion and customer focus to our business operations. Our vision is to empower every human decision in the enterprise, creating a world where individual choices, freedom, and diversity are celebrated. We believe in fostering an ecosystem where human imagination plays a vital role in every decision-making process, constantly challenging ourselves to innovate and improve. We value individuals who empower imagination with intelligence, and we call them true Fractalites. We are currently seeking a Data Engineer with 2-5 year...

HCLTech is seeking a passionate and experienced Azure Data Engineer to become a valuable member of our expanding team. If you possess solid hands-on expertise in Azure Data Factory, Azure Databricks, and Oracle, and are eager to contribute to impactful data projects, then we are eager to learn more about you! As an Azure Data Engineer at HCLTech, you will be responsible for the design, development, and maintenance of data pipelines utilizing Azure Data Factory and Azure Databricks. You will collaborate with Oracle databases for data extraction, transformation, and loading processes. Working closely with cross-functional teams, you will provide support and enhancements to data solutions. Addi...

You will be joining YASH Technologies, a leading technology integrator focused on helping clients enhance competitiveness, optimize costs, and drive business transformation in an increasingly virtual world. As a Microsoft Fabric Professional, you will be responsible for working with cutting-edge technologies in Azure Fabric, Azure Data factory, Azure Databricks, Azure Synapse, Azure SQL, and ETL processes. Your key responsibilities will include creating pipelines, datasets, dataflows, Integration runtimes, and monitoring pipelines in Azure. You will be extracting, transforming, and loading data from source systems using Azure Databricks and creating SQL scripts for complex queries. Additiona...

As a Data Engineer, you will be responsible for designing and building efficient data pipelines using Azure Databricks (PySpark). You will implement business logic for data transformation and enrichment at scale, as well as manage and optimize Delta Lake storage solutions. Additionally, you will develop REST APIs using FastAPI to expose processed data and deploy them on Azure Functions for scalable and serverless data access. Your role will also involve developing and managing Airflow DAGs to orchestrate ETL processes, ingesting and processing data from various internal and external sources on a scheduled basis. You will handle data storage and access using PostgreSQL and MongoDB, writing op...

At EY, you will have the opportunity to shape a career that reflects your uniqueness, supported by a global network, inclusive environment, and cutting-edge technology to empower you to reach your full potential. Your individual voice and perspective are crucial in contributing to EY's continuous improvement. Join our team to create an exceptional journey for yourself and contribute to building a better working world for all. In EY's GDS Tax Technology team, the focus is on developing, implementing, and integrating technological solutions that enhance client service and support engagement teams. As a member of the core Tax practice, you will gain in-depth tax technical knowledge along with e...

Your role at Prudential is to design, build, and maintain data pipelines to ingest data from multiple sources into the cloud data platform. It is essential to ensure that these pipelines are constructed according to defined standards and documented comprehensively. Data governance standards must be adhered to and enforced to maintain data integrity and compliance. Additionally, you will be responsible for implementing data quality rules to ensure the accuracy and reliability of the data. As part of your responsibilities, you will need to implement data security and protection controls around Databricks Unity Catalog. You will be utilizing Azure Data Factory, Azure Databricks, and other Azure...

Dear Candidate, Hope you are doing well. Greeting from NAM Info INC. NAM Info Inc. is a technology-forward talent management organization dedicated to bridging the gap between industry leaders and exceptional human resources. They pride themselves on delivering quality candidates, deep industry coverage, and knowledge-based training for consultants. Their commitment to long-term partnerships, rooted in ethical practices and trust, positions them as a preferred partner for many industries. Learn more about their vision, achievements, and services on their website at www.nam-it.com. We have an open position for Data Engineer role with our company for Bangalore, Pune and Mumbai location. Job De...

To Apply - Mandatory to submit Details via Google Form - https://forms.gle/cCa1WfCcidgiSTgh8 Position : Senior Data Engineer - Total 8+ years Required Relevant 6+ years in Databricks, AWS, Apache Spark & Informatica (Required Skills) As a Senior data Engineer in our team, youll build and nurture positive working relationships with teams and clients with the intention to exceed client expectations Seeking experienced data Engineer to design, implement, and maintain robust data pipelines and analytics solutions using databricks & AWS services. The ideal candidate will have a strong background in data services, big data technologies, and programming languages. Role & responsibilities Technical ...

As an Azure Data Engineer within our team, you will play a crucial role in enhancing and supporting existing Data & Analytics solutions by utilizing Azure Data Engineering technologies. Your primary focus will be on developing, maintaining, and deploying IT products and solutions that cater to various business users, with a strong emphasis on performance, scalability, and reliability. Your responsibilities will include incident classification and prioritization, log analysis, coordination with SMEs, escalation of complex issues, root cause analysis, stakeholder communication, code reviews, bug fixing, enhancements, and performance tuning. You will design, develop, and support data pipelines ...

Educational Requirements MCA,MSc,MTech,Bachelor of Engineering,BCA,BSc Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion • As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. • You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. • You will play a key role in the overall estimation of work requirements to provide the right information on project estimations to Techno...

Availability: Immediate preferred Key Responsibilities: Design and implement advanced data science workflows using Azure Databricks. Collaborate with cross-functional teams to scale data pipelines. Optimize and fine-tune PySpark jobs for performance and efficiency. Support real-time analytics and big data use cases in a remote-first agile environment. Required Skills: Proven experience in Databricks, PySpark, and big data architecture. Ability to work with data scientists to operationalize models. Strong understanding of data governance, security, and performance. Location: Delhi NCR,Bangalore,Chennai,Pune,Kolkata,Ahmedabad,Mumbai,Hyderabad

Job description Expirence - 5+ Years Location - Anywhere India Mandatory skills* Oracle, Azure Data Factory and Azure Databricks, SQL Server, AWS S3, FTP, Oracle, Blob Role & responsibilities Design, develop, and deploy scalable ETL solutions using Azure Data Factory and Azure Databricks. Construct and optimize complex data pipelines, leveraging various ADF activities such as Get Metadata, Lookup, Stored Procedure, For Each, If, and Execute Pipeline. Implement dynamic pipelines to efficiently extract and load data from multiple sources (SQL Server, AWS S3, FTP, Oracle, Blob) into Azure Data Lake Storage. Collaborate with data architects and stakeholders to understand data requirements and tr...

Greeting from ARi !!! Company Profile: ARI is US Based organization; Head Quartered @ USA and having local offices in India @ Hyderabad and Chennai. The overall employee strength is more than 1800+ Website: https://ariglobalsolutions.com Job Title: Senior Azure Cloud Data Engineer Location: Bangalore Experience Required: 5+ years Job Summary: We are seeking a highly skilled Senior Azure Cloud Data Engineer to join our team. The ideal candidate will have extensive experience in processing and analyzing IoT data from connected products to drive value for our customers. This role involves working with cloud data and analytics platforms such as AWS, Azure, or GCP, and requires advanced knowledge...

We are looking for Data Engineers with 5-10 years experience , need candidates who can join us within 15 days Exp: 5-10 Yrs Location: Chennai/Pune Mode: Hybrid - 3 days in a week What we Need: Candidates with good exposure on the below skill: Azure Data Bricks, Azure Data Factory, Azure Data Lakes ,Devops, Python Pyspark, CDC

5+ Years of Data and Analytics experience with minimum 3 years in Azure Cloud Excellent communication and interpersonal skills. Extensive experience in Azure stack ADLS, Azure SQL DB, Azure Data Factory, Azure Data bricks, Azure Synapse, Cosmo DB, Analysis Services, Event Hub etc.. Experience in job scheduling using Oozie or Airflow or any other ETL scheduler Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala. Good experience in designing & delivering data analytics solutions using Azure Cloud native services. Good experience in Requirements Analysis and Solution Architecture Design, Data modelling, ETL, data int...

Seeking a skilled and experienced Technical Hands-On Production Support Lead with a focus on Azure data engineering and production support. The ideal candidate will work with a technical team in building and supporting data solutions on the Azure platform. This is an exciting opportunity to work on cutting-edge projects and be part of a dynamic team that thrives on innovation and collaboration. Required Skills & Experience: • 5+ years of experience in data engineering with a strong focus on Azure data services. • Hands-on experience with Azure Data Factory, Azure Databricks, and Azure Synapse. • Strong proficiency in Python, SQL, and PySpark. • Proven experience in production support environ...

Position Overview: The primary focus of this position is to Design, develop, and maintain robust data pipelines using Azure Data Factory. Implement and manage ETL processes to ensure efficient data flow and transformation. What youll do as a (BI Developer Lead): Design, develop, and maintain robust data pipelines using Azure Data Factory. Implement and manage ETL processes to ensure efficient data flow and transformation. Develop and maintain data models and data warehouses using Azure SQL Database and Azure Synapse Analytics. Create and manage Power BI reports and dashboards to provide actionable insights to stakeholders. Ensure data quality, integrity, and security across all data systems....

As a Senior Software Engineer at our organization, you will play a crucial role in leading and contributing to our healthcare data engineering initiatives. Your primary focus will be on building scalable, real-time data pipelines and processing large-scale healthcare datasets in a secure and compliant cloud environment. You will design and develop scalable real-time data streaming solutions using Apache Kafka and Python. Additionally, you will architect and implement ETL/ELT pipelines using Azure Databricks for both structured and unstructured healthcare data. It will be your responsibility to optimize and maintain Kafka applications, Python scripts, and Databricks workflows to ensure perfor...

You should have more than 5 years of experience in designing and implementing end-to-end data solutions using Microsoft Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Databricks, and SSIS. Your role will involve developing complex transformation logic using SQL Server, SSIS, and ADF, along with creating ETL Jobs/Pipelines to execute these mappings concurrently. You will also be responsible for maintaining and enhancing existing ETL Pipelines, Warehouses, and Reporting leveraging the traditional MS SQL Stack. It is crucial that you have an understanding of REST API principles and the ability to create ADF pipelines to handle HTTP requests for APIs. You should be well-versed i...

You should have 5+ years of experience in data analysis, engineering, and science. Your proficiency should include Azure Data Factory, Azure DataBricks, Python, PySpark, SQL, and PLSQL or SAS. Your responsibilities will involve designing, developing, and maintaining ETL pipelines using Azure Data Bricks, Azure Data Factory, and other relevant technologies. You will be expected to manage and optimize data storage solutions using Azure Data Lake Storage (ADLS) and develop and deploy data processing workflows using Pyspark and Python. Collaboration with data scientists, analysts, and stakeholders to understand data requirements and ensure data quality is essential. Implementing data integration...

You have an exciting opportunity to join YASH Technologies as a Microsoft Fabric Professional. As part of our team, you will be working with cutting-edge technologies to drive business transformation and create real positive changes in an increasingly virtual world. Your main responsibilities will include working with Azure Fabric, Azure Data Factory, Azure Databricks, Azure Synapse, Azure SQL, and ETL processes. You will be creating pipelines, datasets, dataflows, integration runtimes, and monitoring pipelines to trigger runs. Additionally, you will be involved in extracting, transforming, and loading data from source systems using Azure Databricks, as well as creating SQL scripts for compl...

Key Responsibilities: At least 5 years of experience in data engineering with a strong background on Azure Databricks and Scala/Python. Databricks with knowledge in Pyspark Database: Oracle or any other database Programming: Python with awareness of Flask or Streamlit

Position: Data Engineer Azure Databricks Experience: 7+ Years Locations: Trivandrum, Kochi, Bangalore No. of Positions: 20 Notice Period: 0 – 15 Days (Strictly) CTC: Up to 40 LPA (Case-to-case basis) Mandatory Skills: Azure Databricks PySpark SQL Python Key Responsibilities: Develop and optimize robust data pipelines using Databricks, PySpark, and Azure Work on complex ETL/ELT processes , transforming and modeling data for analytics and reporting Build scalable data solutions using relational and big data engines Apply strong understanding of data warehousing concepts (e.g., Kimball/Star Schema ) Collaborate with cross-functional teams in Agile environments Ensure clean code, versioning, doc...

Job description Role: Azure Databricks Allen.Prashanth@ltimindtree.com share resume and details Experience: 5-12 Years Location: Bangalore/Chennai/Kolkata/Coimbatore/Mumbai/Pune/Hyderabad. Forms link to Get quicker turn around on response, will consider application only if this link is filled. Overview: Data Engineer having good experience on Azure Databricks and Pyspark Must Have: Databricks Python Azure Good to have: ADF Requirements Candidate must be proficient in Databricks Skills The Candidate must have 5-12 yrs of experience in databricks delta lake Hands on experience on Azure Experience on Python scripting Relevant experience with ETL methods and with retrieving data from dimensional...