4854 Azure Databricks Jobs - Page 25

As a Cloud Architect with expertise in Azure and Snowflake, your role involves designing and implementing secure, scalable, and highly available cloud-based solutions on AWS and Azure Cloud. Utilize your experience in Azure Databricks, ADF, Azure Synapse, PySpark, and Snowflake Services. Participate in pre-sales activities, including RFP and proposal writing. Key Responsibilities: - Integrate various data sources with Data Warehouse and Data Lake - Create Data warehouses and data lakes for Reporting, AI, and Machine Learning purposes - Understand data modelling and data architecture concepts - Collaborate with clients to comprehend business requirements and translate them into technical solu...

Role Overview: With more than 45,000 employees and partners worldwide, Microsoft's Customer Experience and Success (CE&S) organization aims to empower customers to accelerate business value through differentiated customer experiences leveraging Microsoft's products and services. As a Cloud Solution Architect (CSA) specializing in data platforms and analytics, you will play a crucial role in helping customers build secure, scalable, and AI-ready solutions on Microsoft Azure. Your responsibilities will include developing relationships with key customer IT and business decision makers, leading architecture design sessions, driving Proof of Concepts (POCs) and Minimum Viable Products (MVPs), and...

The project is expected to last for 6 months with a monthly rate of 1.60 Lac. The ideal candidate should have 4-7 years of experience and the work location will be in Bangalore with hybrid working options available. As a candidate, you are required to have: - Strong proficiency in Python, LLMs, Lang Chain, Prompt Engineering, and related Gen AI technologies. - Proficiency with Azure Databricks. - Possess strong analytical, problem-solving, and stakeholder communication skills. - Solid understanding of data governance frameworks, compliance, and internal controls. - Experience in data quality rule development, profiling, and implementation. - Familiarity with Azure Data Services such as Data ...

Role: Azure Data Engineer Must Skill - Azure, ADF, Pyspark, Python, SQL, Azure Databricks, Azure Data Lake Storage, Azure Data Factory Location: PAN India Responsibilities The candidate must be excited by the prospect of optimizing or even re-designing data pipelines to support the modernization of data platform Be curious and eager to work across a variety and volume of data. Design and build scalable and reliable data pipelines with the latest tech stack. Facilitate real-life actionable use cases leveraging our data with a user- and product-oriented mindset. Support teams without data engineers with building decentralized data solutions and product integrations. Conceptualize, design and i...

KEY RESPONSIBILITIES Participate in requirements gathering, database design, testing and production deployments. Analyse system/application requirements and design innovative solutions. Translating business requirements to technical specifications data streams, data integrations, data transformations, databases, data warehouses & data validation rules. Design and develop SQL Server database objects (i.e., tables, views, stored procedures, indexes, triggers, constraints, etc.) Understand design and develop apache spark notebooks in Azure databricks. Analyze and design data flow, data lineage mapping and data models. Optimize, scale and reduce the cost of analytics data platforms for multiple ...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data Lake Storage. Collaborate with cross-functional teams to gather requirements for data processing needs and design solutions that meet business needs. Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Databricks. Implement machine learning models using Python on Azure Synapse Analytics for predictive analytics tasks.

Good in Azure Data Bricks, Python, Pyspark and SQL. Key Responsibilities: Data Pipeline Development: Design, develop, and maintain scalable data pipelines using PySpark to process large volumes of data from various sources. Data Integration: Integrate data from multiple data sources and formats, ensuring high data quality and reliability. Optimization: Optimize and tune data processing jobs for performance and cost-efficiency. Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. ETL Processes: Develop and maintain ETL processes to extract, transform, and load data into data warehouses and d...

We are seeking an experienced Data Engineer to join our dynamic product development team. In this role, you will be responsible for designing, building, and optimizing data pipelines that ensure efficient data processing and insightful analytics. You will work collaboratively with cross-functional teams, including data scientists, software developers, and product managers, to transform raw data into actionable insights while adhering to best practices in data architecture, security, and scalability. Role & responsibilities * Design, build, and maintain scalable ETL processes to ingest, process, and store large datasets. * Collaborate with cross-functional teams to integrate data from various...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

TCS has been a great pioneer in feeding the fire of young techies like you. We are global leaders in the technology arena and there's nothing that can stop us from growing together. TCS Hiring for skill " Sr. Azure Databricks ". Role: Senior Databricks Lead Required Technical Skill Set: Primary: Azure Databricks Secondary: Pyspark, SQL Experience: 8 - 15 yrs Work Location: PAN India' Must-Have: • Databricks >9yrs Deep expertise in Databricks and related technologies. Strong problem-solving and technical leadership capabilities Good handle on Pyspark, SQL Knowledge of PowerBI will be an advantage Good-to-Have: Informatica basic knowledge, Tableau basic knowlege Responsibility of / Expectation...

TCS Hiring for skill " Databricks Engg ". Role: Databricks Engineer Experience: 5 to 10 Yrs Work Location: Hyderabad, Noida, Chennai, Mumbai Job Description: What are the top 5-10 responsibilities for this position? Working on a scrum team as a full stack engineer. Design and develop reusable software modules that meet customer requirements while upholding high standards of reliability, security, maintainability, and performance. Assist in defining product technical architecture. Maintain and document deliverables in Rally as needed Participate in peer reviews for designs, code, and other work products and scrum ceremonies Perform software quality assurance, including all types of testing. W...

Data Engineer - Con/AM - BLR - J49880 Role & responsibilities The responsibilities of the role include: Responsible for client interaction to gather the Business challenges and documentation Critical thinking and problem-solving skills are essential for interpreting data. Responsible of presenting the solution and insight to the Clients. Evaluate internal systems for efficiency, problems, and inaccuracies, developing and maintaining protocols for handling, processing, and cleaning data Work directly with management and users to gather requirements, provide status updates, and build relationships Requirement Design, build, and maintain Azure data services for internal and client platforms, in...

For a top MNC IT company, we need candidates with 5 to 10 years of experience in Azure Data. Key Responsibilities: Design and build data pipelines using Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake, etc. Ingest, transform, and store data from various sources (databases, APIs, files, cloud apps). Develop ETL / ELT solutions for analytics and reporting. Optimize data storage for performance, cost, and scalability. Implement data security using Azure security best practices. Work with data scientists and analysts to provide clean and structured data. Monitor and troubleshoot data processes on Azure. Skills Required: Azure Data Factory (ADF) Azure D...

Greetings from Aspire Systems!! Currently hiring for Data engineers Skill - Azure Data Engineer Experience - 6-10 years Location - Chennai, Kochi, Hyderabad, Bangalore Immediate joiners share cv to safoora.imthiyas@aspiresys.com / WA on 9384788107 Role: Azure Data Engineer Job Summary: We are seeking a skilled and experienced Azure Data Engineer with 6+ years of hands-on experience in designing, developing, and maintaining scalable data solutions using Azure Data Factory, Azure Databricks, Azure SQL, and SQL-based databases. The ideal candidate will have a strong understanding of data integration, transformation, and analytics within the Azure ecosystem. Key Responsibilities: Design and impl...

Key Responsibilities: AI Integration: Implement LLM-based workflows, RAG pipelines, and agentic orchestration using frameworks like LangChain, LangGraph, CrewAI, or similar. Data Pipeline Development: Design, develop, and maintain efficient and scalable data pipelines using Python and Azure tech stack. Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Automation & Deployment: Containerize and deploy solutions using Docker, Kubernetes, and cloud-native architectures (Azure/AWS/GCP). Monitoring & Governance: Ensure data quality, observability, and compliance with security standards....

Python - Modules like pydb and unittest/pytest; ML OPS, AML; Azure Databricks, Azure SQL GIT; Demand Forecasting Algorithms (includes all the forecasting algorithms, linear, log, arima, sarima, prophet etc.,)

Roles and Responsibilities Design, develop, and execute comprehensive test plans for ETL processes using Azure Databricks and PySpark. Collaborate with cross-functional teams to identify requirements and ensure data accuracy. Develop automated tests using SQL queries to validate database performance and integrity. Analyze results, troubleshoot issues, and provide recommendations for improvement. Participate in Agile development cycles by providing regular progress updates. Desired Candidate Profile 3-8 years of experience in Big Data Testing or related field (ETL Testing). Strong understanding of Azure Databricks, PySpark, SQL, and ability to write complex queries. Experience with designing ...

Role & responsibilities 4+ years experience Azure Cloud Services Experience with Azure-native data services (e.g., ADLS, Synapse, Data Factory). Databricks – Hands-on experience in building and optimizing ETL/ELT pipelines. Apache Spark / PySpark – Strong expertise in distributed data processing and performance tuning. SQL – Advanced SQL with strong query optimization and performance tuning skills. Design, build, and optimize large-scale ETL/ELT pipelines in Databricks. Work on performance optimization of Spark jobs and SQL queries. Ingest and transform large-scale datasets from multiple sources. Implement data quality checks, governance, and compliance practices. Collaborate with governance...

Senior MSBI Developer | Arise TechGlobal | Vizag / Hyderabad | Company: Arise TechGlobal Client: Mouri Tech Role: Senior MSBI Developer Experience: 7+ Years Work Mode: WFO Locations: Vizag & Hyderabad Employment Type: Permanent Job Description Arise TechGlobal is hiring a Senior MSBI Developer with strong experience in SSIS, SSAS, T-SQL, and Databricks for a permanent role. The position offers an excellent opportunity to work with a leading global client (Mouri Tech) on advanced BI and cloud data engineering initiatives. Key Responsibilities Design, develop, and maintain MSBI components including SSIS packages , SSAS cubes/models , and advanced T-SQL queries. Build and optimize ETL workflows...

Job Description Azure Data Engineer Location: Bangalore / Kochi Experience: 10+ years Role: Azure Data Engineer Employment Type: Full-time / Permanent About the Role We are hiring an experienced Azure Data Engineer to build scalable, secure, and high-performance data solutions on Microsoft Azure. The role involves end-to-end ownership of data pipelines, data lake/warehouse development, and enabling analytics for business teams. Key Responsibilities Design, develop, and maintain Azure-based data pipelines using ADF, Synapse Pipelines, Databricks, and Azure Functions. Build and optimize data lake and data warehouse environments on ADLS Gen2, Synapse Analytics, and Delta Lake. Develop and maint...

As a highly skilled and strategic Data Architect with expertise in the Azure Data ecosystem, your role at Lexmark involves defining and driving the overall Azure-based data architecture strategy aligned with enterprise goals. You will architect and implement scalable data pipelines, data lakes, and data warehouses using Azure Data Lake, ADF, and Azure SQL/Synapse. Providing technical leadership on Azure Databricks for large-scale data processing and advanced analytics use cases is a crucial aspect of your responsibilities. Key Responsibilities: - Architect and implement scalable data pipelines, data lakes, and data warehouses using Azure Data Lake, ADF, and Azure SQL/Synapse. - Provide techn...

Role Overview: You will work with Python Azure Data Factory (ADF), Azure Databricks, PySpark, Delta Lake, ETL/ELT, data pipelines, and data lakehouse architecture. Key Responsibilities: - Develop robust ETL/ELT workflows to ingest, transform, and load data into our data warehouse, Azure Synapse Analytics using Informatica. - Perform exploratory data analysis (EDA) to validate pipeline outputs and ensure data accuracy. - Implement proactive checks and monitoring to maintain data integrity and reliability. - Write and optimize complex SQL queries to support the data needs of analytical and reporting teams. - Collaborate with data analysts and business users to understand their requirements and...

As a Data Engineer, you will be responsible for designing and building efficient data pipelines using Azure Databricks (PySpark). You will implement business logic for data transformation and enrichment at scale, as well as manage and optimize Delta Lake storage solutions. Additionally, you will develop REST APIs using FastAPI to expose processed data and deploy them on Azure Functions for scalable and serverless data access. Key Responsibilities: - Design and build efficient data pipelines using Azure Databricks (PySpark) - Implement business logic for data transformation and enrichment at scale - Manage and optimize Delta Lake storage solutions - Develop REST APIs using FastAPI to expose p...

As a Senior Software Engineering Lead specializing in Power BI at UnitedHealth Group, your role will involve designing, developing, and maintaining advanced Power BI dashboards and reports using Microsoft Fabric. You will be responsible for integrating data from Azure Data Lake, Azure SQL, and Databricks into Power BI, as well as writing Python scripts for data transformation, automation, and analytics. Your collaboration with stakeholders to gather requirements and deliver data-driven solutions will be crucial in optimizing data models and DAX queries for performance and scalability. Additionally, conducting workshops and training sessions for business users on Power BI and Fabric usage wil...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Databricks, Data Factory, and Snowflake. Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time. Develop complex SQL queries to optimize database performance and troubleshoot issues in Snowflake. Implement data security measures to ensure compliance with company policies.