2403 Azure Databricks Jobs - Page 2

Databricks Developer Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation . Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Strong Programming skills with at least one of Python, Scala or Java Location- Pune, Bangalore, Coimbatore, Chennai Mandatory Skills: DataBricks - Data Enginee...

Dear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill - Azure Data Engineer ( Microsoft Azure Platform, Azure data factory, Azure data bricks, pySpark, Python, SQL ( SSIS)) Exp range 8 yrs -10 yrs Location- PAN India Pls find the Job Description below. Experience working with Azure cloud services, such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics or Azure Data Lake , SSIS Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience building and optimizing big data’ data pipelines, architectures and data sets. Airflow orchestration an...

Job Title: Azure Data Engineer Experience: 3 to 8 Years Locations: Bangalore, Hyderabad, Chennai, Pune, Gurgaon Work Mode: Hybrid (2 days onsite per week) About the Role We are seeking a skilled and passionate Azure Data Engineer to join our dynamic data team. You will play a key role in designing, building, and optimizing data pipelines and analytics solutions using cutting-edge Azure technologies. This is a hybrid role with flexibility to work remotely and collaborate onsite twice a week. Key Responsibilities Design and develop scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks Implement data transformation and processing logic using PySpark Build and manage data w...

Experience: 7+ Years Required Qualification: B.Tech / MCA / Equivalent in Computer Science, IT, or Engineering Primary Skills: Azure Data Factory (ADF) Data pipeline creation, data flow management Power BI Report & dashboard development, DAX, data modeling SQL Strong experience with Azure SQL, SQL Server, query optimization ETL Processes Design and implementation of scalable ETL pipelines Cloud Platforms Microsoft Azure (Azure Data Lake, Azure Blob Storage) Programming Python and SQL for data transformation Data Warehousing Concepts Hands-on understanding of data architecture Performance Tuning Optimize data pipelines for reliability and efficiency. Preferred Skills: Azure Databricks Data en...

Qualification: B.Tech / MCA / BCA / B.Sc (Computer Science or related field) Notice Period: Immediate Joiners Preferred We Have an Immediate Requirement For Azure Data Engineers at Senior and Lead levels to work on cutting-edge data projects in Azure ecosystem. Primary Skills: Azure Data Factory (ADF) Azure Databricks SQL Development & Optimization Power BI Reports, Dashboards, DAX Data Integration & ETL Pipelines Data Modeling and Transformation Secondary Skills: Azure Synapse Analytics Python / PySpark in Databricks DevOps exposure for data pipelines Version control using Git Exposure to Agile & CI/CD Environments Strong communication and client-handling skills Key Responsibilities: Design...

Qualification: B.Tech / MCA / BCA / B.Sc (Computer Science or related field) Notice Period: Immediate Joiners Preferred We Have an Immediate Requirement For Azure Data Engineers at Senior and Lead levels to work on cutting-edge data projects in Azure ecosystem. Primary Skills: Azure Data Factory (ADF) Azure Databricks SQL Development & Optimization Power BI Reports, Dashboards, DAX Data Integration & ETL Pipelines Data Modeling and Transformation Secondary Skills: Azure Synapse Analytics Python / PySpark in Databricks DevOps exposure for data pipelines Version control using Git Exposure to Agile & CI/CD Environments Strong communication and client-handling skills Key Responsibilities: Design...

Role Overview: We are looking for a skilled .NET Backend Developer with Azure Data Engineering expertise to join our dynamic and growing team. This role demands strong hands-on experience in .NET technologies along with cloud-based data engineering platforms like Azure Databricks or Snowflake. Primary Technical Skills (Must-Have): .NET Core / ASP.NET Core / C# Strong backend development Web API & Microservices Architecture SQL Server, NoSQL, Entity Framework (EF 6+) Azure Cloud Platform, Azure Data Engineering Azure Databricks, Microsoft Fabric, or Snowflake Database Performance Tuning & Optimization Strong understanding of OOPs & Design Patterns Agile Methodology Experience Nice to Have (Se...

Senior Data Engineer (Remote, Contract 6 Months) Databricks, ADF, and PySpark. We are hiring a Senior Data Engineer for a 6-month remote contract position. The ideal candidate is highly skilled in building scalable data pipelines and working within the Azure cloud ecosystem, especially Databricks, ADF, and PySpark. You'll work closely with cross-functional teams to deliver enterprise-level data engineering solutions. KeyResponsibilities Build scalable ETL pipelines and implement robust data solutions in Azure. Manage and orchestrate workflows using ADF, Databricks, ADLS Gen2, and Key Vaults. Design and maintain secure and efficient data lake architecture. Work with stakeholders to gather dat...

We Are Hiring: Senior .NET Backend Developer with Azure Data Engineering Experience Job Location: Hyderabad, India Work Mode: Onsite Only Experience: Minimum 6+ Years Qualification: B.Tech, B.E, MCA, M.Tech Role Overview We are seeking an experienced .NET Backend Developer with strong Azure Data Engineering skills to join our growing team in Hyderabad. You will work closely with cross-functional teams to build scalable backend systems, modern APIs, and data pipelines using cutting-edge tools like Azure Databricks and MS Fabric. Technical Skills (Must-Have) Strong hands-on experience in C, SQL Server, and OOP Concepts Proficiency with .NET Core, ASP.NET Core, Web API, Entity Framework (v6 or ...

Mode: Contract As an Azure Data Architect, you will: Lead architectural design and migration strategies, especially from Oracle to Azure Data Lake Architect and build end-to-end data pipelines leveraging Databricks, Spark, and Delta Lake Design secure, scalable data solutions integrating ADF, SQL Data Warehouse, and on-prem/cloud systems Optimize cloud resource usage and pipeline performance Set up CI/CD pipelines with Azure DevOps Mentor team members and align architecture with business needs Qualifications: 10-15 years in Data Engineering/Architecture roles Extensive hands-on with: Databricks, Azure Data Factory, Azure SQL Data Warehouse Data integration, migration, cluster configuration, ...

Availability: Immediate preferred Key Responsibilities: Design and implement advanced data science workflows using Azure Databricks. Collaborate with cross-functional teams to scale data pipelines. Optimize and fine-tune PySpark jobs for performance and efficiency. Support real-time analytics and big data use cases in a remote-first agile environment. Required Skills: Proven experience in Databricks, PySpark, and big data architecture. Ability to work with data scientists to operationalize models. Strong understanding of data governance, security, and performance. Location: Delhi NCR,Bangalore,Chennai,Pune,Kolkata,Ahmedabad,Mumbai,Hyderabad

We are seeking an experienced Azure Data Engineer with 36 years of experience for a 6-month remote contract. The candidate will be responsible for developing and supporting IT solutions using technologies like Azure Data Factory, Azure Databricks, Azure Synapse, Python, PySpark, Teradata, and Snowflake. The role involves designing ETL pipelines, developing Databricks notebooks, handling CI/CD pipelines via Azure DevOps, and working on data warehouse modeling and integration. Strong skills in SQL, data lake storage, and deployment/monitoring are required. Prior experience in Power BI and DP-203 certification is a plus. Location: Delhi NCR,Bangalore,Chennai,Pune,Kolkata,Ahmedabad,Mumbai,Hydera...

Role & responsibilities Resource should have basic Azure knowledge . Good experience in azure Kubernetes , Azure Databricks , Azure storage account. Good to have ADO experience in running the azure pipelines. Basic knowledge on scripting language. Must know Azure monitoring , basic az cli commands . Should know the CI/CD concept .

Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow o...

Role - Data engineer (Pyspark) with AI Experience- 6 to 10 yrs **Responsibilities:** Design and deploy predictive models (e.g., forecasting, churn analysis, fraud detection) using Python/SQL, Spark MLlib, and Databricks ML Build end-to-end ML pipelines (data ingestion feature engineering model training deployment) on Databricks Lakehouse Optimize model performance via hyperparameter tuning, AutoML, and MLflow tracking Collaborate with engineering teams to operationalize models (batch/real-time) using Databricks Jobs or REST APIs Implement Delta Lake for scalable, ACID-compliant data workflows. Enable CI/CD for ML pipelines using Databricks Repos and GitHub Actions Troubleshoot issues in Spar...

Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow o...

Job Title : Databricks Tech Lead (Contract) Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productio...

Job Title : Databricks Tech Lead (Contract) Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productio...

Job Title : Databricks Tech Lead (Contract) Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productio...

Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow o...

We are looking forward to hireAzure Data Factory (ADF) Professionals in the following areas : Experience of 2-4 yrs in Azure services like Azure Data factory, Azure Databricks, Azure Synapse, Azure SQL, ETL Create Pipelines, datasets, dataflows, Integration runtimes and monitoring Pipelines and trigger runs Extract Transformation and Load Data from source system and processing the data in Azure Databricks Create SQL scripts to perform complex queries Create ADF pipelines to migrate data from Gen2 to Azure SQL Data Migration pipeline to Azure cloud (Azure SQL). Database migration from on-prem SQL server to Azure Dev Environment by using Azure DMS and Data Migration Assistant Experience in usi...

Experience in Azure Fabric, Azure Data factory, Azure Databricks, Azure Synapse, Azure SQL, ETL Create Pipelines, datasets, dataflows, Integration runtimes and monitoring Pipelines and trigger runs Extract Transformation and Load Data from source system and processing the data in Azure Databricks Create SQL scripts to perform complex queries Create Synapse pipelines to migrate data from Gen2 to Azure SQL Data Migration pipeline to Azure cloud (Azure SQL). Database migration from on-prem SQL server to Azure Dev Environment by using Azure DMS and Data Migration Assistant Experience in using azure data catalog Experience in Big Data Batch Processing Solutions; Interactive Processing Solutions; ...

ADF Developer with 5+ yrs of exp in designing, developing, maintaining data integration solutions using Azure Data Factory and Azure data services. Should have a strong background in data engineering, ETL/ELT processes, cloud data platforms, SQL. Provident fund Annual bonus Health insurance

Locations: Pune, Maharashtra, India Minimum Experience: 6 Maximum Experience: 12 ctc 6-8 -22 lac 8+ -30 lac max Skill Set: Databricks Engineer, Azure Databricks, SQL, Skill to Evaluate: Databricks Engineer, Azure Databricks, SQL,Pyspark, Data warehousing, ADF Experience: 5 to 12 Years Location: Pune, Maharashtra, India Job Description: Job Title: Senior Data Engineer Key Responsibilities: - Design, build, and maintain scalable data pipelines and ETL processes. - Collaborate with data scientists and analysts to understand data needs and provide support for their analytics requirements. - Develop and implement data models, database designs, and data management solutions. - Ensure data quality,...

Location: Pune / Bangalore / Chennai / Coimbatore Experience: , 5 to 13 years Employment Type: Full-time Mandatory / Primary Skills: We are looking for professionals with strong expertise in: Business Analysis requirement gathering, backlog management, documentation Azure Databricks / PySpark hands-on experience in data mapping, source-to-target mapping (STTM) SQL strong SQL query writing and optimization Secondary Skills (Good to Have): Candidates with exposure to any of the following will have an added advantage: Banking / BFSI Domain – Banking, Insurance, Capital Market, Investment Banking, Wealth Management Python / PySpark – scripting and automation ETL Tools – Azure Data Factory, data ...