3649 Azure Databricks Jobs - Page 26

The ability to be a team player The ability and skill to train other people in procedural and technical topics Strong communication and collaboration skills Required education Bachelor's Degree Required technical and professional expertise Able to write complex SQL queries ; Having experience in Azure Databricks Preferred technical and professional experience Excellent communication and stakeholder management skills

Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. 7+ Yrs total experience in Data Engineering projects & 4+ years of relevant experience on Azure technology services and Python Azure Azure data factory, ADLS- Azure data lake store, Azure data bricks, Mandatory Programming languages Py-Spark, PL/SQL, Spark SQL Database SQL DB Experience with AzureADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with object-oriented/object function scripting languagesPython...

Role & responsibilities: Develop and maintain ETL processes using Python and PySpark. Design and implement data pipelines and workflows. Optimize and fine-tune data processing applications. Collaborate with data scientists and analysts to understand data requirements. Ensure data integrity and consistency across systems. Write clean, scalable, and maintainable code. Monitor and troubleshoot data processing jobs. Technical skills: Python PySpark ETL Data Pipeline Big Data AWS GCP Azure Data Warehousing Spark Hadoop Preferred candidate profile: Ability to develop value-creating strategies and models that enable clients to innovate, drive growth and increase their business profitability Good kn...

Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using A...

Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using A...

Job Title : Databricks Tech Lead (Contract) Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productioni...

Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using A...

Job Title : Databricks Tech Lead (Contract) Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productioni...

Job Title : Databricks Tech Lead (Contract) Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productioni...

As a Data Engineer at Gyansys with 6 to 8 years of experience, your primary focus will be on utilizing Azure Databricks, PySpark, and SQL to design and implement Hadoop big data solutions that align with business requirements and project timelines. - Coding, testing, and documenting data systems to develop scalable applications for data analytics - Collaborating with other Big Data developers to ensure the consistency of all data solutions You will partner with the business community to gather requirements, identify training needs, and conduct user training sessions. Researching technologies and product enhancements will be part of your role to define requirements, address critical issues, a...

As a Data Engineer at this company based in Pune (Hybrid), your primary roles and responsibilities include: - Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Providing forward-thinking solutions in the data engineering and analytics space - Collaborating with DW/BI leads to understand new ETL pipeline development requirements - Triaging issues to identify gaps in existing pipelines and resolving them - Working with the business to understand reporting needs and developing data models accordingly - Assisting team members in resolving technical challenges - Driving technical discussions with client architects and team members Qualifications required for this role ...

As a Data Engineer 2 at JLL, you will be part of the JLL Technologies Enterprise Data team, working in a diverse and fast-paced environment to develop and implement data solutions that are strategic for the business. Your primary focus will be on developing solutions leveraging cloud big data technology to ingest, process, and analyze large, disparate data sets to meet business requirements. Additionally, you will collaborate with internal and external teams to drive data development and derive insights from a variety of data sources. - Develop solutions using cloud big data technology to process and analyze large data sets - Design and develop data pipelines from various internal and extern...

Role Overview: As a Data Engineer, you will collaborate with various teams to deliver solutions on the Azure Cloud utilizing core cloud data warehouse tools such as Azure Data Factory, Azure Databricks, Azure SQL DW, and other Big Data related technologies. Your primary focus will involve constructing the next generation of application data platforms and enhancing recent implementations. It is important to note that this position is geared towards data engineering from the application side, requiring the ability to analyze data and devise strategies for data lake population. You may also be tasked with intricate coding using U-SQL, Scala or Python, and T-SQL. Key Responsibilities: - Work col...

Required Qualifications o 3+ Years professional experience in a data Engineer/analyst role or similar.o At least 5+ year of Development experience in ADF V2 . o At least 1 years of Experience with Spark (PySpark and other python data libraries), Spark Scala is also fine.o At least 1 years of experience in T-SQL, creating complex store procedures, triggers etc. o Should have used Azure DevOps extensively as part of projectso Should have worked on at least 1 project involving hybrid cloud implementation. o Should have worked on Azure Data Bricks, SQL Database, Azure SQL Database, Azure Datawarehouse and should be comfortable with data warehousing concepts. o Should have worked on Azure Logic A...

What you'll do Develop, maintain, and enhance new data sources and tables, contributing to data engineering efforts to ensure comprehensive and efficient data architecture. Serves as the liaison between Data Engineer team and the Airport operation teams, developing new data sources and overseeing enhancements to existing database; being one of the main contact points for data requests, metadata, and statistical analysis Migrates all existing Hive Metastore tables to Unity Catalog, addressing access issues and ensuring smooth transition of jobs and tables. Collaborate with IT teams to validate package (gold level data) table outputs during the production deployment of developed notebooks Deve...

Key Responsibilities Design scalable ETL/ELT data pipelines using Azure Data Factory, Synapse Pipelines, and Databricks. Develop data ingestion workflows for structured and semi-structured data sources, including IoT streams and batch files. Define and enforce data modeling standards for the raw, curated, and semantic layers in ADLS Gen2. Create PySpark jobs and reusable transformation frameworks for cleansing, validation, and enrichment. Oversee data partitioning, versioning, and metadata strategies to ensure high performance and maintainability. Coordinate with ML engineers to support feature engineering pipelines and training datasets. Mentor data engineers, conduct code reviews, and enfo...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role: MLOps Engineer Location: Bhubaneswar Key words -Skillset AWS SageMaker, Azure ML Studio, GCP Vertex AI PySpark, Azure Databricks MLFlow, KubeFlow, AirFlow, Github Actions, AWS CodePipeline Kubernetes, AKS, Terraform, Fast API Responsibilities Model Deployment, Model Monitoring, Model Retraining Deployment pipeline, Inference pipeline, Monitoring pipeline, Retraining pipeline Drift Detection, Data Drift, Model Drift Experiment Tracking MLOps Architecture REST API publishing Job Responsibilities: Research and implement MLOps tools, frameworks and platforms for our Data Science projects. Work on a backlog of activities to raise MLOps maturity in the organization. Proactively introduce a m...

Role: MLOps Engineer Location: PAN India Key words -Skillset AWS SageMaker, Azure ML Studio, GCP Vertex AI PySpark, Azure Databricks MLFlow, KubeFlow, AirFlow, Github Actions, AWS CodePipeline Kubernetes, AKS, Terraform, Fast API Responsibilities Model Deployment, Model Monitoring, Model Retraining Deployment pipeline, Inference pipeline, Monitoring pipeline, Retraining pipeline Drift Detection, Data Drift, Model Drift Experiment Tracking MLOps Architecture REST API publishing Job Responsibilities: Research and implement MLOps tools, frameworks and platforms for our Data Science projects. Work on a backlog of activities to raise MLOps maturity in the organization. Proactively introduce a mod...

The key requirements for the role are: Experience in Analytics Proficiency in Scala Hands-on with PySpark Familiarity with Azure Databricks Knowledge of NoSQL/Cassandra

Project description The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week. Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart. Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business. Responsibilities We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to supp...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform, Microsoft Azure Databricks, Microsoft Azure Data Services Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with cross-functional teams to gather r...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform, Microsoft Azure Databricks, Microsoft Azure Data Services Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Senior Data Engineer, you bring experience in applying advanced concepts and technologies in production environments.Your expertise and skills make you an ideal candidate to lead and deliver cutting-edge data solutions. Roles and Responsibilities- Experience with Infrastructure as Code (IaC), preferably using Terraform.- Proficiency in C...