3651 Azure Databricks Jobs - Page 46

e IT Applications Engineer II - Data KP Job Code 44022 Job Family IT Job Sub Family Applications Engineer IC-2 2 Job Summary This individual contributor is primarily responsible for assisting in the translation of business requirements and functional specifications into software solutions, assisting in the implementation and maintenance of business software solutions, and supporting systems integration testing and user acceptance testing Essential Responsibilities • Completes work assignments by applying up-to-date knowledge in subject area to meet deadlines; following procedures and policies, and applying data and resources to support projects or initiatives; collaborating with others, ofte...

As a Data Engineer Grade 5 located in Hyderabad, TL on a contract-to-hire basis, you will utilize your expertise in software engineering to build solutions against delta lakes and relational databases. Your primary responsibilities will include: - Writing Python and SQL code on Azure Databricks using PySpark - Performing analysis, design, implementation, and testing with a focus on automated testing - Extending the functionality of the consistency check engine for sub-ledger data and other tenants - Delving deeply into spark performance optimization due to large data volume To excel in this role, you must meet the following qualifications: - Hold a Bachelor's or master's degree in computer s...

In-depth expertise in Azure Data Factory and Databricks , including building scalable data pipelines, orchestrating complex workflows, implementing dynamic and parameterized pipelines, and optimizing Spark-based data transformations for large-scale integrations. Hands-on experience with Databricks Unity Catalog for centralized data governance, fine-grained access control, auditing, and managing data assets securely across multiple workspaces. Expert-level knowledge in RDBMS (SQL Server) with clear understanding of SQL query writing, object creation and management and performance and optimisation of DB/DWH operations. Good understanding of Transactional and Dimensional Data Modelling, Star Sc...

Experience: 5+ years Senior Azure Data Engineer: Strong background in data engineering, experience with Azure data services, and the ability to transform raw data into valuable business insights. Proficiency in Azure data services such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, and Azure Databricks. Strong knowledge of programming languages like SQL, Python, or Scala. Experience with big data processing frameworks (e.g., Apache Spark). Familiarity with relational and NoSQL databases (e.g., SQL Server, Cosmos DB). Knowledge of data modelling, schema design, and ETL/ELT processes.

Job Title : Databricks Tech Lead (Contract) Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productio...

Job Title : Databricks Tech Lead (Contract) Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productio...

Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow o...

Job Title : Databricks Tech Lead (Contract) Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productio...

Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow o...

Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow o...

We are seeking a Lead Data Engineer with 7-10 years of experience to join our Data Platform team. This role will report to the Manager of data engineering and be involved in the planning, design, and implementation of our centralized data warehouse solution for ETL, reporting and analytics across all applications within the company. Qualifications: Deep knowledge and experience working with Python/Scala and PySpark Experienced in Azure Data bricks, Azure Blob Storage, Azure Data Lake, Delta lake. Experience working with Spark SQL Experience in creating pipelines and databricks dashboards Experience with Azure cloud environments Experience with acquiring and preparing data from primary and se...

Job Description & Summary: A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge. Job Position Title: Data Architect Responsibili...

Description IT Data Analyst Syneos Healthis a leading fully integrated biopharmaceutical solutions organization built to accelerate customer success We translate unique clinical, medical affairs and commercial insights into outcomes to address modern market realities Our Clinical Development model brings the customer and the patient to the center of everything that we do We are continuously looking for ways to simplify and streamline our work to not only make Syneos Health easier to work with, but to make us easier to work for Whether you join us in a Functional Service Provider partnership or a Full-Service environment, youll collaborate with passionate problem solvers, innovating as a team...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Python (Programming Language), Kubernetes, Microsoft Azure Databricks Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Architecture Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications ar...

Primary Skills Azure Data Factory, Azure Synapse Analytics, Azure Databricks: Extensive experience in building and managing scalable data pipelines for data integration, transformation, and analysis.Azure Data Lake Storage, Azure SQL Database: Proven ability to manage and optimize data storage solutions, ensuring data accessibility and reliability. Azure Machine Learning: Expertise in developing, training, and deploying machine learning models using Azure's machine learning tools and services. Data Warehousing & Data Modeling: Strong experience with designing and maintaining data warehouses, with deep understanding of ETL processes and data models. Programming in Python or R: Skilled in writ...

Collect, harmonize, and automate data quality from multiple BUs using Azure tools. Design and maintain scalable data warehouses and pipelines. Collaborate with teams to ensure timely, accurate data for BI and self-service analytics in Power BI. Required Candidate profile Hands-on experience with Azure Data Factory, Synapse Analytics, Azure DevOps, SQL, data warehousing (star/snowflake), ETL pipelines, and Power BI integration.

Lead the development of data pipelines using Azure Databricks and Delta Live Tables. Architect solutions leveraging Azure Data Lake Storage, Delta Lake, Azure Functions and other Azure-native services.

KPI Partners is seeking a skilled and experienced Senior Azure Data Engineer to join our dynamic team. As a key member of our engineering department, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. Your expertise will play a crucial role in transforming our data into actionable insights, contributing to our mission of delivering high-quality business intelligence solutions to our clients. Key Responsibilities: - Design and implement robust data pipelines using Azure Data Factory, Azure Databricks, and Azure SQL Database. - Work with large datasets to ingest, process, and analyze data from various sources. - Utilize Azure services for...

Shift time-UK Shift time Primary Skillset-Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL,Azure Synapse Experience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key Responsibilities Design and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources. Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue. Collaborate with domain experts in genomics, clinical trials, and lab science to understand and implement robust data solutions. Develop and maintain data models, schemas, and governance practices for structured and unstructured biomedical data. Implement ...

ETL QA Work Location: Pune, Bangalore, Chennai, Mumbai Years of experience-5+ Salary 14-15 LPA We need an ETL Tester with Azure DataBrickss and Data factory background experience. Strong in SQL. Azure Data QA: Must have Azure Data Bricks, Azure Data Factory, Spark SQL knowledge Years 4-5 years of testing experience in Azure Data Bricks Strong experience in SQL, along with performing Azure Data bricks Quality Assurance. Understand complex data systems by working closely with engineering and product teams Develop scalable and maintainable applications to extract, transform, and load data in various formats to SQL Server, Hadoop Data Lake, or other data storage locations. Please share the follo...

Greetings, TCS is looking for Databrick Developer Experience: 8 - 15 Years Education: Minimum 15 years of full-time education (10th, 12th and Graduation) Location: Bangalore Requirements & Skills: Design, develop, and implement robust, scalable data processing solutions using Databricks and Python. Design, develop, and deploy data processing solutions using Azure Databricks. Collaborate with data engineers, architects, and business analysts to gather and analyze requirements. Develop, optimize, and manage complex data pipelines and workflows. Ensure data quality, integrity, and security across various data sources. Troubleshoot and resolve performance issues related to Databricks solutions. ...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. Y...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating communication among stakeho...

Roles and Responsibilities * Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources. Desired Candidate Profile * Develop complex data workflows using Azure Databricks and PySpark to process large datasets. * Troubleshoot issues with existing data pipelines and implement improvements for better performance. **Job Requirements** * 6-11 years of experience in designing and developing data pipelines using Azure Data Factory (ADF) or similar tools. * Strong understanding of big data technologies such as Hadoop, Spark, and NoSQL databases. * Proficiency in programming languages like Python or R for scripting...