15 Databricks Notebooks Jobs

As a Senior Informatica Developer with over 10 years of experience, your role will primarily involve strong hands-on exposure in CDGC (Informatica Cloud data governance and catalog). You must have a deep understanding of the data governance process and be able to set up Informatica catalog connecting to SAP HANA, Tableau/Power BI, Python/Informatica ETL, and Databricks notebooks, data Databricks Unity catalog. Your responsibilities will include implementing business glossary and data quality rules, as well as understanding how tagging works in the Informatica tool. Key Responsibilities: - Strong hands-on exposure in CDGC (Informatica Cloud data governance and catalog) - Setting up Informatic...

The Oracle Cloud Infrastructure Compute team is seeking a passionate, experienced Principal Data Engineer ready to tackle complex business and technical challenges through the managing and analysis of data, in a fast-paced environment. As OCI continues to scale to demands of an ever-growing customer base and regions, we need engineers who can lead data-driven initiatives to ensure OCI continues to provide an outstanding customer experience while continuously improving the efficiency of development processes. The ideal candidate is someone who thrives in the face of ambiguity and can quickly distill abstract ideas into concrete solutions and has a proven track record of delivering complex dat...

The Oracle Cloud Infrastructure Compute team is seeking a passionate, experienced Data Engineer ready to tackle complex business and technical challenges through the managing and analysis of data, in a fast-paced environment. As OCI continues to scale to demands of an ever-growing customer base and regions, we need engineers who can lead data-driven initiatives to ensure OCI continues to provide an outstanding customer experience while continuously improving the efficiency of development processes. The ideal candidate is someone who thrives in the face of ambiguity and can quickly distill abstract ideas into concrete solutions and has a proven track record of delivering complex data engineer...

Role Overview: As a Data Engineer Deputy Manager at Philips, you will be responsible for being well versed with the Microsoft Business Intelligence stack, with a strong focus on developing and implementing BI and advanced analytics solutions based on business requirements. Your role will involve hands-on experience in Microsoft ADF pipelines, databricks notebooks, and Pyspark. You will be adept in designing and developing data flows using ADF, implementing complex ETL logics through databricks notebooks, and writing complex SQL queries. Your expertise will also include handling MDX cubes, SSIS packages, and implementing CI-CD pipelines through Azure DevOps. You will work in an agile (scrum) ...

Job Title:Immediate Data Scientist (3+ Years Experience) Bengaluru Location:Bengaluru (Work from Office Minimum 4 Days/Week) Employment Type:Full-time (Third-Party Payroll, Not Contractual) Experience Required:3+ years in AI/ML Educational Qualifications: o B.E./B.Tech/M.Tech/MCA in Computer Science, Electronics & Communication, Electrical Engineering, or a related field. o A master's degree in computer science, Artificial Intelligence, or a specialisation in Deep Learning or Computer Vision is highly preferred. Experience: o 46 years of IT experience, with a minimum of 3+ years in data science o Proven experience in designing and deploying deep learning models, particularly in computer visi...

Job Title: Databricks SQL Engineer with Commercial Pharma Location: Remote Type: Contract About the Role: We are looking for a Databricks SQL Engineer to design, develop, and optimize data solutions using Databricks SQL. The ideal candidate will have expertise in SQL, performance tuning, data modeling, and cloud-based data platforms such as AWS, Azure, or GCP. Key Responsibilities: Develop and optimize SQL queries and notebooks in Databricks for data transformation, aggregation, and analysis. Optimize Databricks SQL workloads for performance, cost, and scalability. Monitor, debug, and troubleshoot Databricks SQL queries and jobs. Required Qualifications: 4+ years of experience with SQL devel...

Responsibilities: Strong experience on Python programming. Experience on Databricks. Experience on Database like SQL Perform database performance tuning and optimization. Databricks Platform Work with Databricks platform for big data processing and analytics. Develop and maintain ETL processes using Databricks notebooks. Implement and optimize data pipelines for data transformation and integration. Design, develop, test, and deploy high-performance and scalable data solutions using Python

Role Overview: As a Senior Azure Data Engineer, you will utilize Azure technologies to facilitate data transformation, analytics, and machine learning. Your primary responsibility will involve designing scalable Databricks data pipelines using PySpark to convert raw data into actionable insights. Additionally, you will be tasked with constructing, deploying, and managing machine learning models using MLlib or TensorFlow, all while optimizing cloud data integration from various Azure sources such as Blob Storage, Data Lake, and SQL/NoSQL databases. Your role will also encompass executing large-scale data processing using Spark Pools and fine-tuning configurations for efficiency. Key Responsib...

Eviden, part of the Atos Group, with an annual revenue of circa 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital, cloud, data, advanced computing and security, it brings deep expertise for all industries in more than 47 countries. By uniting unique high-end technologies across the full digital continuum with 47,000 world-class talents, Eviden expands the possibilities of data and technology, now and for generations to come. Roles and Responsibility The Senior Tech Lead - Databricks leads the design, development, and implementation of advanced data solutions. Has To ha...

Role Overview: You will be responsible for designing, implementing, and maintaining ETL processes using ADF and ADB. Your role will involve creating and managing views in ADB and SQL to ensure efficient data access. Additionally, you will optimize SQL queries for large datasets and high performance. Conducting end-to-end testing and impact analysis on data pipelines will also be a part of your responsibilities. Key Responsibilities: - Identify and resolve bottlenecks in data processing to ensure smooth operation of data pipelines. - Optimize SQL queries and Delta Tables to achieve fast data processing. - Implement data sharing methods such as Delta Share, SQL Endpoints, and utilize Delta Tab...

About GyanSys Inc. GyanSys Inc. is a leading global systems integrator headquartered in the U.S., specializing in SAP, Salesforce, Microsoft, and ServiceNow solutions. With over 2,000 consultants worldwide and 300+ enterprise clients, GyanSys is at the forefront of delivering digital transformation and business process automation across industries. Our India delivery centers in Bengaluru, Hyderabad, and Pune play a critical role in driving global implementations for Fortune 500 companies. At GyanSys, youll find a collaborative culture, cutting-edge projects, continuous learning opportunities , and the ability to make a real impact . Job Title: Databricks Consultant Experience: 3-5 Years Loca...

We are looking for energetic, self-motivated and exceptional Data engineer to work on extraordinary enterprise products based on AI and Big Data engineering leveraging AWS/Databricks tech stack. He/she will work with star team of Architects, Data Scientists/AI Specialists, Data Engineers and Integration. Skills and Qualifications: 5+ years of experience in DWH/ETL Domain; Databricks/AWS tech stack 2+ years of experience in building data pipelines with Databricks/ PySpark /SQL Experience in writing and interpreting SQL queries, designing data models and data standards. Experience in SQL Server databases, Oracle and/or cloud databases. Experience in data warehousing and data mart, Star and Sno...

Design, build, and maintain scalable and efficient data pipelines using Azure services such as Azure Data Factory (ADF), Azure Databricks, and Azure Synapse Analytics. Develop and optimize ETL/ELT workflows for ingestion, cleansing, transformation, Required Candidate profile 5-10 years of overall experience in Data Engineering with a minimum of 5 years in Azure-based data projects. Strong understanding of data warehouse architecture, data lakes, and big data frameworks

Responsibilities As a Databricks Data Engineer, you will: Design, construct, install, test, and maintain highly scalable data management systems using Azure Databricks. Develop data processing pipelines using Databricks Notebooks, Spark SQL, and other Databricks utilities. Integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB. Ensure optimal performance of data processing and extraction, transformation, and loading (ETL) processes. Collaborate with data architects to implement effective data models and schemas within the Databricks environment. Monitor data reliability, efficiency, and quality, and implement improv...

3+ years of relevant experience in Pyspark and Azure Databricks Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources Good experience in SQL or native SQL query languages Strong experience in implementing Databricks notebooks using Python Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Azure functions Experience in SSIS/ETL transformation processes Experience in Azure DevOps and CI/CD deployments DP-203 certification Loation : Chennai,Hyderabad,Bengaluru,Pune