4706 Data Bricks Jobs

Job Description We are looking for an experienced Solution Architect with a strong background in Databricks and enterprise data management. The ideal candidate will have extensive experience designing and implementing scalable data solutions using Databricks Unity Catalog , ensuring data governance, security, and performance across analytics platforms. Key Responsibilities Lead the design and implementation of Databricks-based data solutions aligned with business and compliance requirements. Manage Unity Catalog , including tagging, lineage, and access control for data governance. Develop strategies for KPI anonymization , data extraction , and secure data sharing. Collaborate with cross-fun...

Once you join our team you will have the opportunity to Access experts across industries for maximum learning opportunities including Weekly Knowledge Sharing Sessions, LinkedIn Learning, and more. Gain exposure to a rich variety of research techniques from knowledgeable professionals. Enjoy a remote first/hybrid work environment with a flexible schedule. Obtain insights into the needs and challenges of your clientsto learn how the worlds leading brands use research. Experience peace of mind working for a company with a commitment to conducting research ethically. Build lasting relationships with fun colleagues in a culture that values each person Position Specifications: Should have 6+ year...

Role & responsibilities Must Have Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark Proficient with Databricks & Python Senior developers with Full Database/ Datawarehouse/ DataMart development capabilities Senior SME with SQL Server required. Proficiency with standard file formats and markup language technology such as JSON, XML, XSLT. Proficiency with Azure Cloud data environments highly desired. Excellent verbal communication skills. Good problem-solving skills. Attention to detail. Proficiency with Data Warehousing principals and design Nice to have Familiarity with oDa...

enior Data Engineer (Azure/Databricks) Overview We are seeking a Senior Data Engineer with 5+ years of hands-on experience in building and scaling data solutions within the Azure ecosystem . The ideal candidate will have deep expertise in Databricks , PySpark , and modern data lake architectures , and be adept at designing robust ETL pipelines and data workflows. Key Responsibilities Design, develop, and maintain scalable data pipelines using Azure and Databricks . Build efficient data ingestion and transformation workflows with PySpark and Delta Lake . Develop, optimize, and maintain ETL/ELT pipelines using Python and SQL . Implement data modeling , data quality , and governance best practi...

Role & responsibilities JOB DESCRIPTION Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related te...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role: Sr AWS Data engineer - Data Migration Experience: 6+ years Location: Hyderabad Fission Labs , headquartered in Sunnyvale, with offices in Dallas & Hyderabad, Fission Labs is a leading software development company, specializing in crafting flexible, agile, and scalable solutions that propel businesses forward. With a comprehensive range of services, including product development, cloud engineering, big data analytics, QA, DevOps consulting, and AI/ML solutions, we empower clients to achieve sustainable digital transformation that aligns seamlessly with their business goals. Responsibilities Experience leading and driving large scale data migration projects Experience in working with all...

Role: Data Engineer Experience: 5-10 Years Location: Bannerghatta Road, Bangalore Work Mode: Onsite (5 days a week) Notice Period: Immediate Joiners Preferred Key Skills: Databricks, PySpark Responsibilities: Develop, optimize, and maintain scalable data pipelines using Databricks and PySpark . Manage data integration, transformation, and loading from multiple sources. Ensure data quality, reliability, and performance across platforms. Collaborate with data scientists and analysts to support analytical models and dashboards. Troubleshoot issues and provide production-level data support. Requirements: 510 years of hands-on experience in data engineering . Strong programming experience with Py...

Role & responsibilities Preferred candidate profile

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc with coding skills in Python PySpark and SQL. Works independently and demonstrates proficiency in at least one domain related to data with a solid understanding of SCD concepts and data warehousing principles. Outcomes: Collaborate closely with data analysts data scientists and other stakeholders to ensure data accessibility quality and security across various data sources.rnDesign develop and maintain data pipelines...

Were looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks. You’ll turn requirements into production-grade ELT/ETL jobs, Delta Lake tables, and reusable components that speed up our teams. In this role, you’ll implement and improve reference patterns, optimize Spark for performance and cost, apply best practices with Unity Catalog and workflow orchestration, and ship high-quality code others can build on. If you love solving data problems at scale and empowering teammates through clean, well-documented solutions, you’ll thrive here. Bachelor’s degree in computer science, Engineering, or a related field 5+ years of experience in software/data engineerin...

Responsibilities: Design, develop & maintain data pipelines using Azure Data Factory & SQL. Optimize performance through data modeling & query optimization. Scala Gradle is mandatory, please don't apply if you don't have experience.

Scala Data Engineer Location :Bangalore/ Chennai / Delhi / Pune CompanyName :Persistence Experience :5-8Years NoticePeriod:Imm- 15 Days About The Role : :Scala Data Engineer Must Have :Spark,Data Bricks,Azure,Azure Data,SQL,Services,Databricks, Data Migration,Azure Data Catalog,Azure DevOps,Data Catalog,DevOps,Scala Sr. Data Engineer - Scala Summary Analyzes, designs, develops, tests, and modifies new and existing applications in areas such as Database or analytics development, and data integrations. Provides system support, testing, and training for Enterprise Data Lake clinical data. Proven 4-6 years work experience as an Azure Data engineer/Developer or similar role. Strong knowledge in S...

Description Job Summary Role Value Proposition MetLife Data & Analytics organization is the team of expert technologists responsible for building big data platforms and data services with innovative technologies to enable MetLife businesses to generate insights and value to its customers. The team is the center of excellence in data engineering in MetLife and plays a key role in data enablement through multiple data stores supporting different kind of analytical use cases to be able to derive predictive prescriptive and descriptive insights. The Azure Data Engineer III serves as big data development expert within the data analytics engineering organization of MetLife Data & Analytics. This p...

Description Key Responsibilities Analyse raw data from various source files (e.g. EXCEL CSV JSON XML Parquet etc.) to identify formatting issues inconsistencies missing values and discrepancies. Use PySpark to transform clean and restructure source data to match the expected format for further processing and analysis. Apply data validation rules and data quality checks to correct issues related to data integrity including handling null values duplicate records and data type mismatches. Develop PySpark jobs to transform raw data into standardized formats (e.g. converting date formats normalizing text fields correcting encoding issues). Ensure that data transformations meet the required schema...

Job description Must have 5+ years for experience B2 and 8+ years for experience for B3 of in ETL Testing Experience on Snowflake, data bricks, Azure Cloud and DWH Must have hands on experience in complex SQL queries Analyses and understand the Business requirements and ability to convert that to test cases of functional and non-functional components Identification, Preparation, documentation, and execution of Smoke, functional, non-functional, Automation Regression and E2E test cases Experience of working in agile teams, where to collaborate with PO, developers, and testers Adaptive team player who can be flexible to work on an aggressive timeline as an Individual contributor and as well as...

Data Support Engineer Location: Bangalore Experience 6+yrs Rate 30 LPA AMVikas POC:Swati Patil Key Responsibilities: Database Development & Support: Write and optimize SQL queries, stored procedures, and views for data retrieval and transformation. Develop and maintain data pipelines to support business intelligence and analytics requirements. Support SQL Server and Amazon Redshift environments for data storage, transformation, and analytics. Ensure data integrity, security, and quality across all database solutions. Operational Support: Monitor ETL logs and troubleshoot data pipeline issues to minimize downtime. Perform data validation and reconciliation to ensure data accuracy. Maintain Ex...

Databricks and Bigdata Client persistent Role; C2H AMVikas Exp8+ years Budget:30 LPA Location POC:Swathi Patil About The Role 1.Mandatory Skills - Big Data, Data Bricks, SQL, Python, Databricks Sr Data Engineer JD as below-Must have 8+ years of total experience. Hands-on experience in SQL, Python, Pyspark, AWS Databricks. Good knowledge of Big Data, Data Warehousing concepts. Good knowledge of GIT, CI/CD Customer-focused, react well to changes, work with teams and able to multi-task. Must be a proven performer and team player that enjoy challenging assignments in a high-energy, fast growing and start-up workplace. Must be a self-starter who can work well with minimal guidance and in fluid en...

JR REQ --Azure Data Bricks, Pyspark--- 3-6years -- All persis locations---Vaishali Rai Location - Chandigarh,Dadra & Nagar Haveli,Daman,Diu,Goa,Haveli,Jammu,Lakshadweep,Nagar,New Delhi,Puducherry,Sikkim

6+ yrs. of total exp. and 5+ yrs. in Azure Databricks technologies. Good understanding of ETL , BI and DW technologies. Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Work together with data scientists and analysts to understand the needs for data and create effective data workflows. Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. Utilizing Azure Data Bricks to create and maintain ETL (Extract, Transform, Load) operations. Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. Improve the scalability, ...

Description: Primary Skill - Platform Engineer, Data Bricks, Azure data platform, infra support Main 3 competence needed in Primary Skills - Platform Engineer, Data Bricks, Azure data platform Platform Engineer, Data Bricks, Azure data platform

Job Profile: The Data Engineer builds and maintains the data pipelines, transformations, and integrations thatpower AI-ready analytics on Microsoft Fabric and the Azure data ecosystem. This is a hands-on, delivery-focused role responsible for implementing data architectures, optimizing performance, and enabling analytics and AI use cases through well-designed, secure, and scalable data pipelines.You will work across the Bronze Silver Gold layers of Fabric to build ingestion, transformation, and curation pipelines that support business intelligence and AI-driven workloads.. Key Responsibilities: Own and deliver Fabric pipelines: Build, optimize, and maintain ingestion, transformation, and cur...

When our values align, there's no limit to what we can achieve. At Parexel, we all share the same goal - to improve the world's health. From clinical trials to regulatory, consulting, and market access, every clinical development solution we provide is underpinned by something special - a deep conviction in what we do. Each of us, no matter what we do at Parexel, contributes to the development of a therapy that ultimately will benefit a patient. We take our work personally, we do it with empathy and we're committed to making a difference. Key Responsibilities : Architect and implement end-to-end data pipelines using Azure Data Factory, Databricks, and Snowflake for large-scale data ingestion...

Job Title: Data Engineer Pharma/Life Sciences Domain Company: Indegene (Client Location) Experience: 5–10 Years Location: Bangalore (Onsite/Hybrid) Employment Type: Full-Time Industry: Healthcare / Pharma / Life Sciences Job Description We are looking for a highly skilled Data Engineer with strong experience in data engineering technologies and a solid understanding of the Healthcare/Pharma/Life Sciences domain . The ideal candidate will be responsible for designing, building, and optimizing end-to-end data pipelines that support analytics, insights, and data-driven decisions. Roles & Responsibilities Design, develop, and maintain scalable data pipelines, ETL workflows, and data integration ...

Role Overview We are seeking a Data Analyst/Engineer to join our global Data & Insights team. This role is critical to advancing our value creation across our global company based on data and AI. The ideal candidate combines strong engineering skills with curiosity for understanding business requirements and passion for leveraging the latest advances in Microsoft Azure and Databricks technology. This position offers the opportunity to work at the intersection of business and data engineering, and cutting-edge AI. Working on top of the Common Data Platform (CDP) foundation, this team ensures that insights are turned into action and value is realized. Key Responsibilities Design, implement, an...