4749 Data Bricks Jobs - Page 23

Job description- Databricks Years of Experience- 7-11 years Location- Bangalore Job Summary: We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. You'll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity Catalog. Key Responsibilities: Design and implement ETL/ELT pipelines using Databricks and PySpark. Work with Unity Catalog to manage data governance, access controls, lineage, and auditing across data assets. Develop high-performance SQL queries and optimize Spark jobs. Collaborate with data scientists, analysts, and business...

About the Role: We are looking for a skilled QA Engineer to join our agile development team and take ownership of quality across core components and cloud data warehouse platforms. If you're passionate about testing, automation, and data reliability , this is a great opportunity to work with modern technologies and complex systems. Experience with cloud data platforms like Snowflake, Redshift, Databricks, or BigQuery will be a strong plus. Youll work closely with data engineers and platform teams to build robust automated test frameworks that help us ensure scalable, reliable, and accurate systems . What Youll Do: Develop and implement test strategies for core services and data pipelines. Bu...

We are looking for a skilled QA Engineer to join our agile development team and take ownership of quality across core components and cloud data warehouse platforms. If you're passionate about testing, automation, and data reliability , this is a great opportunity to work with modern technologies and complex systems. Experience with cloud data platforms like Snowflake, Redshift, Databricks, or BigQuery will be a strong plus. Youll work closely with data engineers and platform teams to build robust automated test frameworks that help us ensure scalable, reliable, and accurate systems . What Youll Do: Develop and implement test strategies for core services and data pipelines. Build and execute ...

We are looking for a skilled QA Engineer to join our agile development team and take ownership of quality across core components and cloud data warehouse platforms. If you're passionate about testing, automation, and data reliability , this is a great opportunity to work with modern technologies and complex systems. Experience with cloud data platforms like Snowflake, Redshift, Databricks, or BigQuery will be a strong plus. Youll work closely with data engineers and platform teams to build robust automated test frameworks that help us ensure scalable, reliable, and accurate systems . What Youll Do: Develop and implement test strategies for core services and data pipelines. Build and execute ...

You will be work closely in a world class AI ML team comprised of experts in AI ML modeling, ML & LLMOps engineers, data science and data engineering teams. You will contribute to engineering and developing solutions for ML operations and be a critical part of leading S&Ps AI-driven transformation to drive value internally and for our customers. S&P is a leader in automation and AI/ML to transform risk management. This role is a unique opportunity for ML/MLOps engineers to grow into the next step in their career journey. Responsibilities and Impact: Lead ML Engineering to architect, build and deploy production grade GenAI services and solutions. Work on large-scale stateful and stateless dis...

Professional Experience Qualifications 8 - 10 years prior experience in Java, spring boot, SQL, REST APIS. Must be hands on! Hands on experience on Java 11+. Atleast 2-3 years of experience/exposure on Spark SQL, Containerization like Docker Nice to have Databricks on AWS, Glue, EMR. S3 Excellent Analytical skills and quick to turn around on issues Must be aware of design principles, patterns in software. Great interpersonal and communication skills Financial services domain is preferred and any knowledge to Market risk technology will be a great advantage. Education Qualification : B.Tech or MCA Mandatory Competencies Programming Language - Java - Core Java (java 8+) Middleware - Java Middl...

ADB with Pyspark design and development exp.

Job Purpose The Senior Data Engineer will be responsible for designing, building, and maintaining scalable and efficient data pipelines and architectures for the Enterprise Data Platform. This role will focus on enabling high-quality, reliable, and timely data access for analytics, reporting, and business decision-making. Working closely with business analysts, data scientists, and architects, the Senior Data Engineer will ensure data solutions meet business needs and adhere to best practices and governance standards Duties and Responsibilities Design and implement robust, scalable, and high-performance data pipelines and ETL/ELT processes. Develop, optimize, and maintain data architectures ...

Job Purpose This position is open with Bajaj Finance Ltd. Duties and Responsibilities Write efficient SQL queries to extract, transform, and load data Develop Python scripts for data processing, analysis, and automation Utilize Databricks to build scalable data pipelines and notebooks Collaborate with cross-functional teams to interpret data requirements Perform exploratory data analysis and generate actionable insights Maintain data integrity and troubleshoot issues in datasets Work within modern cloud environments (Azure, AWS, or GCP) Support initiatives involving AI/ML technologies and tools Recommend, document, and oversee policies and procedures to meet industry best practices and to me...

Technical Lead Data Engineering As a Technical Lead, you will be responsible in building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. This position reports to Engineering Manager. Responsibilities: Align Sigmoid with key Client initiatives Interface daily with customers across leading Fortune 500 companies to understand strategic requirements Connect with VP and Director level clients on a regular basis. Travel to client locations Ability to understand business requirements and tie them to technology solutions Facilitate in Technical Aspects Design, develop and evolve...

Job Overview Summary The Lead Data Architect is a strategic and technical leadership role responsible for architecting, scaling, and evolving enterprise-grade data platforms that enable advanced analytics, AI/ML, and data-driven decision-making. Reporting to the Senior Director of Data Platforms , this role will lead the design and governance of modern data architectures, drive innovation in AI orchestration, and ensure the delivery of secure, compliant, and high-performing data solutions. This position combines hands-on engineering expertise with architectural vision and cross-functional leadership. The Lead Data Architect will guide engineering teams, influence platform strategy, and estab...

The Principal Data Engineer will be a senior individual contributor responsible for designing, building, and optimizing advanced data solutions that power enterprise-wide analytics, AI/ML, and data-driven decision-making. Reporting directly to the Senior Director of Data Platforms, this role will serve as a technical expert and thought partner in scaling modern data architectures, enabling AI orchestration, and delivering robust, secure, and compliant data products. This position is highly hands-on, requiring expertise in data engineering, Databricks, Python, AI/ML platforms, and orchestration frameworks. The Principal Engineer will work across functional teams to design and implement high-p...

Data Services Architect to work and lead the design and implementation of data architecture solutions for a logistics enterprise. This role requires a good understanding of canonical architecture patterns, medallion (bronze-silver-gold) data architecture, and end-to-end data processing pipelines and enabling analytics-ready data from raw files stored in AWS S3, using Databricks as the core processing platform. The ideal candidate will collaborate closely with business stakeholders to understand domain knowledge. Key Responsibilities: Canonical Architecture Design Medallion Architecture Implementation (Databricks) Raw Data Mapping and Transformation : Build ingestion pipelines to process raw ...

Job Title: Data Engineer Location: Navi- Mumbai - Airoli Experience: 2 - 7 years Education: BE/B.Tech/BCA/MCA or equivalent in Computer Science or related field About GEP GEP is a global leader in digital supply chain transformation, delivering cloud-native software and AI-driven solutions that help enterprises operate efficiently, drive agility, and achieve sustainable growth. Our innovative products and consulting expertise empower the worlds leading organizations to optimize performance and build resilient supply chains. Key Responsibilities Strong ability to build and optimize Big Data data pipelines, architectures and datasets.Proficient in Python & PySpark Experience on atleast one Clo...

Role: Data Modeler Experience: 8-11 Years Relevant Experience in Data Modeler :8+ Years Notice Period: Immediate to 15 Days Joiners Only Role & responsibilities The Data Modeller designs fit-for-purpose conceptual, logical, and physical data models in-line with business requirements to serve analytical, business intelligence, and operational use cases primarily within the data platform. Technical skills: Entity relationship, dimensional, and NOSQL modelling as appropriate to data warehousing, business intelligence, and analytical approaches using IE or other common notations. SQL, DDL, DML, and Pyspark scripting ERWIN or Visio data modelling/UML tool(Mandatory to have) Ideally, Azure Data Fa...

Role: Engineer Required Technical Skill Set: AI/ML Experience: 5 to 10 Yrs Work Location: Hyd, Noida, Chennai, Mumbai Desired Competencies: Must-Have: AI/ML, Azure ML Studio, AI/ML On Databricks, Python & CICD Devops. Supervised and unsupervised ML and Predictive Analytics using Python Feature generation through data exploration and SME requirements Relational database querying Applying computational algorithms and statistical methods to structured and unstructured data Communicating results through data visualizations Programming Languages: Python, PySpark Big Data Technologies: Spark with PySpark Cloud Technologies: Azure (ADF, Databricks, Storage Account Usage, WebApp, Key vault, SQL Serv...

Job Overview Summary The Lead Data Architect is a strategic and technical leadership role responsible for architecting, scaling, and evolving enterprise-grade data platforms that enable advanced analytics, AI/ML, and data-driven decision-making. Reporting to the Senior Director of Data Platforms , this role will lead the design and governance of modern data architectures, drive innovation in AI orchestration, and ensure the delivery of secure, compliant, and high-performing data solutions. This position combines hands-on engineering expertise with architectural vision and cross-functional leadership. The Lead Data Architect will guide engineering teams, influence platform strategy, and estab...

The Principal Data Engineer will be a senior individual contributor responsible for designing, building, and optimizing advanced data solutions that power enterprise-wide analytics, AI/ML, and data-driven decision-making. Reporting directly to the Senior Director of Data Platforms, this role will serve as a technical expert and thought partner in scaling modern data architectures, enabling AI orchestration, and delivering robust, secure, and compliant data products. This position is highly hands-on, requiring expertise in data engineering, Databricks, Python, AI/ML platforms, and orchestration frameworks. The Principal Engineer will work across functional teams to design and implement high-p...

Job Role Overview Title : Senior Power BI Developer Key Responsibilities Design and maintain data pipelines using Microsoft Fabric Lakehouse, Pipelines, and Dataflows. Build analytics-ready datasets using SQL and PySpark. Develop dashboards and semantic models in Power BI. Integrate ERP and business systems into unified models. Ensure data quality, lineage, and compliance (e.g., GxP, 21 CFR Part 11). Collaborate with global stakeholders and data scientists. Use Azure DevOps for agile delivery and CI/CD. Provide production support and maintain documentation. Major Skills Required Microsoft Fabric Lakehouse architecture Pipelines and Dataflows Real-time analytics and OneLake integration DP-700...

We are looking for a highly skilled Technical Architect with expertise in Databricks to join our team at YASH Technologies Middle East. The ideal candidate will have a strong background in IT Services & Consulting and excellent technical skills. Roles and Responsibility Design and implement scalable data pipelines using Databricks. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data architectures. Ensure data quality and integrity through data validation and testing procedures. Provide technical guidance and support to junior team members. Participate in code reviews and contribute to the improvement of the overall co...

Job Title: Data Engineer Dataiku | Pharma / Life Sciences Domain Experience: 5+ Years Location: Hyderabad Employment Type: Full Time Work Mode: Onsite Job Description: We are seeking an experienced Data Engineer with expertise in Dataiku DSS and SQL , preferably from the Pharma / Life Sciences domain. The ideal candidate will design and manage scalable ETL / ELT pipelines , data integrations, and analytical workflows supporting clinical, research, and commercial data operations. Key Responsibilities: Develop, optimize, and maintain ETL/ELT pipelines using Dataiku and SQL-based transformations. Work with pharma and life sciences data — including clinical trials, patient data, drug safety, and...

Bachelor's degree in computer science, Information Systems, or other relevant subject area or equivalent experience ' 8-1O+ years of experience in the skills .net framework,.net core,asp.net, vb.net, html, web serv ce,web api,SharePoint,power automate,Microsoft apps,mysql,sqlserver Client and Server Architecture and maintain code base via GitHub would be added benefit Robost SQL knowledge such as complex nested queries,procedure and triggers Good to have skills from Data tools perspective :Pyspark,Athena,Databricks, AWS Redshift technologies to analyse and bring data into Data Lake.Knowledge of building reports and power Bl Good knowledge of business processes, preferably knowledge of relate...

At least 6-8 yrs of experience in ETL Testing with Automation Testing Expert in database testing using SQL. Must have worked on Databricks and aware of Databricks related concepts Check the data source locations and formats, perform a data count, and verify that the columns and data types meet the requirements. Test the accuracy of the data, and its completeness. Identify key ETL mapping scenarios and create SQL queries that simulate the scenarios. Should be able to develop and execute test plans, test cases, test scripts. Experience in writing complex SQL queries and validation of Enterprise Data Warehouse Applications Understanding of data model, ETL architecture, Data Warehouse concepts. ...

Hi, Greetings from the IDES LABS, Job Posting Title: Senior Platform Engineer Description: Bachelors degree (Computer Science), masters degree or Technical Diploma or equivalent At least 8 years of experience in a similar role At least 5 years of experience on AWS and/or Azure At least 5 years of experience on Databricks At least 5 years of experience on multiples Azure and AWS PaaS solutions: Azure Data Factory, MSSQL, Azure storage, AWS S3, Cognitive search, CosmosDB, Event Hub, AWS glue Strong knowledge of AWS and Azure architecture design best practices Knowledge of ITIL & AGILE methodologies (certifications are a plus) Experience working with DevOps tools such as Git, CI/CD pipelines, A...

We are looking for a skilled App DevOps professional with 5-10 years of experience to join our team. The ideal candidate will have expertise in Data Ingestion, Release Management, Monitorization, Incident Review, Databricks, Azure Cloud, and Data Analysis. Roles and Responsibility Implement and manage data ingestion processes to acquire data from various sources and ensure its accuracy and completeness. Collaborate with development and operations teams to facilitate the release management process, ensuring successful and efficient deployment of application updates and enhancements. Monitor application performance and health, promptly identifying and addressing any anomalies or potential issu...