2919 Data Bricks Jobs - Page 13

Job Summary: We are seeking a highly skilled and experienced Lead Data Engineer to join our data engineering team. The ideal candidate will have a strong background in designing and deploying scalable data pipelines using Azure technologies, Spark, Flink, and modern data lakehouse architectures. This role demands hands-on technical expertise, leadership in managing offshore teams, and a strategic mindset to drive data-driven decision-making across financial and regulatory domains Key Responsibilities: Design, develop, and deploy scalable batch and streaming data pipelines using PySpark, Flink, Scala, SQL, and Redis. Lead migration of complex on-premise workflows to Azure cloud ecosystem (Dat...

Role: Data Engineer Experience: 4 - 6 years Location: Coimbatore Job Type: Full Time Mode of work: Hybrid (Weekly 2 days WFO) Notice period: Immediate Mandatory Skills Required: Python, PySpark, AWS, Data Bricks, SQL. Job Description: Roles and Responsibilities: Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift. Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability. Collaborate on the design of scalable and resilient data architectures in AWS. Develop and manage infrastructure as code using Terraf...

Senior Software Engineer JLL Technologies, Bangalore We are seeking an experienced Backend Developer with strong expertise in the Java ecosystem to join our team. This role requires a solid technical foundation in building scalable, distributed systems and will involve working with building management systems while supporting our production environment across global time zones. Key Responsibilities Design, develop and maintain backend services with a focus on API development and WebSocket implementations that can handle heavy traffic and scale efficiently Build robust, scalable Java applications using Spring Boot, Spring Framework, and related technologies Develop and deploy microservices in...

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Your Role Experience with Azure Data Bricks, Data Factory Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics Experience in Python/Pyspark/Scala/Hive Programming. Experience with Azure Databricks/ADB Experience with building CI/CD pipelines in Data ...

Your Role Design, develop, and optimize data pipelines and ETL processes on Snowflake Cloud Data Warehouse. Implement best practices for performance tuning, query optimization, and data modeling in Snowflake. Manage integrations with various data sources and ensure secure, scalable data flow. Azure data factory , Data Bricks, Python, Spark, Pyspark , SQL , ETL process Works in the area of Software Engineering, which encompasses the development, maintenance and optimization of software solutions/applications.1. Applies scientific methods to analyse and solve software engineering problems.2. He/she is responsible for the development and application of software engineering practice and knowledg...

Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the worlds leading data-rich organizations across sectors such as CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges. Our global team specializes in cloud data modernization, predictive analytics, generative AI, and DataOps, supported by 10+ delivery centers and innovation hubs, including a major global presence in Bengaluru and operations across the USA, Canada, UK, Netherlands, Poland, Singapore, and India. Recognized as a leader in the data and analytics space, Sigmoid is backed by Peak XV Partn...

Relevant and Total years of experience Relevant 7+ years, Total 8+ years Detailed job description - Skill Set: Databricks , AWS, Python/PySpark, Informatica Qualifications: 7+ years of experience in Databricks, AWS, Python/PySPark as primary skill and 5+ years in Informatica as Secondary.. Proficiency in Databricks, Python, AWS Strong knowledge of Databricks, Python, AWS. Experience with ETL processes and cloud platforms. Excellent problem-solving and leadership skills. Technical Leadership: Guide and mentor teams in designing and implementing Databricks solutions. Architecture & Design: Develop scalable data pipelines and architectures using Databricks Lakehouse. Data Engineering: Lead the ...

Role & responsibilities Bachelor's degree in Computer Science, Computer Engineering, Technology, Information Systems (CIS/MIS), Engineering or related technical discipline, or equivalent experience/training 5-7 years software solution development using agile, DevOps, operating in a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions 5-7 years data analytics experience using SQL 5-7 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI. Combination of Develo...

We are seeking an experienced AI Lead with a minimum of 10 years of industry experience in the field of Artificial Intelligence. The ideal candidate will have a proven track record of successfully leading and delivering multiple projects in Machine Learning, Deep Learning, and Natural Language Processing (NLP). Additionally, they should possess sound knowledge in Generative AI and Large Language Models (LLMs). Responsibilities: Project Leadership: Lead end-to-end AI projects, from conception to delivery, ensuring alignment with business objectives and stakeholder requirements. Technical Expertise: Serve as a subject matter expert in AI, providing guidance and support to the team in the devel...

Job Summary We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our dynamic team. The ideal candidate will have expertise in Python Databricks SQL Databricks Workflows and PySpark. This role operates in a hybrid work model with day shifts offering the opportunity to work on innovative projects that drive our companys success. Responsibilities Develop and maintain scalable data processing systems using Python and PySpark to enhance data analytics capabilities. Collaborate with cross-functional teams to design and implement Databricks Workflows that streamline data operations. Optimize Databricks SQL queries to improve data retrieval performance and ensure ef...

We are seeking a highly skilled Data Engineer with strong expertise in Databricks, ETL processes, Azure Cloud, and Python to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and architectures to support our data-driven initiatives. Key Responsibilities: Design and Develop Data Pipelines: Create and optimize scalable data pipelines on Databricks to process and analyze large datasets. ETL Processes: Implement and manage ETL processes to ensure data is accurately extracted, transformed, and loaded from various sources ,DLT Framework: Utilize the Delta Live Tables (DLT) framework to build reliable, maintainable, and...

Job Title: Hybrid Data Engineer Databricks Focus Location: Hybrid (Remote + Onsite as needed) Job Type: Full-Time About the Role: We are looking for a skilled Data Engineer with strong hands-on experience in Databricks and data pipeline development. The ideal candidate will have a solid understanding of data validation, enrichment, and transformation processes, with exposure to business intelligence tools like Power BI as a plus. Youll be part of a team working on complex, enterprise-scale data initiatives focused on spend analytics and reporting. Key Responsibilities: Develop, maintain, and optimize data pipelines in Databricks . Validate and reconcile SAP-derived spend data from the Data L...

Job Summary We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our dynamic team. The ideal candidate will have expertise in Python Databricks SQL Databricks Workflows and PySpark. This role operates in a hybrid work model with day shifts offering the opportunity to work on innovative projects that drive our companys success. Responsibilities Develop and maintain scalable data processing systems using Python and PySpark to enhance data analytics capabilities. Collaborate with cross-functional teams to design and implement Databricks Workflows that streamline data operations. Optimize Databricks SQL queries to improve data retrieval performance and ensure ef...

Job Summary We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks Unity Catalog Azure Data Lake Store Azure DevOps Python Databricks SQL Databricks Workflows and PySpark. Experience in Data Management Hedge Fund Accounting and Account Management is a plus. This hybrid role requires working during the day shift with no travel obligations. Responsibilities Develop and maintain scalable data solutions using Databricks Unity Catalog and Azure Data Lake Store to enhance data accessibility and security. Collaborate with cross-functional teams to integrate Azure DevOps into the development lifecycle ens...

Job Summary We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks Unity Catalog Azure Data Lake Store Azure DevOps Python Databricks SQL Databricks Workflows and PySpark. Experience in Data Management Hedge Fund Accounting and Account Management is a plus. This hybrid role requires working during the day shift with no travel obligations. Responsibilities Develop and maintain scalable data solutions using Databricks Unity Catalog and Azure Data Lake Store to enhance data accessibility and security. Collaborate with cross-functional teams to integrate Azure DevOps into the development lifecycle ens...

Work Flexibility: Hybrid What will you do: Leads discussions with key stakeholders to ensure that key business questions and problems are well defined and understood Assists or leads the design, development and delivery of data sets/solutions to help meet business objectives Design, build, maintain data pipelines that procure, transform and structure data from multiple systems into a format that can be easily used by downstream users in the data lake, Proficiency with Delta Format for data engineering workloads , leads ETL processes to develop data models and have them available within the appropriate application to be utilized by data analytics function and business users, manage the implem...

Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role 12 – 15 Years of relevant experience on Big Data Platforms / Databricks / Data Fabric. Hands on experience in the area of Data Platforms (DwH / Datalake) like Cloudera / Databricks / MS Data Fabric / Teradata / Apache Hadoop / BigQuery / AWS Big Data Solutions (EMR, Redshift, Kinesis) / Qlik etc. Strong understanding of data modelling and datab...

We are seeking a proactive and detail-oriented MIS Automation Analyst / Developer to join our data-driven MIS team. The ideal candidate will be responsible for automating data workflows, building and maintaining interactive dashboards, and optimizing reporting systems that support critical business decisions across various departments. Roles & Responsibilities: 1. MIS & Reporting Automation Design, develop, and automate daily/weekly/monthly MIS reports using Power BI , SQL , Python , and Databricks . set up automated alerts and job scheduling to support near real-time for management reporting. 2. Dashboard Development Create interactive Power BI dashboards tailored for leadership and operati...

Role Overview: At PwC, you will be part of the managed services team focusing on outsourced solutions and providing support to clients across various functions. Your role will involve helping organizations streamline operations, reduce costs, and enhance efficiency by managing key processes and functions. You will leverage your skills in project management, technology, and process optimization to deliver high-quality services to clients. Specifically, as a Data Engineer Offshore, you will play a crucial role in designing, implementing, and maintaining scalable data pipelines and systems to support data-driven initiatives. Key Responsibilities: - Design, develop, and maintain scalable ETL pip...

Key Responsibilities Lead and mentor a team of data engineers, providing technical guidance, performance feedback, and career development. Architect, develop, and maintain scalable ETL/ELT pipelines using AWS services , PySpark , SQL , and Python . Drive the design and implementation of robust data models and data warehouses/lakes to support analytics and reporting. Ensure data quality, security, and governance across all stages of the data lifecycle. Collaborate with product and engineering teams to integrate data solutions into production environments. Optimize data workflows and performance across large, complex datasets. Manage stakeholder relationships and translate business needs into ...

Data and Analytics Supervisor RSM is seeking a highly skilled and experienced Data and Analytics Supervisor to join our India team. The ideal candidate will have a strong background in data engineering, data modeling, data transformation, storage design, and modern cloud architecture . This role requires excellent leadership skills along with hands-on technical expertise in Microsoft Data Platform and Snowflake . The Supervisor will oversee the design, development, and delivery of enterprise data solutions, ensuring efficient use of Microsoft data services and Snowflake for storage, transformation, and analytics. Responsibilities Collaborate with cross-functional teams, including data scient...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing streaming pipelines Exp...

Identifying business problems, understand the customer issue and fix the issue. Evaluating reoccurring issues and work on for permanent solution Focus on service improvement. Troubleshooting technical issues and design flaws Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise BE / B Tech in any stream, M.Sc. (Computer Science/IT) / M.C.A, with Minimum 3-5 years of experience Azure IAAS, PASS & SAAS services expert and Handson experience on these and below all services. VM, Storage account, Load Balancer, Application Gateway, VNET, Route Table, Azure Bastion, Disaster Recovery, Backup, NSG, Azure update manager, Key Vault etc....

Identifying business problems, understand the customer issue and fix the issue. Evaluating reoccurring issues and work on for permanent solution Focus on service improvement. Troubleshooting technical issues and design flaws Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise BE / B Tech in any stream, M.Sc. (Computer Science/IT) / M.C.A, with Minimum 3-5 years of experience Azure IAAS, PASS & SAAS services expert and Handson experience on these and below all services. VM, Storage account, Load Balancer, Application Gateway, VNET, Route Table, Azure Bastion, Disaster Recovery, Backup, NSG, Azure update manager, Key Vault etc....

About The Role We are seeking a highly skilled and experienced Delivery Solution Architect with deep expertise in Industrial IoT (IIoT), Cloud Data Platforms, and AI/Analytics to lead the design and delivery of smart factory solutions under the Industry 4.0 paradigm. This role will be instrumental in driving digital transformation initiatives for manufacturing clients by architecting scalable, secure, and intelligent solutions that integrate operational technology (OT) with information technology (IT). Your Profile Over 10+ years of experience, including 3+ years Delivery Solution Architect IIoT, Cloud Data & AI Analytics Excellent communication, documentation, and stakeholder management ski...