2919 Data Bricks Jobs - Page 12

Job Title: Lead Data Engineer Location: Pune Job Type: Full-Time About TVARIT TVARIT GmbH specializes in developing and delivering cutting-edge artificial intelligence (AI) solutions for the metal industry, including steel, aluminum, copper, cast iron, and more. Our software products empower customers to make intelligent, data-driven decisions, driving advancements in Predictive Quality (PsQ), Predictive Maintenance (PdM), and Energy Consumption Reduction (PsE), etc. With a strong portfolio of renowned reference customers, state-of-the-art technology, a talented research team from prestigious universities, and recognition through esteemed awards such as the EU Horizon 2020 AI Prize, TVARIT i...

Role Purpose The purpose of the role is to create exceptional architectural solution design and thought leadership and enable delivery teams to provide exceptional client engagement and satisfaction. Do 1.Develop architectural solutions for the new deals/ major change requests in existing deals Creates an enterprise-wide architecture that ensures systems are scalable, reliable, and manageable. Provide solutioning of RFPs received from clients and ensure overall design assurance Develop a direction to manage the portfolio of to-be-solutions including systems, shared infrastructure services, applications in order to better match business outcome objectives Analyse technology environment, enter...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Overview: In this role at Kimberly-Clark, you will play a pivotal part in designing and building analytics solutions to facilitate informed decision-making. Your primary responsibility will be to design, develop, and maintain analytics solutions working closely with various R&D and DTS technology teams. By leveraging your professional expertise and talent, you will contribute to delivering better care for billions of people worldwide. Key Responsibilities: - Collaborate with engineering and architecture teams to identify, collect, and harmonize data from various sources. - Design and develop ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) pipelines using technologies s...

We are looking for a skilled Data Engineer with experience in Python, SQL, Databricks, Apache Spark , and Microsoft Azure . You will be responsible for building scalable data pipelines, optimizing data workflows, and supporting analytics initiatives on the Azure cloud platform. Key Skills: Strong Python and SQL programming Databricks & Apache Spark for big data processing Azure Data Lake, Data Factory, and other Azure services Data pipeline development and optimization Experience with ETL/ELT processes and large-scale data systems

Design and implement scalable data processing solutions usingApache SparkandJava. Develop and maintain high-performance backend services and APIs. Collaborate with data scientists, analysts, and other engineers to understand data requirements. Optimize Spark jobs for performance and cost-efficiency. Ensure code quality through unit testing, integration testing, and code reviews. Work with large-scale datasets in distributed environments (e.g., Hadoop, AWS EMR, Databricks). Monitor and troubleshoot production systems and pipelines. Experience in Agile Development Process. Excellent communication skills, problem solving and debugging and troubleshooting Skills. Mandatory Competencies Architect...

Professional Experience / Qualifications 8 - 10 years prior experience in Java, spring boot, SQL, REST APIS. Must be hands on! Hands on experience on Java 11+. Atleast 2-3 years of experience/exposure on Spark SQL, Containerization like Docker Nice to have Databricks on AWS, Glue, EMR. S3 Excellent Analytical skills and quick to turn around on issues Must be aware of design principles, patterns in software. Great interpersonal and communication skills Financial services domain is preferred and any knowledge to Market risk technology will be a great advantage. Education Qualification : B.Tech or MCA Mandatory Competencies Programming Language - Java - Core Java (java 8+) Middleware - Java Mid...

We are seeking a skilled and experienced Machine Learning Engineer to join our team.The ideal candidate will have a strong background in Python and PyTorch, along with 4-8 years of experience deploying ML/AI models to production. This role requires excellent analytics skills and a good working knowledge of Databricks. You will work closely with data scientists, clinicians, software engineers, and product teams to design, build, and optimize scalable machine learning solutions. Role & responsibilities Develop, train, and optimize machine learning models using PyTorch and other ML frameworks. Deploy and maintain ML models in production environments, ensuring scalability, performance, and relia...

Educational Requirements Bachelor of Engineering,BSc,BCA,MCA,MSc,MTech Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion • As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. • You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. • You will play a key role in the overall estimation of work requirements to provide the right information on project estimations to Techno...

Overview Data Science Team works in developing Machine Learning (ML) and Artificial Intelligence (AI) projects. Specific scope of this role is to develop ML solution in support of ML/AI projects using big analytics toolsets in a CI/CD environment. Analytics toolsets may include DS tools/Spark/Databricks, and other technologies offered by Microsoft Azure or open-source toolsets. This role will also help automate the end-to-end cycle with Azure Pipelines. You will be part of a collaborative interdisciplinary team around data, where you will be responsible of our continuous delivery of statistical/ML models. You will work closely with process owners, product owners and final business users. Thi...

About the Opportunity Job TypeApplication 31 July 2025 TitlePrincipal Data Engineer (Associate Director) DepartmentISS LocationBangalore Reports ToHead of Data Platform - ISS Grade 7 Department Description ISS Data Engineering Chapter is an engineering group comprised of three sub-chapters - Data Engineers, Data Platform and Data Visualisation that supports the ISS Department. Fidelity is embarking on several strategic programmes of work that will create a data platform to support the next evolutionary stage of our Investment Process.These programmes span across asset classes and include Portfolio and Risk Management, Fundamental and Quantitative Research and Trading. Purpose of your role Th...

ADB- DE: Primary: Azure, Databricks,ADF, Pyspark/Python Secondary:Datawarehouse, Must Have 10+ Years of IT experience in Datawarehouse and ETL Hands-on data experience on Cloud Technologies on Azure, ADF, Synapse, Pyspark/Python Ability to understand Design, Source to target mapping (STTM) and create specifications documents Flexibility to operate from client office locations Able to mentor and guide junior resources, as needed Nice to Have Any relevant certifications Banking experience on RISK & Regulatory OR Commercial OR Credit Cards/Retail"

As a Software Developer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys. Your primary responsibilities include: Proficient Software Development with Microsoft TechnologiesDemonstrate expertise in software development using Microsoft technologies, ensuring high-quality code and efficient application performance. Collaborative Problem-Solving and Stakeholder EngagementCollaborate effectively with stakeholders to understand product requirements and challenges, proactively addressing issues through analytical problem-solving and str...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Purpose The purpose of the role is to create exceptional architectural solution design and thought leadership and enable delivery teams to provide exceptional client engagement and satisfaction. Do 1.Develop architectural solutions for the new deals/ major change requests in existing deals Creates an enterprise-wide architecture that ensures systems are scalable, reliable, and manageable. Provide solutioning of RFPs received from clients and ensure overall design assurance Develop a direction to manage the portfolio of to-be-solutions including systems, shared infrastructure services, applications in order to better match business outcome objectives Analyse technology environment, enter...

Position Description: Founded in 1976, CGI is among the world's largest independent IT and business consulting services firms. With 94,000 consultants and professionals globally, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services, and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68billion, and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more atcgi.com....

SUMMARY Role: Python/Data Engineer: Level Expected: 4-9 yrs Must Haves: 1. Good analytical and problem-solving skills. 2. Good hands-on experience in developing Python programs with Python 3.10 version 3. Familiarity with Python frameworks Django, Flask etc. 4. Good knowledge of Database technologies like RDBMS, MongoDB, Hibernate etc. 5. Good knowledge of REST API, creation and consumption 6. Basic knowledge of AWS services - EC2, S3, Lambda function, ALB 7. Familiarity with Git, JIRA and other dev tools Good to have: 1. Hands on experience with AWS services, mainly Lambda function creation. 2. Basic knowledge of Databricks

About Koantek: Koantek is a Databricks Pure-Play Elite Partner, helping enterprises modernize faster and unlock the full power of Data and AI. Backed by Databricks Ventures and honored as a six- As time Databricks Partner of the Year, we enable global enterprises to modernize at speed, operationalize AI, and realize the full value of their data. Our deep expertise spans industries such as healthcare, financial services, retail, and SaaS, delivering end-to-end solutions from rapid prototyping to production-scale AI deployments. We deliver tailored solutions that enable businesses to leverage data for growth and innovation. Our team of experts utilizes deep industry knowledge combined with cut...

Role & responsibilities : Create and manage robust data ingestion pipelines leveraging Databricks, Airflow, Kafka, and Terraform. Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines. Develop data processing workflows using Databricks, Delta Lake, and Spark technologies. Maintain and improve the Data Lakehouse, utilizing Unity Catalog for efficient data management and discovery. Construct automation, frameworks, and enhanced tools to streamline data engineering workflows. Collaborate across teams to facilitate smooth data flow and integration. Enforce best practices in observability, data governance, security, and regulatory compliance Preferred candi...

SUMMARY Job Summary We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams. Key Responsibilities Develop and optimize scalable PySpark applications on Databricks. Work with AWS services (S3, EMy, Lambda, Dlue) for cloud-native data processing. Integrate streaming and batch data sources, especially using Kafka. Tune Spark jobs for performance, memory, and compute efficiency. Collaborate with DevOps, product, and analytic...

Core skills required for the role : Databricks Level: Advanced SQL (MSSQL Server) Joins, SQ optimization, basic knowledge of StoredProcedure, Functions PySpark Level: Advanced Azure Delta lake Python Basic Mandatory Competencies Big Data - Big Data - Pyspark Data Science and Machine Learning - Data Science and Machine Learning - Databricks Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight Database - Sql Server - DBA Data Science and Machine Learning - Data Science and Machine Learning - Python