4710 Data Bricks Jobs - Page 13

Skill: Pyspark + Databricks Experience : 6 to 9 Years Location : AIA - Gurgaon Job Summary We are seeking a highly skilled Technical Lead with 12 to 16 years of experience to join our dynamic team. The ideal candidate will have expertise in Databricks Workflows Unity Catalog and Databricks with a preference for experience in Research and Development. This hybrid role offers the opportunity to work on cutting-edge projects during day shifts with no travel required. Responsibilities Lead the design and implementation of scalable data solutions using Databricks Workflows to enhance data processing capabilities. Oversee the integration of Databricks Unity Catalog to ensure seamless data governan...

Skill: Azure Databricks Experience: 9 to 12 years Location: AIA-Gurgaon Job Summary As a Sr. Developer you will leverage your expertise in Databricks PySpark and AWS to drive innovative solutions in a hybrid work model. With 6 to 10 years of experience you will collaborate with cross-functional teams to enhance data processing capabilities and contribute to the companys mission of delivering impactful technology solutions. Responsibilities Develop and implement data processing solutions using Databricks and PySpark to optimize data workflows and improve efficiency. Collaborate with data engineers and analysts to design scalable data architectures on AWS ensuring seamless integration and perf...

We are seeking an experienced professional with strong expertise in Databricks, Informatica, API integration, and Fivetran . Total Experience: 8+ years Databricks & Informatica: 6+ years (hands-on required) Fivetran & API Integration: 3-5 years

Skill: Azure Databricks Experience: 4 to 6 years Location: AIA-Gurgaon Job Summary We are seeking a skilled Developer with 3 to 5 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. This role involves developing and optimizing data solutions to drive business insights and efficiency. The position offers an opportunity to contribute to impactful projects that enhance our data capabilities and support our companys growth. Responsibilities Develop and maintain scalable data pipelines using Databricks SQL and PySpark to support business analytics and reporting needs. Collabo...

AIA-Pune Job Summary We are seeking a highly skilled Sr. Developer with 5 to 11 years of experience to join our dynamic team. The ideal candidate will have expertise in Python Databricks SQL Databricks Workflows and PySpark. This role operates in a hybrid work model with day shifts offering the opportunity to work on innovative projects that drive our companys success. Responsibilities Develop and maintain scalable data processing systems using Python and PySpark to enhance data analytics capabilities. Collaborate with cross-functional teams to design and implement Databricks Workflows that streamline data operations. Optimize Databricks SQL queries to improve data retrieval performance and ...

Position Summary To be a driven business analyst who can work on complex Analytical problems and help the customer in better business decision making especially in the area of pharma/life sciences (domain). Job Responsibilities Write Pyspark queries for data transformation needs. Participates in ETL Design using any python framework of new or changing mappings and workflows with the team and prepares technical specifications Write complex SQL queries with performance tuning and optimization Should be able to handle task independently and lead the team if required. Good communication Skills Coordinate with cross-functional teams to ensure project objectives are met. Collaborate with data arch...

Position Summary To be a driven business analyst who can work on complex Analytical problems and help the customer in better business decision making especially in the area of pharma/life sciences (domain). Job Responsibilities Engage with Client to participate in requirement gathering, Status update on work, UAT and be the key partner in the overall engagement Participates in ETL Design using any python framework of new or changing mappings and workflows with the team and prepares technical specifications Crafts ETL Mappings, Mapplets, Workflows, Worklets using Informatica PowerCenter Write complex SQL queries with performance tuning and optimization Should be able to handle task independen...

As part of our strategic initiative to build a centralized capability around data and cloud engineering, we are establishing a dedicated Azure Cloud Data Engineering practice under RMI Optum Advisory umbrella. This team will be at the forefront of designing, developing, and deploying scalable data solutions on cloud primarily using Microsoft Azure platform. The practice will serve as a centralized team, driving innovation, standardization, and best practices across cloud-based data initiatives. New hires will play a pivotal role in shaping the future of our data landscape, collaborating with cross-functional teams, clients, and stakeholders to deliver impactful, end-to-end solutions. Primary...

Software engineering is the application of engineering to the design, development, implementation, testing and maintenance of software in a systematic method. The roles in this function will cover all primary development activity across all technology functions that ensure we deliver code with high quality for our applications, products and services and to understand customer needs and to develop product roadmaps. These roles include, but are not limited to analysis, design, coding, engineering, testing, debugging, standards, methods, tools analysis, documentation, research and development, maintenance, new development, operations and delivery. With every role in the company, each position h...

Lead Data Engineer-2 - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow Overview Mastercard is looking for a Senior Software Engineer to join the Account Level Management(ALM) team in our Pune office thats focused on building ALM Services with Data warehouse skills. The Mastercard Account Level Management platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend. Role Develop high quality, secure and scalable data ...

As a Senior Data Scientist focusing on Autonomous Networks at Nokia, you will be a key player on a dynamic team dedicated to revolutionizing telecom services through AI and machine learning. You will work closely with cross-functional teams, including engineers, product managers, and executive stakeholders, to design and implement cutting-edge data-driven solutions tailored for Communication Service Providers. You will engage directly with customers to understand their needs and drive the deployment of scalable AI/ML use cases that enhance network efficiency and performance. HOW YOU WILL CONTRIBUTE AND WHAT YOU WILL LEARN Design, develop, and deploy AI/ML solutions for Autonomous Networks (A...

As part of the Data Engineering team, you will serve as a Tier 2 Support Specialist responsible for managing and resolving technical support tickets related to our data pipelines, ingestion processes, and data quality. You will play a critical role in ensuring the stability and reliability of our intelligent data platform, supporting business users and internal stakeholders with timely solutions. Your work will directly contribute to smooth operations, improved client service, and enabling data-driven decision-making across Cushman & Wakefield. About the Role: Serve as the Tier 2 escalation point for support tickets related to data ingestion, pipelines, and data marts. Troubleshoot and resol...

Job Description Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client qu...

Job Description Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert re...

Job Description Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert re...

Job Description Role Purpose The purpose of the role is to create exceptional architectural solution design and thought leadership and enable delivery teams to provide exceptional client engagement and satisfaction. Do 1.Develop architectural solutions for the new deals/ major change requests in existing deals Creates an enterprise-wide architecture that ensures systems are scalable, reliable, and manageable. Provide solutioning of RFPs received from clients and ensure overall design assurance Develop a direction to manage the portfolio of to-be-solutions including systems, shared infrastructure services, applications in order to better match business outcome objectives Analyse technology en...

Job Description Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client qu...

Job Title: Developer Work Location: Chennai, TN Skill Required: Azure Data Factory Experience Range : 8-10 Years Relevant years of experience in ADF, ADB, azure has to be 5 years and plus. Job Description: Must-Have: Azure Data Factory, SQL- Advance, SSIS, Data Bricks, SDFS Azure Data Factory (ADF) pipelines and Polybase Good knowledge of Azure Storage including Blob Storage, Data Lake, Azure SQL, Data Factory V2, Databricks Can work on streaming analytics and various data services in Azure like Data flow, etc Ability to develop extensible, testable and maintainable code Good understanding of the challenges of enterprise software development Track record of delivering high volume, low latenc...

Job Description Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client qu...

Job Description Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client qu...

Job Description Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert re...

Required Skills: Strong experience in AI/ML architecture and solution design. Hands-on experience with ML frameworks (TensorFlow, PyTorch, Scikit-learn). Experience with LLMs and generative AI (OpenAI, Azure OpenAI, LangChain, Hugging Face). Strong programming background in Python (FastAPI, Flask), and familiarity with Java/Node.js. Experience in cloud platforms (AWS/GCP/Azure) and ML toolkits (SageMaker, Azure ML, Vertex AI). Good understanding of microservices, REST APIs, GraphQL, and event-driven architecture. Knowledge of vector databases like Pinecone, FAISS, Chroma, or Weaviate. Proficiency with CI/CD, Docker, Kubernetes, MLflow, Airflow, or similar tools.

The Team: We are looking for a highly motivated, enthusiastic, and skilled engineering leader for S&P Global Commodity Insights. We strive to deliver solutions that are sector-specific, data-rich, and hyper-targeted for evolving business needs. The Impact: S&P Global Commodity Insights is seeking a Lead Software Developer to provide technical leadership for all stages of software design, development, and maintenance for data processing applications. This person would be part of a development team that manages and supports the internal applications that support ETSS datasets. This role requires a candidate to handle data processing and develop applications for big data. We have teams composed...

As a Principal Engineer for Data Science and Engineering, you have the responsibility to develop data-centric solutions and take lead of comprehensive (sub-)projects with a direct impact on results. You will work with colleagues from a wide range of disciplines, professional backgrounds and specializations on a daily basis. Responsibilities : Responsible for the successful development and implementation of innovative analytics and business insights by tapping into various domain-specific data sources that are available. Develop GenAI solutions using the data sources that addresses business needs Addressing on strategic and operational issues for enabling data engineering and data science top...

Roles & Responsibilities Design & Build Scalable Data Solutions Improve data processing efficiency, ensuring scalability, speed, and reliability. Work closely with data scientists, analysts, business teams, product owners to understand data needs and deliver reliable, well-structured products. Mentor junior engineers, conduct code reviews, and promote best practices in data engineering. Mandatory Skills: 2-4 years experience in Data Engineering Deep hands-on expertise in Databricks, Python, SQL queries. Must be experienced in Design and implementation of Big Data technologies (Apache Spark, Hadoop ecosystem, Apache Kafka, NoSQL databases) Working as a Big Data Engineer: query tuning, perform...