6138 Data Bricks Jobs - Page 14

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Roles & Responsibilities :Provide operational support for Azure Databricks clusters, jobs, notebooks, and workspaces.Monitor platform health, job performance, and troubleshoot issues related to pipelines, clusters, and data latency.Handle incident management, root cause analysis (RCA), and L2/L3 problem resolution for Databric...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

Role & responsibilities A minimum of 10+ years of experience in data architecture and analytics. Databricks: Proficiency in Databricks for data processing, machine learning, and analytics. Cloud Platforms: Strong experience with any one or more cloud platforms such as AWS, Azure, GCP, and the ability to integrate Databricks with them. Data Engineering: Strong experience engineering concepts, data modelling, and ETL processes. SQL: Advanced SQL skills for data querying, transformation, and analysis. Python: Proficiency in Python programming for data manipulation, scripting, and automation. Apache Airflow: Strong experience with Apache Airflow for orchestrating and scheduling ETL workflows. Bi...

Role & responsibilities Contribute to the strategic vision for data engineering and participate in the architectural design and development of new and complex data solutions, focusing on scalability, performance, and hands-on implementation. Design and implement new data systems and infrastructure to ensure the reliability and scalability of data systems by actively contributing to day-to-day engineering tasks. Influence key decisions regarding the data technology stack, infrastructure, and tools while actively engaging in hands-on engineering efforts in the creation and deployment of new data architectures and workflows. Set coding standards and best practices for the Data Engineering & Ope...

Must have atleast 5+ yrs of overall IT experience and 3+ years' experience working as a Data Engineer working on AWS platform with Python and Pyspark programming and SQL Python Application Development - Object oriented programming, test driven development using Pytest, implementing modules & packages, developing production ready frameworks and working with core and extended Python libraries, working with files, database, API, familiar with PEP coding standards, GIT version control Hands-on experience on developing data pipelines using AWS Data Services like S3, Lambda, Glue, Step Functions, RDS, Redshift, Event Bridge, DynamoDB, SNS, SQS, IAM, EMR, EC2, ECS, Fargate, SSM, Secrets Manager, Co...

Role & responsibilities: At least 5 years of hands-on experience in Python, Snowflake, AWS, Unix, Airflow, Data bricks. Experience in Hive and Hadoop is an added advantage. At least 3-4 years of experience in AWS technologies At least 4 years of experience in software development life cycle. At least 5 years of experience in Design preparation. Empirical understanding of data systems data analysis, data warehousing, data ETL, etc. on process automation and standardization. Ability to work in team in diverse multiple stakeholders. Familiarity with Agile methodologies and practices. Proficient in using Git for version control. Strong problem-solving skills and attention to detail. Preferred ca...

We are seeking a Databricks Data Engineer to design, build, and optimize scalable data pipelines and analytics solutions on the Databricks Lakehouse Platform. You will be responsible for transforming raw data into high-value datasets that power analytics, AI/ML models, and business insights. Were looking for a dynamic, self-motivated, and proactive leader who thrives in a fast- paced environment and can foster a high-performing culture. Develop scalable ETL/ELT pipelines using PySpark, SQL, and Delta Lake. Build and maintain batch and stream data pipelines using Databricks Workflows. Design and implement Lakehouse architecture and optimize Delta Lake tables. Integrate data from multiple sour...

The Team: We are looking for a highly motivated, enthusiastic, and skilled engineering leader for S&P Global Energy. We strive to deliver solutions that are sector-specific, data-rich, and hyper-targeted for evolving business needs. The Impact: S&P Global Energy is seeking a Senior Software Developer to provide technical leadership for all stages of software design, development, and maintenance for data processing applications. This person would be part of a development team that manages and supports the internal applications that support Horizon business datasets. This role requires a candidate to handle data processing and develop applications for big data. We have teams composed of indivi...

Responsibilities: * Design, develop, and maintain Azure data solutions using Data Bricks, SQL, PySpark, Python, and Azure Data Factory.

Databricks Engineer Job Description Role Overview The Data Engineer will be responsible for designing, building, and optimizing data pipelines and platforms to enable advanced analytics and business intelligence across the organization. This role requires strong expertise in Databricks , SQL , AWS , and Airflow , combined with a solid foundation in data analysis and engineering best practices. The ideal candidate will collaborate with cross-functional stakeholders and ensure scalable, secure, and high-performing data solutions. Location: Bengaluru Key Responsibilities Technical Design Develop, and maintain data pipelines and ETL workflows using Databricks and Airflow. Good understanding of D...

Team Overview: Data Science and Artificial Intelligence represents the next phase in the advancement of our digital transformation and is a significant evolution for MasterCard. We continue to evolve our Data Science and AI strategy to support aggressive growth plans, and we are seeking a Lead Software Engineer to join our team. Are you an expert developer with the vision to guide complex projects from ideation to implementation? If so, we want you on our team! Roles & Responsibilities: Develop complete understanding of end-to-end technical architecture and dependency systems. Participate in team prioritization discussions with Product/Business stakeholders. Estimate and own delivery tasks (...

We are seeking an experienced MDM Engineer with 812 years of experience to lead development and operations of our Master Data Management (MDM) platforms, with hands-on experience in data engineering experience. This role will involve handling the backend data engineering solution within MDM team. This is a technical role that will require hands-on work. To succeed in this role, the candidate must have strong Data Engineering experience. Candidate must have experience on technologies like (SQL, Python, PySpark, Databricks, AWS, API Integrations etc). Roles & Responsibilities: Develop distributed data pipelines using PySpark on Databricks for ingesting, transforming, and publishing master data...

ALM Services with Data warehouse skills The Mastercard Account Level Management platform empowers real-time card level decisioning As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend Role o Develop high quality, secure and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO o Leverage technologies and solutions to innovate with increasingly large data sets o Drive automation and efficiency in Data ingestion, data movement and data access w...

What you will do In this vital role you will be responsible for designing, developing, and maintaining software applications and solutions that meet business needs and ensuring the availability and performance of critical systems and applications. This role is for a technical functional lead/developer supporting Veeva ClinOps vault (suite of applications). The role involves working closely with product managers, designers, and other engineers to create/maintain high-quality, scalable software solutions and automating operations, monitoring system health, and responding to incidents to minimize downtime. Roles & Responsibilities: Participate in technical discussions related to clinical Trial ...

The Senior Associate Medical Data Analyst will play a pivotal role in supporting Global Medical Affairs by generating data-driven insights that inform scientific engagement, strategic decision-making, and patient-focused strategies. In this role you will design and develop advanced analytical solutions that enable the Medical Affairs team to extract meaningful insights from various complex datasets. This role will serve as a technical cornerstone within the Medical Data and Analytics (MDnA) team, translating structured and unstructured data into actionable intelligence to inform strategic decisions and improve patient outcomes. Key Responsibilities Translate complex analytical findings into ...

What you will do In this vital role you will as a Senior Associate IS Business Systems Analyst with strong data science and analytics expertise to join the Digital Workplace Experience (DWX) Automation & Analytics product team. In this role, you will develop, maintain, and optimize machine learning models, forecasting tools, and operational dashboards that support strategic and day-to-day decisions for global digital workplace services. This role is ideal for candidates with hands-on experience building predictive models and working with large operational datasets to uncover insights and deliver automation solutions. You will work alongside product owners, engineers, and service leads to del...

Work location: Hyderabad Experirence: 5 + years(4+ relevant) Mandatory working experience to be in CV: Experience in HR, Azure, AWS, data Bricks, power BI, SQL. Updated CV can be shared to gramashetty@allegisglobalsolutions.com. Job Title: Manager - Performance and Reward System Job Description: We are looking for an experienced professional to join our Performance & Reward Systems team . This role will focus on HR technology, data analytics, and reporting transformation to support annual performance and reward cycles and drive innovation in HR systems. Key Responsibilities: Manage and enhance Performance & Reward systems and reporting suites. Provide functional oversight of SuccessFactors P...

Seeking Microsoft Fabric Data Engineer (4–5 yrs exp) to design, build & optimize pipelines with Fabric, Azure, Power BI. Strong SQL, Python, PySpark skills; ensure data quality, governance & collaborate on analytics solutions Required Candidate profile 4–5 yrs in data engineering/BI, expert in Microsoft Fabric (Data Factory, Synapse, Data Lake, Power BI), strong SQL/Python/PySpark, Azure cloud, ETL, data warehousing, Agile

Required Skills: Strong experience in AI/ML architecture and solution design. Hands-on experience with ML frameworks (TensorFlow, PyTorch, Scikit-learn). Experience with LLMs and generative AI (OpenAI, Azure OpenAI, LangChain, Hugging Face). Strong programming background in Python (FastAPI, Flask), and familiarity with Java/Node.js. Experience in cloud platforms (AWS/GCP/Azure) and ML toolkits (SageMaker, Azure ML, Vertex AI). Good understanding of microservices, REST APIs, GraphQL, and event-driven architecture. Knowledge of vector databases like Pinecone, FAISS, Chroma, or Weaviate. Proficiency with CI/CD, Docker, Kubernetes, MLflow, Airflow, or similar tools.

About Client Hiring for One of the Most Prestigious Multinational Corporations! Job Description Job Title : Azure Data Engineer / Data Engineer Qualification : Any Graduate or Above Relevant Experience : 6 to 10yrs Required technical skill: SQL ,Python, Spark, AWS, Data Bricks is Mandate Location : Hyderabad CTC Range : 10 to 15yrs Notice period : Immediate Quiline Roopa M Staffing analyst - IT recruiter Black and White Business solutions PVT Ltd Bangalore, Karnataka, INDIA roopa@blackwhite.in I www.blackwhite.in +91 9739199898

We are seeking experienced candidate for Azure data engineer, 5- 9 Years overall experience in develop, manage data pipelines using ADF and Azure data bricks. Requirements: 5-9 years experienced in Azure data engineer. Should have the ability to develop and manage data pipelines using ADF and Azure data bricks. Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure. Expertise in on-prem to azure cloud migration. Expertise in SQL and Pyspark. Experience in production support of ADF jobs. Excellent communication and team leading capabilities. Bachelors or Masters degree in Computer Science, Information Technology, Engineering, or a related field. Location:...

Job Title: Data Engineer Experience: 510 Years Location: PAN India Employment Type: Full-Time About the Company Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future. Job Description: We are seeking a Data Engineer with strong hands-on experience in Python, PySpark, Apache Spark, Kafka, and Databricks to build and maintain scalable, high-performance data pipelines. The role requires deep coding expertise and experience working ...

Desired Job attributes: Bachelors degree in computer science, Engineering, or a related field. Proven experience as a ETL/SQL QA Tester or similar role. Thorough knowledge with ETL (extract, transform, load) process and validation points within the process Experience in executing jobs in ETL software, such as Databricks or DataStage. Data testing, Testing in large datasets, Missing data, Duplicate data, Data from different sources Structural errors, Data attribute validations Strong in SQL query writing skills. Strong knowledge of software testing methodologies, tools, and processes. Familiarity with Agile development methodologies. Excellent analytical and problem-solving skills. Strong att...

Title: Azure Data Architect Location: Chennai (Onsite) Employment Type: Full-time Permanent Experience Required: 10-12 Years Responsibilites: Architect scalable, secure, and high-performance data solutions for fraud and risk analytics. Design end-to-end Azure data architectures , covering ingestion, transformation, storage, governance, lineage, and consumption layers. Build and optimize ETL/ELT pipelines using Spark, PySpark, and Azure Databricks . Handle large-scale structured and semi-structured datasets , ensuring data quality and integrity. Collaborate with data science teams to prepare training datasets, support feature engineering, and enable ML model operationalization. Implement clou...

Overview: The Azure Data Engineer / Data Architect will be responsible for designing, developing, and managing scalable data solutions on Microsoft Azure. You will ensure that data is accessible, optimized for performance, and compliant with organizational and security standards. You will have hands-on expertise with Azure services, strong ETL development skills, and the ability to architect modern data platforms that support business intelligence, analytics, and advanced data science initiatives. You will operate in a Scrum/Agile environment, collaborating closely with cross-functional teams to deliver value iteratively. Core Responsibilities: •Design, build, and maintain scalable and relia...