4749 Data Bricks Jobs - Page 26

Role & responsibilities I came across your profile for Databricks Architect role with us and would like to check with you in reference to the below Full Time/Permanent job Opportunity. Please check the details below and let me know if you would be interested in applying your Candidature for the same . Position :: Databricks Architect Location :: Noida Role :: Full-Time Company :: Stefanini Group (https://stefanini.com/en/) Role Overview: A Data Architect designs, implements, and manages scalable data solutions on the IICS and Databricks platform. This role involves collaborating with business stakeholders to develop data pipelines, optimize performance, and ensure best practices in data hand...

As a Senior Data Engineer in the Engineering team: Join us in: Building and optimizing data architectures to handle large-scale data from various sources, including cloud and on-premise systems. Architecting scalable ETL and data workflows to support advanced analytics and machine learning models. Collaborating with cross-functional teams to deliver end-to-end data solutions that drive business insights. Owning and leading projects that focus on data platform modernization, ensuring high performance, security, and scalability. Working on complex data engineering challenges that push the boundaries of cloud data infrastructure. You'll have: A Bachelors or Master’s degree in Computer Science, ...

We help the world run better At SAP, we enable you to bring out your best Our company culture is focused on collaboration and a shared passion to help the world run better HowWe focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and future-focused work We offer a highly collaborative, caring team environment with a strong focus on learning and development, recognition for your individual contributions, and a variety of benefit options for you to choose from, What Youll Build We are looking for a Senior Software Engineer Java to join and strengthen the App2App Integration team wit...

Position Overview: The Databricks Data Engineering Lead role is ideal a highly skilled Databricks Data Engineer who will architect and lead the implementation of scalable, high-performance data pipelines and platforms using the Databricks Lakehouse ecosystem The role involves managing a team of data engineers, establishing best practices, and collaborating with cross-functional stakeholders to unlock advanced analytics, AI/ML, and real-time decision-making capabilities, Key Responsibilities: Lead the design and development of modern data pipelines, data lakes, and lakehouse architectures using Databricks and Apache Spark, Manage and mentor a team of data engineers, providing technical leader...

Job Title : D-commerce AI Product Owner Location : Bangalore, India Role Summary: This role is part of the global dCom product team, which is tasked to deliver billion plus euros in incremental turnover across different online commerce archetypes. AI Product Owner in D-commerce is responsible for defining, prioritizing, and managing the product backlog for AI products, ensuring they align with business goals and customer needs. This role involves close collaboration with stakeholders (across Business Groups and markets), development teams, and UX designers to deliver high-quality e-commerce experience and growth programs. The Product Owner acts as the voice of the customer, translating busin...

Key Responsibilities: Lead the design, development, and deployment of advanced data pipelines and analytical workflows leveraging Azure Databricks, PySpark, and other big data technologies. Implement and optimize ETL/ELT processes for data ingestion, transformation, and loading from diverse sources into data lakes and data warehouses on Azure and AWS. Develop and maintain data models, ensuring data quality, integrity, and governance. Utilize Python and SQL extensively for data manipulation, scripting, automation, and complex data analysis. Work with AWS services (e.g., S3, Glue, Redshift, Lambda) and Azure services (e.g., Data Lake, Data Factory, Synapse Analytics) to build and manage data i...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Role & responsibilities Design, build, and maintain robust data ingestion and transformation pipelines using Python, SQL, and dbt . Orchestrate workflows using Airflow / Prefect / Dagster for automation, scheduling, and dependency management. Manage data pipelines across environments ensuring reliability, scalability, and version control ( GitOps best practices ). Collaborate with analysts, ML engineers, and backend teams to design high-quality data models supporting analytics and AI use cases. Implement data validation, lineage, and observability frameworks (Great Expectations, OpenMetadata, DataHub). Champion data quality, lineage, and observability as first-class citizens in every pipelin...

Job Summary We are seeking a skilled Senior Visualization Developer with 6 to 9 years of experience in Kibana / Elastic Power Bi and DataBricks / PySpark for a hybrid work model. The ideal candidate will excel in developing and maintaining high-quality software solutions. They will collaborate with cross-functional teams to deliver impactful projects that align with our companys goals. Proficiency in English is essential for effective communication. Responsibilities Develop and maintain robust software applications using Python3 to meet business requirements. Collaborate with cross-functional teams to design implement and optimize software solutions. Ensure code quality and maintainability b...

We are hiring a Senior Azure Data Engineer to build scalable data pipelines using Azure Databricks, PySpark, and Spark Pools. The role involves transforming raw data into insights, integrating cloud data platforms, and deploying machine learning models. Candidates should have 5+ years of data engineering experience and strong skills in Python, PySpark, Azure Data Lake, and Blob Storage. Experience with ML tools like MLlib or TensorFlow is preferred. The role demands strong problem-solving and communication skills, with added value for those familiar with CI/CD, Git, Docker, or Power BI.

Roles & responsibilities: : The candidate must be able to independently manage his/ her own workstream and effectively collaborate with other regional teams. Develop and deploy machine learning models to support key business areas such as Credit Risk, Fraud Detection, Customer Segmentation, Marketing Optimization, and Collections Strategy. Collaborate with cross-functional teams (Data Engineers, Product Managers, Engineers) across Chennai, Manila, and Singapore to deliver production-grade ML solutions aligned with business goals. End-to-End Ownership: Drive the full lifecycle of ML solutionsfrom data exploration, feature engineering, and algorithm selection to deployment and performance moni...

Must Have: SQL: Ability to read, write, test, and maintain complex SQL queries BigQuery: Working knowledge, including aspects like internal vs external tables, partitioning, clustering, etc. Python: Hands-on expertise in writing Python application code Big Data Engineering: Experience in Big Data Engineering projects Good to Have (Added Advantage): Knowledge/experience with DBT and Alembic (availability of these skills will be a big push) GCP Cloud, Big Data, Bigquery

About the Role Youll own the architecture, development, and deployment of next-generation scalable agentic AI systems that reshape how organizations operate These solutions will autonomously orchestrate multi-step workflows, analyze real-time data streams, surface predictive insights, and embed decision-making across finance, sales, operations, and more Youll partner with product, data science, RPA, security, and business teams to drive end-to-end impact Responsibilities Develop robust, production-grade AI agents tailored to solve real-world enterprise challenges. Collaborate across technical and business teams to ensure agent success at every stage. Design serverless, event-driven workflows...

Project description The role focuses on analyzing, documenting, and translating business requirements into technical specifications for Azure-based cloud applications. The analyst will collaborate with architects, developers, and stakeholders to design and deliver scalable, secure, and cost-effective Azure-native solutions. Responsibilities Gather and analyze business requirements from stakeholders for cloud-based solutions. Translate business needs into technical specifications, focusing on Azure-native services. Collaborate with architects and developers to design scalable and secure Azure solutions. Define and document integration points between Azure services (Functions, App Services, Op...

Project description Information and Document Systems is a global technology change and delivery organization comprising nearly 200 individuals located mostly in Switzerland, Poland, and Singapore. Providing global capturing and document processing, archiving, and retrieval solutions to all business divisions focusing on supporting Legal, Regulatory, and Operational functions. Responsibilities Design, implement, and manage data solutions on Azure Develop and maintain data pipelines using Databricks Ensure efficient data storage and retrieval using Azure Storage and Data Lake Automate infrastructure and application deployments with Ansible Write clean, maintainable code in Python Collaborate w...

Project description Information and Document Systems is a global technology change and delivery organization comprising nearly 200 individuals located mostly in Switzerland, Poland, and Singapore. Providing global capturing and document processing, archiving, and retrieval solutions to all business divisions focusing on supporting Legal, Regulatory, and Operational functions. Responsibilities Configuration and customization of Selenium in various integrations Automation of various projects, e.g., a framework, communication and interaction with stakeholders to solve their problems Development of equipment automation plans and their approval Share and contributeSupport and guide less senior te...

Project description We are seeking an experienced Azure Cloud Support Engineer skilled in cloud architecture and Microsoft Azure. The ideal candidate will have advanced knowledge of Azure Cloud services, Configuration Management, knowledge on DevOps Deployment & Delivery methodologies. This role involves maintaining the A infrastructure and applications. Responsibilities Technical SupportProvide technical assistance and resolve issues related to Azure services, including system outages and performance slowdowns TroubleshootingDiagnose and fix problems with cloud-based servers, storage, and networking Client CollaborationWork closely with clients to understand their cloud computing needs and ...

Project description We are seeking a highly skilled and motivated Data Scientist with 5+ years of experience to join our team. The ideal candidate will bring strong data science, programming, and data engineering expertise, along with hands-on experience in generative AI, large language models, and modern LLM application frameworks. This role also demands excellent communication and stakeholder management skills to collaborate effectively across business units. Responsibilities We are seeking a highly skilled and motivated Data Scientist with 5+ years of experience to join our team. The ideal candidate will bring strong data science, programming, and data engineering expertise, along with ha...

Project description Luxoft has been asked to contract a Developer in support of a number of customer initiatives. The primary objective is to develop based on client requirements in the Telecom/network work environment Responsibilities A Data Engineer with experience in the following techologies Databricks and Azure Apache Spark-based, hands on Python, SQL, Apache Airflow. Databricks clusters for ETL processes. Integration with ADLS, Blob Storage. Efficiently ingest data from various sources, including on-premises databases, cloud storage, APIs, and streaming data. Use Azure Key Vault for managing secrets. Hands on experience working with API's Kafka/Azure EventHub streaming hands on experie...

Overview DataOps L3 The role will leverage & enhance existing technologies in the area of data and analytics solutions like Power BI, Azure data engineering technologies, ADLS, ADB, Synapse, and other Azure services. The role will be responsible for developing and support IT products and solutions using these technologies and deploy them for business users Responsibilities 5 to 10 Years of IT & Azure Data engineering technologies experience Prior experience in ETL, data pipelines, data flow techniques using Azure Data Services Working experience in Python, Py Spark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse and file formats like JSON & Parquet. Experience in creatin...

Overview As a data engineering manager, you will be the key technical expert overseeing PepsiCo's data product build & operations and drive a strong vision for how data engineering can proactively create a positive impact on the business You'll be empowered to create & lead a strong team of data engineers who build data pipelines into various source systems, rest data on the PepsiCo Data Lake, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company As a member of the data engineering team, you will help lead the development of very large and complex data applications into public cloud environments directly impacting...

We are looking for a skilled ETL Testing professional with 6-12 years of experience to join our team in Bengaluru. The ideal candidate will have expertise in database testing using SQL and experience working with Databricks. Roles and Responsibility Develop and execute comprehensive test plans, test cases, and test scripts for ETL processes. Verify the accuracy and completeness of data, identifying key ETL mapping scenarios and creating SQL queries to simulate them. Perform data source location and format checks, conduct data counts, and ensure columns and data types meet requirements. Collaborate with cross-functional teams to identify and resolve data-related issues. Write complex SQL quer...

Urgent requirement for Senior Cognos Admin. Experience:5+ Years Relevant Experience : 6+ Years. Job Description: We are seeking a skilled and experienced Cognos and Informatica Administrator to join our team. You will be responsible for the installation, configuration, maintenance, and support of Cognos and Informatica software in our organization. Your role will involve collaborating with cross-functional teams, solve system issues, and ensuring the smooth functioning of the Cognos and Informatica environments. Role Scope Deliverables: Responsibilities: Install, configure, and upgrade Cognos and Informatica application components, including servers, clients, and related tools. Monitor and m...

6+ years of experience in Data engineering projects using COSMOS DB- Azure Databricks (Min 3-5 projects) Strong expertise in building data engineering solutions using Azure Databricks, Cosmos DB Strong T-SQL programming skills or with any other flavor of SQL Experience working with high volume data, large objects, complex data transformations Experience working in DevOps environments integrated with GIT for version control and CI/CD pipeline. Good understanding of data modelling for data warehouse and data marts Strong verbal and written communication skills Ability to learn, contribute and grow in a fast phased environment Nice to have: Expertise in Microsoft Azure is mandatory including co...