6138 Data Bricks Jobs - Page 24

DATA BRICKS: Project Overview: As part of this data engineering project, enabling & supporting the data pipelines with Thermo fisher standards. Role Scope / Deliverables: Create new data pipelines in databricks. Support existing data pipelines in databricks. Create DAG setup in in airflow. Resolve day to day job failurs/performance issues. Key Skills: • Minimum 5 years of total experience. • Proficient in Databricks, Pyspark/Python & SQL (minimum 3+ year of experience) • Hands on experience in could AWS/Azure (preferably AWS) • Excellent communication. • Can be able to work independently.

Role & responsibilities Databricks Sr.Developer JD Open positions 1 (India) Looking for Hands-on profiles. Please avoid managers, architects, solution designers etc., Purpose of the role To migrate existing AWS data tech stack into Databricks Candidates working for this role will support platform modernization efforts by migrating existing AWS components to Databricks, depending on their assessed skill sets. Support platform modernization by migrating existing AWS components to Databricks . Ensure smooth transition of data pipelines, orchestration workflows, and security configurations. Design, implement, and optimize complex data pipelines for large-scale data processing. Build reusable, sc...

Role: Data Engineer Experience: 7-9 Years Location: Bangalore, Pune Notice Period: Immediate Joiners Only Role & responsibilities Mandate Skills Strong - Pyspark (Programming) Databricks Background and experience: Bachelors Degree in Computer Science or related field 7-9 years of experience in Cloud Data Engineering. Technical and professional skills: We are looking for a flexible, fast learning, technically strong Data Engineer. Expertise is required in the following fields: Proficient in Cloud Services Azure Build ETL and data movement solutions. Migrate data from traditional database systems to Cloud environment Strong hands-on experience for working with Streaming dataset Building Comple...

Role: Data Engineer Experience: 7-9 Years Location: Bangalore, Pune Notice Period: Immediate Joiners Only Role & responsibilities Mandate Skills Strong - Pyspark (Programming) Databricks Background and experience: Bachelors Degree in Computer Science or related field 7-9 years of experience in Cloud Data Engineering. Technical and professional skills: We are looking for a flexible, fast learning, technically strong Data Engineer. Expertise is required in the following fields: Proficient in Cloud Services Azure Build ETL and data movement solutions. Migrate data from traditional database systems to Cloud environment Strong hands-on experience for working with Streaming dataset Building Comple...

Key Skills: Databricks, SQL, Python, DBT, Snowflake DB, Data Bricks, Data cleansing Roles and Responsibilities: Design, develop, and maintain robust data pipelines using Snowflake DB, Databricks, and DBT. Write efficient SQL queries for data extraction and transformation. Implement data cleansing processes to ensure data quality. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Optimize data models for performance and scalability. Utilize Python for data manipulation and automation tasks. Monitor and troubleshoot data pipeline performance issues. Document data processes and workflows for future reference. Skills Required: Strong knowledge of data...

Role & responsibilities • Developing, managing and optimizing robust and reliable data pipelines using azure native capabilities. • Implement ADF workflows that perform data ingestion, data integration/ETL, statistical model executions etc. • Creating architecture for data solutions with high performance characteristics • Bringing data and analytics products to production • Implement CI/CD pipelines for data solutions • Build dashboards for data stewards and business reporting • Design & build RDBMS data models

About Position: We are seeking for Python testing with hands on experience in python, databricks, azure, etc., Role: Python Testing Location: All Persistent Locations Experience: 8 to 12 Years Job Type: Full Time Employment What You'll Do: Collaborate with Product Managers, Business Analysts, and Developers during requirement gathering to identify test scenarios early. Draft and maintain detailed Automation test cases and test plans aligned with evolving business requirements. Design, develop, and execute automated test scripts using industry-standard tools and frameworks. Perform regression, integration, and performance testing across multiple platforms. Identify, document, and track defect...

Role: Data Engineer Experience: 6-8 Years Relevant Experience in Data Engineer : 6+ Years Notice Period: Immediate Joiners Only Job Location: Pune and Bangalore Key Responsibilities: Mandate Skills Strong - Pyspark (Programming) Databricks Technical and professional skills: We are looking for a flexible, fast learning, technically strong Data Engineer. Expertise is required in the following fields: Proficient in Cloud Services Azure Architect and implement ETL and data movement solutions. Design and implement data solutions using medallion architecture, ensuring effective organization and flow of data through bronze, silver, and gold layers. Optimize data storage and processing strategies to...

Design, develop, and maintain data solutions using MS SQL and Snowflake . Create and optimize SQL views and stored procedures for performance and scalability. Build and manage data warehouse solutions to support analytics and reporting. Develop and maintain Power BI dashboards for business insights. Fine-tune SQL queries for efficiency and reliability. Collaborate with cross-functional teams to ensure data integrity and availability. Required Qualifications: 5+ years of experience in data engineering or similar roles. Strong skills and proficiency in MS SQL and Snowflake (coding views and procedures). Hands-on experience with Power BI . Solid understanding of data warehouse concepts and best...

Mandatory Skills: 1. Experience in Deep learning engineering (mostly on MLOps) 2. Strong NLP/LLM experience and processing text using LLM 3. Proficient in Pyspark/Databricks & Python programming. 4. Building backend applications (data processing etc) using Python and Deep learning frame works. 5. Deploying models and building APIS (FAST API, FLASK API) 6. Need to have experience working with GPUS. 7. Working knowledge of Vector databases like 1) Milvus 2) azure cognitive search 3) quadrant etc 8. Experience in transformers and working with hugging face models like llama, Mixtral AI and embedding models etc. Good to have: 1. Knowledge and experience in Kubernetes, docker etc 2. Cloud Experien...

Mandatory Skills: 1. Experience in Deep learning engineering (mostly on MLOps) 2. Strong NLP/LLM experience and processing text using LLM 3. Proficient in Pyspark/Databricks & Python programming. 4. Building backend applications (data processing etc) using Python and Deep learning frame works. 5. Deploying models and building APIS (FAST API, FLASK API) 6. Need to have experience working with GPUS. 7. Working knowledge of Vector databases like 1) Milvus 2) azure cognitive search 3) quadrant etc 8. Experience in transformers and working with hugging face models like llama, Mixtral AI and embedding models etc. Good to have: 1. Knowledge and experience in Kubernetes, docker etc 2. Cloud Experien...

Job Description: Job Title: Functional Architect Azure We are looking for an experienced Azure Functional Architect to design and deliver scalable, secure, and resilient cloud solutions on Microsoft Azure. The role involves leading architecture design, data platforms, DevOps automation, and hybrid cloud integration while ensuring governance, compliance, and high availability. Key Responsibilities: • Architect and implement end-to-end Azure solutions. • Design data platforms using Azure Data Factory, Synapse, and Databricks. • Manage Azure AD, RBAC, and identity/access governance. • Drive Azure DevOps CI/CD automation for delivery. • Design networking, storage, and hybrid connectivity solutio...

About Narayana Health: Narayana Health is headquartered in Bengaluru, India, and operates a network of hospitals in India and Overseas. Our mission is to deliver high quality, affordable healthcare services to the broader population. Narayana Health Group is Indias leading healthcare provider and one of the largest hospital groups in the country with a network of 21 hospitals, 5 heart centers, and 19 primary care facilities. The NH group treats over 2.6 Million patients every year from over 78 countries covering 30+ medical specialties. Our Centers of Excellence help in treating Adult & Pediatric patients and we have one of the largest transplant centers in India. We have a strong presence a...

Databricks (3+ yrs): ETL/ELT with PySpark, Auto Loader, Structured Streaming, Delta Live Tables, Medallion Architecture, CI/CD integration. Databricks SQL Endpoints AWS (5+ yrs): Glue, Lambda, CloudWatch, CloudTrail, IAM security best practices.

We are seeking a motivated Data Engineer with experience to design, develop, and maintain scalable data solutions on the Microsoft Azure platform. You will collaborate with cross-functional teams to enable data-driven decision-making using Azure Synapse Analytics, Data Factory, SQL, Python, and data analysis techniques. This role offers opportunities to grow your expertise in cloud data engineering while contributing to impactful projects. ________________________________________ Key Responsibilities Data Pipeline Development: Build, deploy, and maintain efficient ETL/ELT pipelines using Azure Data Factory and Azure Synapse Analytics. For Data Engineers, Databricks and Fabric should must hav...

Job Title: Senior Data Engineer with Databricks and Power BI (DAX) Job Description: As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining robust data pipelines and data architectures to support advanced analytics and reporting initiatives. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data solutions that empower the organization to make data-driven decisions. Your expertise in Databricks and Power BI (DAX) will be critical in optimizing data workflows and visualizing complex datasets. Key Responsibilities: - Design and implement scalable data processing solutions using Databricks, including ETL pr...

EPAM has presence across 40+ countries globally with 55,000 + professionals & numerous delivery centers, Key locations are North America, Eastern Europe, Central Europe, Western Europe, APAC, Mid East & Development Centers in India (Hyderabad, Pune & Bangalore). Location: Pune/Hyderabad/Bengaluru/Chennai/Coimbatore Work Mode: Hybrid (2-3 days office in a week) Full time Job Description: 5-14 Years of in Big Data & Data related technology experience Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on programming with Python Experience with building stream-processing systems, using technologies such as Apache Storm or Sp...

Role: AWS Data engineer (Lead / Associate Architect / Architect) Experience: 9+ years No. of positions: 3 Location: Hyderabad Fission Labs, headquartered in Sunnyvale, with offices in Dallas & Hyderabad, Fission Labs is a leading software development company, specializing in crafting flexible, agile, and scalable solutions that propel businesses forward. With a comprehensive range of services, including product development, cloud engineering, big data analytics, QA, DevOps consulting, and AI/ML solutions, we empower clients to achieve sustainable digital transformation that aligns seamlessly with their business goals. Responsibilities Experience leading and driving large scale data migration...

As a skilled Business Performance Management Professional with expertise in Excel, Power BI, MS SQL, Azure, Data Bricks, and Analytics, you will be part of a global Business Performance Management team dedicated to ensuring operational efficiency, effectiveness, and alignment with strategic objectives across all GSCs. Your role involves monitoring, analyzing, and reporting on various aspects of business performance to provide insights and recommendations to senior management and stakeholders. Key Responsibilities: - Develop and maintain dashboards and reports to provide insights into business performance using Excel, Power BI, and other tools. - Analyze data from various sources to identify ...

As an experienced professional in the field, your role will involve finalizing solution architecture, system architecture, and technology architecture for the Data bricks migration program/projects. You will be responsible for finalizing conversion methodology which includes ETL, Data pipelines, and Visualization tools using 3rd party accelerators and Data bricks tools like Lake bridge. Additionally, you will provide technical guidance to a group of data engineers on code conversion to data bricks compliant formats, Database objects to databricks compliant formats, data loading, and data reconciliation with old and new systems. Key Responsibilities: - Finalize solution architecture, system a...

Location: Mumbai/ Pune/ Bangalore/ Noida/ Kochi Job Profile Summary: In this role, you will support the Data Engineering team in setting up the Data Lake on Cloud and the implementation of standardized Data Model. You will develop data pipelines for new sources, data transformations within the Data Lake, CI/CD and data delivery as per the business requirements. Job Description: • Build pipelines to bring in wide variety of data from multiple sources within the organization as well as from social media and public data sources. • Collaborate with cross functional teams to source data and make it available for downstream consumption. • Work with the team to provide an effective solution design ...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Databricks, PySpark, Azure Data Factory, Python

PepsiCo Data Analytics & AI Overview: With data deeply embedded in our DNA, PepsiCo Data, Analytics and AI (DA&AI) transforms data into consumer delight. We build and organize business-ready data that allows PepsiCos leaders to solve their problems with the highest degree of confidence. Our platform of data products and services ensures data is activated at scale. This enables new revenue streams, deeper partner relationships, new consumer experiences, and innovation across the enterprise. The Data Science Pillar in DA&AI will be the organization where Data Scientist and ML Engineers report to in the broader D+A Organization. Also DS will lead, facilitate and collaborate on the larger DS com...