4706 Data Bricks Jobs - Page 8

Description Responsibilities Perform testing in Databricks environment which includes Participating in developing Test frameworks. Participating in testing scripts development, code reviews Partner with the product owner, data engineers, data architects and analysts to create scalable and robust solutions. Prepare the status report of testing activities and share updates with the team during Scrum meeting. Experience using appropriate test management tool like Azure DevOps Competencies / Required Skills: ETL Testing experience of 7+ years Report Testing experience of 2+ years, preferably PowerBI Hands on experience of 3+ years working in Databricks/ADLS environment. Good at Python/Pyspark sc...

Assignment Title: .Net Full Stack Developer with Angular Comments on Experience Skills QUALIFICATIONS Expertise in C#/.NET .NET CORE, with knowledge how to work with the SOLID principles Very good hands on experience with Angular technology and Web APIs Minimum five years of backend development experience with complex products Strong skills in Microsoft SQL language and Entity framework Good knowledge and experience writing and using unit tests Good communication skills, fluent in English MERITING Azure, Data bricks and Python Hands on experience with test automation tools

Experience: 5+years Location: PAN India Role & responsibilities: Databricks Unity Catalog Engineer (6+ yrs) Hands-on experience with Databricks, including Unity Catalog, Delta Lake, and workspace management Experience in design and implementing Databricks Unity Catalog for centralized governance across workspaces and data domains Strong understanding of cloud platforms (Azure, AWS, or GCP) and their security models Experience with metadata management, data lineage, and cataloging Proficiency in SQL and scripting for automation and policy enforcement.

Key Responsibilities Data Architecture & Engineering Leadership Design and own scalable data architectures for ingestion, transformation, and analytics on Databricks . Build robust ETL/ELT pipelines using PySpark , SQL , and Databricks Workflows . Lead performance tuning, partitioning, and data optimization across large distributed systems. Mentor junior data engineers and enforce best practices for code quality, testing, and version control. Cloud & Platform Engineering Develop and maintain data lakes and data warehouses on cloud platforms (Azure Data Lake, AWS S3, GCP BigQuery, etc.). Utilize Azure Data Factory , AWS Glue , or similar orchestration tools to manage large-scale data workflow...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities Requirements: Experience in Databricks, SQL, PySpark, Spark, Python, and Azure Data Factory (ADF). Experience in designing, developing, and maintaining data pipelines and data streams. Experience in moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Experience in working with stakeholders to understand their data needs and provide solutions. Experience in collaborating with other teams to ensure data quality and consistency. Experience in developing and maintaining data models and data dictionaries. Experience in developing and maintaining ETL proces...

We are seeking a talented individual to join our Tech team at MMC Corporate.This role will be based in Gurgaon/ Noida/Pune/Mumbai. This is a hybrid role that has a requirement of working at least three days a week in the office. Senior Principal Engineer Data Engineering What can you expect? As a Data Engineer, you will be responsible for designing and implementing scalable data pipelines and AI Based solution using Databricks. You will handle end-to-end ETL/ELT processes, manage large datasets, and work with tools like Python, PySpark, and AWS S3 to ensure data is transformed and optimized for analytical use. Youll work on cutting-edge cloud and hybrid data projects, transforming raw data i...

Demonstrated considerable experience (minimum 5-7 Years) implementing Data platform/Big data projects on Hyperscalars platform. (Primarily on AWS/Databricks & Google cloud) Extensive working experience on implementing data warehouse, data lake, data mart projects (5-8 years) Strong solution/architect skills in building Data engineering pipelines. (> 5 Years) Hands on experience working in AWS (glue, redshift, s3, athena)/Databricks/Spark (pyspark preferred) /Snowflake/Google cloud (GCS, Big query, dataproc, dataflow, composor). Experience working on Real team data engineering projects Having Data engineering Certifications will be added advantage Good to have Knowledge of AI/ML skills, ML En...

Primary Responsibility: Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so Required Qualifications: B.E./B Tech/MCA/M Tech / Bachelor's degree Co...

Demonstrated considerable experience (minimum 5-7 Years) implementing Data platform/Big data projects on Hyperscalars platform. (Primarily on AWS/Databricks & Google cloud) Extensive working experience on implementing data warehouse, data lake, data mart projects (5-8 years) Strong solution/architect skills in building Data engineering pipelines. (> 5 Years) Hands on experience working in AWS (glue, redshift, s3, athena)/Databricks/Spark (pyspark preferred) /Snowflake/Google cloud (GCS, Bigquery, dataproc, dataflow, composor) Experience working on Real team data engineering projects Having Data engineering Certifications will be added advantage Good to have Knowledge of AI/ML skills, ML Engi...

Job Summary: We are looking for a highly hands-on Back-End Engineer with a strong foundation in Python, system design, and practical experience in building and deploying Agentic Generative AI systems. The ideal candidate is passionate about solving complex problems using LLMs, understands the architecture of modern AI agent frameworks like LangChain/LangGraph, and can deliver scalable, cloud-native back-end services with a GenAI focus. Key Responsibilities: Design and implement robust, scalable back-end systems for GenAI agent-based platforms. Work closely with AI researchers and front-end teams to integrate LLMs and agentic workflows into production services. Develop and maintain services u...

Domain Experience: Retail Media Campaign data Analytics Roles and Responsibilities : Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory to ingest, transform, and integrate data from multiple internal and external sources. Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets. Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver efficient data solutions. Optimize data processing performance and implement best practices for data engineering in cloud environments. Work in Agile development environments, contributing to sprint planning, re...

Lumen is seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining data pipelines and architectures that enable effective data collection and analysis. You will work closely with data analysts and data scientists to ensure that our data infrastructure supports the needs of the business. Your expertise will help enhance our data quality and provide actionable insights that drive strategic decisions. Key Responsibilities: 6-8 years of hands-on experience predominantly in data engineering , ETL/ELT , and modern data platforms such as ( Synapse, Databricks , Big Query). Proven experience in data warehouse migration ...

Experienced Data Engineer with 5+ years of hands-on development using Python (preferred), along with strong proficiency in Scala, Java, or C#. Skilled in designing and building high-performance, scalable data pipelines and architectures. Specialized in working with PySpark on Databricks, and experienced across a range of data engineering tools including Snowflake, BigQuery, Apache Spark, Hive, Hadoop, Cloudera, and Redshift. Key Competencies: Programming & Development: 5+ years of experience developing data-centric applications using Python (preferred), with additional expertise in Scala, Java, or C#. Big Data & Cloud Platforms: Deep experience with cloud-based and on-premise data platforms ...

Role Proficiency: Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities Outcomes: Interpret the application/feature/component design to develop the same in accordance with specifications. Code debug test document and communicate product/component/feature development stages. Validate results with user representatives; integrates and commissions the overall solution Select appropriate technical options for development such as reusing improving or reconfiguration of existing components or creating own solu...

Position Summary The Solutions Architect for the Data & Analytics (D&A) portfolio will lead the design, development, and governance of scalable, high-performance data solutions that empower business insights and decision-making. This role will serve as the bridge between business stakeholders, data engineers, platform teams, and enterprise architects to ensure that data-driven systems align with Prologis' technology strategy and D&A roadmap. The architect will also play a strategic role in leveraging emerging technologies such as Generative AI (GenAI) to accelerate modernization and data value realization across the enterprise. Key Responsibilities 1. Solution Architecture & Design Develop e...

Role Proficiency: This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Outcomes: Act creatively ...

Role Proficiency: Role Scope / Deliverables: Scope of Role Serve as the link between business intelligence, data engineering, and AI application teams, ensuring the Large Language Model (LLM) interacts effectively with the modeled dataset. Define and curate the context and knowledge base that enables GPT to provide accurate, relevant, and compliant business insights. Collaborate with Data Analysts and System SMEs to identify, structure, and tag data elements that feed the LLM environment. Design, test, and refine prompt strategies and context frameworks that align GPT outputs with business objectives. Conduct evaluation and performance testing (evals) to validate LLM responses for accuracy, ...

Role Proficiency: This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Outcomes: Act creatively ...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

TCS is conducting Weekday Virtual drive for the role of Azure Data Engineer. Years of experience: 5 to 10 yrs Location: Hyderabad Notice Period: 0 to 60 days Date of Interview: 6th Nov 2025 Time of Interview: 10 AM to 2 PM Roles & Responsibilities: Relevant experience in Pyspark and Azure Databricks. Developing, managing and optimizing robust and reliable data pipelines using azure native capabilities. Implement ADF workflows that perform data ingestion, data integration/ETL, statistical model executions etc. Creating architecture for data solutions with high performance characteristics Bringing data and analytics products to production Implement CI/CD pipelines for data solutions Build dash...

As a Database Administrator at Revenge and portfolio company systems, your primary responsibility is to maintain the operations of databases and DBMSs efficiently. You will be focusing on code deployments following change management processes and executing policies, procedures, and standards related to database management. Your role will involve assisting in the general system administration of both legacy and cloud resources that interact with the database systems. Key Responsibilities: - Maintain operations of databases and DBMSs - Perform code deployments following change management processes - Review and execute policies, procedures, and standards related to database management - Assist ...

Role & responsibilities Years of Experience: 6 to 10yrs Location: Bangalore & Hyderabad Notice Period: 0 to 60 days Date of Interview : 5th, 6th, 7th, 8th Nov, 2025 Kindly apply if there is a skill match with 6+yrs of experience. Job Description: Overall 6+ years of work experience in Data Warehouse(DWH) Development Experience in AzureDatabricks, Pyspark, Python , SQL Hands on exp in Azure data factory, data bricks Design, implement, and manage data solutions on Azure Develop and maintain data pipelines using Databricks Ensure efficient data storage and retrieval using Azure Storage and Data Lake Automate infrastructure and application deployments with Ansible Write clean, maintainable code ...

Requisition Id : 1627334 As a global leader in assurance, tax, transaction and advisory services, we hire and develop the most passionate people in their field to help build a better working world. This starts with a culture that believes in giving you the training, opportunities and creative freedom. At EY, we don't just focus on who you are now, but who you can become. We believe that it's your career and It's yours to build which means potential here is limitless and we'll provide you with motivating and fulfilling experiences throughout your career to help you on the path to becoming your best professional self. The opportunity : Assistant Manager-Operations-Operations-CBS - ITS - Local ...

We are seeking a skilled Snowflake Developer with a strong background in Data Warehousing (DWH), SQL, Informatica, Power BI, and related tools to join our Data Engineering team. The ideal candidate will have 5+ years of experience in designing, developing, and maintaining data pipelines, integrating data across multiple platforms, and optimizing large-scale data architectures. This is an exciting opportunity to work with cutting-edge technologies in a collaborative environment and help build scalable, high-performance data solutions. Key Responsibilities Minimum of 5+ years of hands-on experience in Data Engineering, with a focus on Data Warehousing, Business Intelligence, and related techno...

We are Hiring For Data Engineer (Python Pyspark Data bricks) Required Technical Skill Set** (Python Pyspark Data bricks) Desired Experience Range** 6+ Location of Requirement Hyderabad Desired Competencies (Technical/Behavioral Competency) Must-Have** Job Expectations: Job Expectations: Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal ingestion, transformation, and Publishi...