6138 Data Bricks Jobs - Page 23

Role & responsibilities Data Analysis & Reporting Perform data extraction, transformation, and analysis using Python, Databricks and SQL. Develop and validate dashboards and reports to present insights to business teams. Validate data accuracy and consistency across multiple sources. Collaboration Work closely with data engineers to ensure availability of clean, curated datasets. Partner with business stakeholders to understand requirements and deliver meaningful insights. Support ad-hoc analysis for strategic initiatives. Optimization & Governance Ensure compliance with data governance and security standards. Optimize queries for performance and cost efficiency. Maintain documentation for d...

Role & responsibilities 8+ years of experience as a Data Engineer, with a focus on Databricks and cloud-based data platforms, with a minimum of 4 years of experience in writing unit/end-to-end tests for data pipelines and ETL processes on Databricks. Hands-on experience in PySpark programming for data manipulation, transformation, and analysis. Strong experience in SQL and writing complex queries for data retrieval and manipulation. Experience in Docker for containerising and deploying data engineering applications is good to have. Strong knowledge of the Databricks platform and its components, including Databricks notebooks, clusters, and jobs. Experience in designing and implementing data ...

As a Data and Analytics (D And A) Azure Data Engineer - Senior at EY, you will have the opportunity to be part of a global team that helps clients solve complex business challenges using data and technology. Your role will involve developing and deploying big data pipelines in a cloud environment using Azure Cloud services, designing and optimizing model codes for faster execution, and interacting with senior leaders to understand and contribute to workstreams. Key Responsibilities: - Develop & deploy big data pipelines in a cloud environment using Azure Cloud services - ETL design, development and migration of existing on-prem ETL routines to Cloud Service - Interact with senior leaders, un...

As a Cloud Data PM at Dexian India, you will be responsible for leveraging your over 10 years of hands-on experience in Azure, DWH, ETL, and Presales to drive successful data projects. Your role will be based in Chennai with a shift from 2.00pm to 11.00pm IST. **Key Responsibilities:** - Solid understanding of SQL and data modeling - Proficiency in DWH architecture, including EDW/DM concepts and Star/Snowflake schema - Experience in designing and building data pipelines on Azure Cloud stack - Familiarity with Azure Data Explorer, Data Factory, Data Bricks, Synapse Analytics, Azure Fabric, Azure Analysis Services, and Azure SQL Datawarehouse - Knowledge of Azure DevOps and CI/CD Pipelines - P...

Job Title: Data Engineer Databricks Exp-2-6yrs Location- Hyderabad Role Summary: As a Data Engineer focusing on Databricks, you will be responsible for designing, implementing, and maintaining scalable data pipelines and data lakehouse solutions. You will translate business requirements into reliable technical implementations using Databricks features, ensuring high performance, data quality, and security across projects. Responsibilities: Develop and maintain Databricks-based data pipelines, data models, and ETL/ELT processes. Collaborate with senior engineers and architects to ensure high-quality solution design. Implement data ingestion strategies using Auto Loader, Delta Live Tables (DLT...

Data Quality Engineer Desired Experience Range: 7 - 10 years Location of Requirement: Bangalore Required Experience/Skills: Experience in data quality engineering, software testing, or data engineering. Strong proficiency in SQL and Python with the ability to validate large datasets. Experience with Snowflake, Databricks, Spark, Airflow, or similar tools. Proven ability to build and scale automated data testing frameworks. Experience leading strategic initiatives and/or managing engineering team members. Strong problem-solving and debugging skills; able to anticipate and prevent data issues. B.S. in Computer Science (or equivalent degree or work experience) Nice to have: Experience with BDD ...

We at Aegis Global are recruiting for Senior Azure Datafactory Consultants to join our Pan India team ( ONLY IMMEDIATE JOINERS- who can join within 10 days ) We are recruiting for Experienced & Senior Azure Data Engineers with 5+ years of experience , strong hands-on expertise in Azure Databricks, PySpark, Delta Lake, and Unity Catalog. The role involves building scalable pipelines using ADF, API integrations, and Fusion PVO extraction . Key Responsibilities : • Develop and optimize data pipelines using Azure Databricks and PySpark • Build Delta Lake tables (MERGE, OPTIMIZE, ZORDER, schema evolution) • Manage data governance and security through Unity Catalog • Create and orchestrate ADF pip...

Position: Databricks Developer Location: Hyderabad Experience: 511 Years Notice Period: Immediate Joiners Preferred About the Role We are looking for an experienced Databricks Developer with strong expertise in building scalable data pipelines using Apache Spark, Delta Lake, and cloud-native data platforms. The ideal candidate must have hands-on experience in Databricks development across AWS/Azure/GCP environments. Key Responsibilities Develop scalable and high-performance data pipelines using Databricks (PySpark/Scala). Implement Delta Lake, optimized storage layers, and advanced Lakehouse architecture. Build batch and streaming ETL/ELT jobs for ingestion, transformation, and enrichment. C...

Role Overview: In today's market, there is a unique duality in technology adoption. On one side, extreme focus on cost containment by clients, and on the other, deep motivation to modernize their Digital storefronts to attract more consumers and B2B customers. As a leading Modernization Engineering company, Sonata Software aims to deliver modernization-driven hypergrowth for clients based on the deep differentiation created in Modernization Engineering, powered by the Lightening suite and 16-step Platformation playbook. Key Responsibilities: - Design and Development: Architect, design, and implement data solutions using Microsoft technologies such as SQL Server, Azure Data Services, Power BI...

As a Senior Data Analyst, you will be responsible for leading complex data analysis projects, delivering actionable insights, and supporting strategic decision-making across the organization. You will collaborate with cross-functional teams and mentor junior analysts to drive a data-driven culture and achieve business outcomes. Key Responsibilities: - Lead the design, implementation, and delivery of advanced data analyses and reporting solutions. - Partner with business stakeholders to identify opportunities, define metrics, and translate business requirements into analytical solutions. - Develop, maintain, and optimize dashboards, reports, and data visualizations for various audiences. - Pe...

As a Project Management Professional at YASH Technologies, you will be part of a team dedicated to helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation in an increasingly virtual world. **Role Overview:** - Lead technical design and architecture discussions across cross-functional teams. - Oversee software requirements including design, architecture, and testing. - Manage projects through agile methodologies, such as Scrum. - Decipher technical needs of other departments and translate them across stakeholder groups. **Key Responsibilities:** - Should have 15+ years of experience hand...

Preferred candidate profile - 7+ years in data engineering with strong hands-on PySpark and Databricks (jobs, notebooks, clusters, Delta Lake). Proven experience building and operating data pipelines on AWS (S3, Glue/EMR, Lambda, Athena, Redshift, Kinesis/MSK). Solid understanding of Spark internals (RDD/DataFrame APIs, Catalyst, Tungsten), file formats ( Parquet , ORC , Avro ), and streaming (Structured Streaming). Strong SQL , data modeling (dimensional/lakehouse), and performance tuning skills. Experience with workflow orchestration (Airflow/Databricks Workflows) and CI/CD for data projects. Proficiency in Git and collaborative development in a notebook + repo workflow. Knowledge of secur...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Azure/SQL/Application - Data Engineer Job description: Responsible to maintain the data required for managed application like Advanced Planning System, Dealer Management System, etc., Responsible for user access management on data upload and download Working with functional team to manage the required data in a structured manner Make use of Azure services like Data Factory, Data Lake, Machine Learning, SQL Warehouse, Data Bricks for data extraction. Building real-time data pipelines from on-prem SAP DB to cloud along with required API. Python model development and continuous improvement through containerization. Conduct basic exploratory analytics for insights. Working with Azure SQL databas...

Hiring for Associate Manager - AWS, Data bricks, Pyspark, Python Candidate should have 10+ Years of relevant experience WFO / Both Side cabs Salary Up to = 31 LPA Fixed + Variables

Role & responsibilities Position: Senior Developer (Azure Data Engineer) Experience: 6-8 Years No. Of Position: 2 were always looking to strengthen our business by adding the best available people to our team. Were currently seeking a Senior Azure Data Engineer to work closely with our Data Analytics team in driving the adoption, optimization, and iteration, leveraging multiple integrations and technologies. The ideal candidate will have at least 3-10 years of experience with technical implementation of customer projects. Using their expertise, problem-solving ability, and creative flair, the consultant will design, build, deliver, and maintain. The consultant will also help develop business...

Job Overview Primary Responsibilities Design, develop, and maintain data lakes and data pipelines on AWS using ETL frameworks and Databricks. Integrate and transform large-scale data from multiple heterogeneous sources into a centralized data lake environment. Implement and manage Delta Lake architecture using Databricks Delta or Apache Hudi. Develop end-to-end data workflows using PySpark, Databricks Notebooks, and Python scripts for ingestion, transformation, and enrichment. Design and develop data warehouses and data marts for analytical workloads using Snowflake, Redshift, or similar systems. Design and evaluate data models (Star, Snowflake, Flattened) for analytical and transactional sy...

Job Description Join our AWS Data Engineer Walkin drive on 13th Dec'25 Years of Exp : 5-10 Years Primary Skillset: AWS,Python,SQL,Pyspark, Databricks and Data Modelling -Knowledge. Walkin Drive : 13th Dec'25 Time : 10.30 AM-3.00PM Registration Link For Walkin Drive: https://agilisium.zohorecruit.com/jobs/Careers/589705000033514003/Data-Engineer?source=CareerSite Venue: World Trade Center 1st floor of Tower B, 5/142, Rajiv Gandhi Salai, Perungudi, Chennai, Tamil Nadu 600096 Job Description: Proven experience as a Data Engineer (typically 5-10 years, depending on level). Strong hands-on experience with Python for data engineering tasks. Proficiency in SQL (writing complex queries, performance ...

SUMMARY Wissen Technology is Hiring for Data Modeling Architect About Wissen Technology : At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting...

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. You will collaborate with the Integration Architects and Data A...

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, collaborating with Integration Architects and Data Architects to ensure cohesive integration between systems and da...

Key Responsibilities: Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with various data sources and systems. Collaborate with cross-functional teams to understand data, and deliver effective BI solutions. Implement data ingestion, transformation, and processing workflows using Spark(PySpark/Scala), SQL, and Databricks notebooks. Develop and maintain data models, ETL/ELT processes ensuring high performance, reliability, scalability and data quality. Build and maintain APIs and data services to support analytics, reporting, and application integration. Ensure data quality, integrity, and security across all stages of the data lifecycle. Monitor, troublesh...

Role & responsibilities 8+ years of experience as a Data Engineer, with a focus on Databricks and cloud-based data platforms, with a minimum of 4 years of experience in writing unit/end-to-end tests for data pipelines and ETL processes on Databricks. Hands-on experience in PySpark programming for data manipulation, transformation, and analysis. Strong experience in SQL and writing complex queries for data retrieval and manipulation. Experience in Docker for containerising and deploying data engineering applications is good to have. Strong knowledge of the Databricks platform and its components, including Databricks notebooks, clusters, and jobs. Experience in designing and implementing data ...

Role & responsibilities - Own end-to-end delivery of Databricks platform rollouts across OEs. - Define project plans, milestones, and resource allocations. - Coordinate across teams and stakeholders to ensure timely execution. - Manage risks, dependencies, and escalations during onboarding. - Ensure compliance with governance, security, and operational standards. - Report progress and KPIs to internal leadership and customer stakeholders.

Role: Data Engineer Location: Onsite/Bangalore- Candidate must be local to Bangalore - interviews will be virtual Experience: 5-8 years Databricks-3+ yrs AWS-5+ yrs Governance & Advanced: (Immuta/Privacera), AI/ML pipeline integration.