6138 Data Bricks Jobs - Page 18

Architect with Data bricks expeience, nice to have is fabrics, 15+ years experience Detailed JD will be updated shortly

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Primary Skill: Azure infrastructure ,Databricks architecture,Python Secondary Skill: Azure Monitor, Azure Database platform,Cosmos DB, MongoDB JD: In this role, you will: • Architect and deploy scalable Databricks solutions on Azure. • Develop and implement data pipelines, ETL processes, and machine learning workflows using Databricks and Azure services. • Monitor Databricks performance and optimize configurations for efficiency and cost-effectiveness. • Implement best practices for data storage, processing, and analysis to ensure optimal performance. • Ensure Databricks environments comply with security standards and regulatory requirements. • Implement and manage data encryption, access co...

Key Responsibilities Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF) , Databricks , Synapse Analytics , and related Azure services. Implement ETL/ELT processes to integrate data from multiple structured and unstructured data sources. Build and optimize data lake and data warehouse solutions in Azure Data Lake Storage (ADLS) and Azure Synapse . Collaborate with data scientists, analysts, and business stakeholders to deliver scalable data solutions. Develop CI/CD pipelines for data workflows using Azure DevOps or equivalent tools. Implement data governance, quality, and security best practices following enterprise standards. Monitor, troubleshoot, and opt...

Design and implement Azure-based data solutions using Databricks, Data Factory, Synapse Analytics, and Data Lake services. Develop data pipelines, APIs, and orchestration frameworks for seamless data ingestion, transformation, and delivery. Establish and maintain data governance, metadata, and lineage frameworks using Databricks Unity Catalog and Azure Purview. Build and maintain ETL/ELT frameworks, data APIs, and real-time workflows connecting diverse HR and enterprise systems. Leverage AI and ML capabilities within Databricks to build intelligent data agents for automation, monitoring, and analytics enrichment. Apply best practices for performance optimization, scalability, and cost effici...

Consolidate and analyze large datasets, queries, and reports from operational and financial systems. Build metadata and set up data capture and input processes, assigning context to business data. Conduct exploratory analyses to identify trends, success indicators, and performance insights. Prepare and lead monthly ad-hoc reviews with business partners, providing insights and clear understanding of variances. Support monthly forecast cycles, work on high-impact projects, and troubleshoot system-related issues. Develop and maintain scalable code using Python, SQL, and advanced analytics techniques. Disclaimer: This job description has been sourced from a public domain and may have been modifi...

Consolidate and analyze large datasets, queries, and reports from operational and financial systems. Build metadata and set up data capture and input processes, assigning context to business data. Conduct exploratory analyses to identify trends, success indicators, and performance insights. Prepare and lead monthly ad-hoc reviews with business partners, providing insights and clear understanding of variances. Support monthly forecast cycles, work on high-impact projects, and troubleshoot system-related issues. Develop scalable code using Python, SQL, and advanced knowledge of backend development. Disclaimer: This job description has been sourced from a public domain and may have been modifie...

Design, build, and optimize cloud-native ingestion, transformation, and enrichment pipelines using Azure. Implement data joins, validation frameworks, profiling, and quality checks to ensure analytics-ready datasets. Engineer scalable feature pipelines and reusable data products for advanced analytics and ML workloads. Maintain data quality, lineage, and metadata in collaboration with Data Governance teams. Contribute to automated deployment workflows using DevOps/CI/CD, GitHub Actions, Terraform, and related tools. Perform end-to-end Exploratory Data Analysis (EDA) to identify trends, anomalies, and insights. Build, validate, and deploy machine learning models (supervised and unsupervised)....

Were Hiring: Senior Data Engineer | Bangalore If you love building things that actually move data with speed and clarity, this role will feel like home. You’ll spend your days shaping scalable pipelines, owning cloud-first solutions, and partnering with people who genuinely care about doing good work. Here’s what the job looks like: What you’ll do • Refactor and build reusable data pipelines in AWS and Databricks • Work closely with analysts, data scientists, architects, and business teams • Build cloud-native solutions across data lakes, warehouses, ETL and backend services • Take part in code reviews and solid documentation • Tune pipelines for cost, scale, reliability, and security • Put ...

The Lead Data Engineer will provide technical expertise in analysis, design, development, rollout and maintenance of data integration initiatives. This role will contribute to implementation methodologies and best practices, as well as work on project teams to analyse, design, develop and deploy business intelligence / data integration solutions to support a variety of customer needs. This position oversees a team of Data Integration Consultants at various levels, ensuring their success on projects, goals, trainings and initiatives though mentoring and coaching. Key Role and Responsibilities: Design, develop, test, and deploy data integration processes (batch or real-time) using tools such a...

Hiring: Data Engineer (5+ Years) Chennai | Hybrid | Face-to-Face Interview on 13th We are looking for an experienced Data Engineer with strong expertise in modern data platforms, cloud technologies, and scalable data pipelines. Experience: 5–10 Years Location: Chennai Mode: Hybrid Interview: Face-to-face on 13th (Mandatory) Key Skills & Responsibilities Proven hands-on experience as a Data Engineer. Strong Python skills for data engineering workflows. Expertise in SQL (complex queries, performance optimization). Strong working knowledge of PySpark and Databricks. Experience with AWS services – S3, Glue, EMR, Redshift, Lambda, etc. Proficiency in data pipeline orchestration tools (Airflow, St...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Databricks, Delta Live Table, and Data Factory. Troubleshoot issues related to data quality, performance tuning, and scalability in a distributed computing environment. Desired Candidate Profile 4-6 years of experience in designing and developing large-scale data pipelines using Azure Databricks, Delta Live Table, or similar technologies. Strong understanding of PySpark programming language for working with big data sets. Proficiency in writing efficient SQL queries for extracting insights from relational databases (e.g., Oracle). Experience with building ETL processes using Azure Data Factory (AD...

Key Responsibilities Technical Leadership & Project Execution Provide technical thought leadership, compare different technologies to meet business requirements and cost control drivers. Work with Business and IT groups to design and deliver a data lake platform. Produce & maintain the overall solution design for the entire Data Lake Platform. Execution of data strategy, help in the design and architecture of solutions on the platform Enforce technical best practices for Big Data management and solutions, from software selection to technical architectures and implementation processes. Document and publish best practices, guidelines, and training information. Ensures all functional solutions ...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...