6143 Data Bricks Jobs - Page 44

Duties/ Roles & Responsibilities Lead the design, optimization, and scaling of data pipelines using Data bricks, Spark, and advanced SQL. Drive architectural decisions, enforce best practices, and mentor teams on distributed data processing and lake house patterns. Collaborate with cross-functional partners to deliver high-quality, reliable data solutions that support analytics and business objectives.

Duties/ Roles & Responsibilities Lead the design, optimization, and scaling of data pipelines using Data bricks, Spark, and advanced SQL. Drive architectural decisions, enforce best practices, and mentor teams on distributed data processing and lake house patterns. Collaborate with cross-functional partners to deliver high-quality, reliable data solutions that support analytics and business objectives.

Roles and Responsibilities Location - Bangalore/Hyderabad/Noida Exp - 5 - 12 years Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions such as Blob Storage, File Share, and SQL Database. Collaborate with cross-functional teams to understand business requirements and design scalable data architectures that meet those needs. Develop complex SQL queries to optimize database performance and troubleshoot issues in Microsoft Azure environments. Implement data bricks solutions using Azure Databricks for big data processing tasks. Interested candidates can share profiles to mary...

Job Summary: We are seeking a highly skilled Lead Data Engineer to join our dynamic team. The ideal candidate will possess a strong background in data engineering, with a focus on designing and implementing robust data solutions. This role requires expertise in AWS, PySpark, and Apache Flink for real-time streaming applications. The Lead Data Engineer will be responsible for architecting data solutions that meet business needs while ensuring scalability, reliability, and performance. Responsibilities: Design and implement data pipelines and architectures to support real-time data processing and analytics. Collaborate with cross-functional teams to gather requirements and translate them into ...

As a Data Engineering Manager at EY, you will be responsible for leading large scale solution architecture design and optimization to provide streamlined insights to partners throughout the business. You will lead a team of Mid and Senior data engineers to partner with visualization on data quality and troubleshooting needs. Your key responsibilities will include: - Implementing data processes for the data warehouse and internal systems - Leading a team of Junior and Senior Data Engineers in executing data processes and providing quality, timely data management - Managing data architecture and designing ETL processes - Cleaning, aggregating, and organizing data from disparate sources and tra...

Dear Candidate, Greetings from HCL Technologies!! I am pleased to inform you we have bulk Data Engineer openings for Bangalore location, and your resume is shortlisted from Naukri.com. Years of exp: 5+ to 8 Skills: Databricks, AWS/Azure Work Mode: Hybrid Location: Bangalore - Whitefield Notice: Immediate to 30Days If you are interested from this position, please share the details given below with updated resume to ashwini.br@hcltech.com Name- Current Location- Preferred Location- Current Salary- Preferred salary- Any Counter Offer Yes/No-If yes please mention which company and location Notice Period/Expected date of joining-

Design, develop new features for a large-scale cloud data platform using Databricks, snowflake and Fabric, Deeply understand legacy data platforms, and drive their modernization, Provide production support Design data pipelines and data warehouse. Required Candidate profile 5 years in developing and scaling data platforms using Snowflake, databricks, Fabric, Strong Python and SQL Intermediate C# Understanding of modern data architectures such as Data Mesh, Lakehouse

Job Title: MLOps Engineer Description: We are seeking an experienced MLOps Engineer to join our team and play a key role in deploying, automating, monitoring, and optimizing machine learning solutions. The ideal candidate will have strong experience with Databricks, SQL, Python, PySpark, and CI/CD pipelines, along with hands-on exposure to Jenkins, SonarQube, Jira, and Git. You will collaborate with data scientists, data engineers, and DevOps teams to streamline the ML lifecycle from model development to production deployment and monitoring. Key Responsibilities Design, implement, and maintain MLOps pipelines for machine learning model deployment and monitoring. Collaborate with data scienti...

Location: Hyderabad Work Mode: Hybrid Experience Required: 5 7 Years Notice Period: Immediate to 30 Days Job Description We are looking for an experienced Databricks Engineer with strong expertise in Python, PySpark, and AWS to join our team. The ideal candidate should have hands-on experience in building scalable data pipelines and working with cloud-based data platforms. Key Responsibilities Develop, optimize, and maintain PySpark scripts and data pipelines in Databricks . Work with AWS cloud services such as S3, Lambda, EMR, Glue, IAM, and CloudWatch. Perform data transformations, data ingestion, and ETL operations. Design and implement scalable data solutions on Databricks. Collaborate w...

Role Proficiency: This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required. Outcomes: Act creatively ...

What you'll do Develop, maintain, and enhance new data sources and tables, contributing to data engineering efforts to ensure comprehensive and efficient data architecture. Serves as the liaison between Data Engineer team and the Airport operation teams, developing new data sources and overseeing enhancements to existing database; being one of the main contact points for data requests, metadata, and statistical analysis Migrates all existing Hive Metastore tables to Unity Catalog, addressing access issues and ensuring smooth transition of jobs and tables. Collaborate with IT teams to validate package (gold level data) table outputs during the production deployment of developed notebooks Deve...

Educational Requirements Bachelor of Engineering,BTech,BCA,BSc,MTech,MCA,MSc Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to get to the heart of customer issues, diagnose problem areas, design innovative solutions and facilitate deployment resulting in client delight. You will develop a proposal by owning parts of the proposal document and by giving inputs in solution design based on areas of expertise. You will plan the activities of configuration, configure the product as per the design, conduct conference room pilots and will assist in resolving any queries related to requirements a...

Educational Requirements Bachelor of Engineering,Bachelor Of Science,Bachelor Of Technology,Bachelor Of Commerce,Bachelor Of Comp. Applications,Master Of Engineering,Master Of Science,Master Of Technology,Master Of Commerce,Master Of Comp. Applications,Master Of Business Adm. Service Line Enterprise Package Application Services Responsibilities A day in the life of a BI consultant at Infosys involves: Engaging with customers on a regular basis and providing them with the best-in-class IT consulting services and solutions Collaborating with clients business users and IT stakeholders, defining the to-be processes and producing detailed functional and technical design specifications based on re...

Educational Requirements Bachelor of Engineering,BBA,BSc Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to get to the heart of customer issues, diagnose problem areas, design innovative solutions and facilitate deployment resulting in client delight. You will develop a proposal by owning parts of the proposal document and by giving inputs in solution design based on areas of expertise. You will plan the activities of configuration, configure the product as per the design, conduct conference room pilots and will assist in resolving any queries related to requirements and solution design Y...

Educational Requirements Bachelor of Engineering,BSc,MSc,MCA Service Line Data & Analytics Unit Responsibilities Understand the requirements from the business and translate it into an appropriate technical requirement. Responsible for successful delivery of MLOps solutions and services in client consulting environments; Define key business problems to be solved; formulate high level solution approaches and identify data to solve those problems, develop, analyze/draw conclusions and present to client. Assist clients with operationalization metrics to track performance of ML Models Help team with ML Pipelines from creation to execution Guide team to debug on issues with pipeline failures Under...

Educational Requirements Bachelor of Engineering,BSc,BBA,MSc,MCA Service Line Data & Analytics Unit Responsibilities Understand the requirements from the business and translate it into an appropriate technical requirements. Creating a detailed business analysis, outlining problems, opportunities and solutions for a business. Perform activities related to data wrangling, model building and model deployment. Stay current with the latest research and technology and communicate your knowledge throughout the enterprise. Lead initiatives to improve the team morale, camaraderie, and collaboration Technical and Professional Requirements: Generative AI, AI/ML, Python, Databricks Preferred Skills: Tec...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Job Description We are hiring an experienced Data Engineer with strong hands-on expertise in Spark, Databricks, Python/Scala , and end-to-end ETL pipeline development. The candidate will be responsible for analysis, design, architecture, development, and support of large-scale data pipelines on the Databricks platform. Key Responsibilities Design, build and support ETL pipelines using Spark & Databricks. Analyze requirements, create technical specifications, and deliver high-quality code. Ensure solutions follow enterprise best practices, architecture, and compliance standards. Collaborate with global teams to ensure consistent and high-quality deliverables. Conduct unit testing, debugging, ...

Role & responsibilities: Translate functional specifications and change requests into technical specifications Translate business requirement document, functional specification, and technical specification to related coding Develop efficient code with unit testing and code documentation Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving Setting up the development environment and configuration of the development tools Communicate with all the project stakeholders on the project status Manage, monitor, and ensure the security and privacy of data to satisfy business needs Contribute to the automation of modules, wherever ...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions. Collaborate with cross-functional teams to gather requirements and design scalable data architectures that meet business needs. Develop complex SQL queries to optimize database performance and troubleshoot issues in Microsoft Azure databases. Implement machine learning models using PySpark on Databricks for predictive analytics applications. Desired Candidate Profile 5-10 years of experience as an ADF developer with expertise in big data technologies such as Hadoop, Spark, Kafka. Strong under...

Responsibilities: Design, develop & maintain GCP data pipelines using Data Bricks, Unity Catalog, PySpark, SQL & Terraform. Collaborate with cross-functional teams on CI/CD processes for data solutions.

Key Responsibilities Design, develop, and deploy ML models for predictive analytics, computer vision, or NLP use cases. Build scalable data ingestion and preprocessing pipelines using Python (Pandas, PySpark, etc.). Implement and optimize ML workflows using frameworks like TensorFlow, PyTorch, or scikit-learn. Collaborate with data engineers and data scientists to integrate models into production systems. Automate model retraining, monitoring, and performance tracking. Required Skills & Qualifications Bachelors or Masters degree in Computer Science, Data Science, Engineering, or a related field. 4.9 years of hands-on experience in Python-based AI/ML development. Good to have understanding of...

Role & responsibilities Job Title: MLOps Engineer About the Role We are seeking an experienced MLOps Engineer to join our team and play a critical role in deploying, automating, monitoring, and optimizing machine learning solutions. The ideal candidate will have strong hands-on experience with Databricks, Python, PySpark, SQL, and CI/CD pipelines , along with exposure to Jenkins, SonarQube, Jira, and Git . You will work closely with data scientists, data engineers, and DevOps teams to streamline the end-to-end ML lifecyclefrom model development to production deployment and continuous monitoring. Key Responsibilities Design, implement, and maintain MLOps pipelines for ML model deployment and ...

Work Location: - ~ CHENNAI~BANGALORE~ Experience: - 6 to 8 Skill Required: Azure data Engineer, Databricks, ADF Role Description: Design, develop, and optimize data pipelines using Azure Data Factory (ADF) and Databricks for scalable data processing and transformation. Collaborate with cross-functional teams in an Agile environment to deliver end-to-end data solutions for business analytics. Implement and maintain efficient ETL/ELT workflows to integrate data from multiple sources into Azure environments like Data Lake and Synapse Analytics .

Description: We are seeking an experienced MLOps Engineer to join our team and play a key role in deploying, automating, monitoring, and optimizing machine learning solutions. The ideal candidate will have strong experience with Databricks, SQL, Python, PySpark, and CI/CD pipelines, along with hands-on exposure to Jenkins, SonarQube, Jira, and Git. You will collaborate with data scientists, data engineers, and DevOps teams to streamline the ML lifecycle from model development to production deployment and monitoring. Key Responsibilities Design, implement, and maintain MLOps pipelines for machine learning model deployment and monitoring. Collaborate with data scientists to package and deploy ...