2920 Data Bricks Jobs - Page 23

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Job Summary We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in Data Analysis & analytics using Azure technologies. Will be responsible for designing, developing, and maintaining data pipelines and solutions within the Azure technologies like Azure Databricks, Azure Data Factory, Cloud DB-Azure SQL and ensuring data quality, consistency, and security while collaborating with other teams to meet busin...

About Position: We are looking for an experienced and talented Python Architect to join our growing data competency team. The ideal candidate will have a strong background in working with Lead Python Platform, Apache Beam + Databricks platform, parsing/OCR, Validation, Implementation, Cloud (AWS/Azure/GCP). We have built the core features, but need a senior engineer to architect. Role: Python Architect Location: All Persistent Locations Experience: 7 to 14 Years Job Type: Full Time Employment What You'll Do: Architecture and reuse: Design and build a shared component library/SDK for pipelines: ingestion, parsing/OCR, extraction (RegEx now, LLM/SLM later), validation, enrichment, publishing. ...

Role & responsibilities Data Products Enhancement: Collaborate with cross-functional teams to agentify” current Data Products, enabling intelligent and adaptive data flows that support evolving business needs. Agentification of ETL Pipelines: Transformation of existing ETL and data ingestion pipelines by embedding agentic architectures. This involves re-engineering traditional pipelines to harness autonomous agents for enhanced automation, scalability, and adaptability. Build and Deploy Domain specific AI Co-pilots and Agents for Data Engineering with integrated experience with Databricks. Build and Deploy Insights Agents: Design, implement, and operationalize insights agents capable of auto...

Role & responsibilities Data Products Enhancement: Collaborate with cross-functional teams to agentify current Data Products, enabling intelligent and adaptive data flows that support evolving business needs. Agentification of ETL Pipelines: Transformation of existing ETL and data ingestion pipelines by embedding agentic architectures. This involves re-engineering traditional pipelines to harness autonomous agents for enhanced automation, scalability, and adaptability. Build and Deploy Domain specific AI Co-pilots and Agents for Data Engineering with integrated experience with Databricks. Build and Deploy Insights Agents: Design, implement, and operationalize insights agents capable of autom...

Greetings from Future Focus Infotech!!! We have multiple opportunities Azure Devops Engineer Exp: 5+yrs Location : Mumbai Job Type- This is a Permanent position with Future Focus Infotech Pvt Ltd & you will be deputed with our client. A small glimpse about Future Focus Infotech Pvt Ltd. (Company URL: www.focusinfotech.com) If you are interested in above opportunity, send updated CV and below information to reema.b@focusinfotech.com Kindly mention the below details. Total Years of Experience: Current CTC: Expected CTC: Notice Period : Current location: Available for interview on weekdays : Pan Card : Thanks & Regards, Reema reema.b@focusinfotech.com 8925798887

Job Requirements 1 . Job Description : AI/ML/GenAI Architect with Microsoft Azure Cloud skills Responsibilities: Design and implement advanced AI solutions, including machine learning models, computer vision applications, OCR systems, and Generative AI (GenAI) solutions using frameworks like TensorFlow, Pytorch, OpenCV and Langchain. knowledge of AI orchestration, AI Agents, Agentic AI, Enterprise Integration skills, distributed and event based architectures Develop end-to-end machine learning pipelines, from data collection and preprocessing to model training and deployment, utilizing Python libraries such as Pandas and NumPy. Architect and implement robust MLOps infrastructure to support m...

ADF (Azure datafactory) Databricks Sql queries (ms sql, MySQL, Cassandra etc.. any) Working Knowledge on any ETL tool (preferably on Talend) not mandatory but good to have. Working Knowledge on job scheduling tool. Experience in monitoring scheduled jobs. Working Knowledge on SLA, driving high priority issues and escalation handling.

Role & responsibilities Bachelors or master’s degree in computer science, Information Technology, or a related field. Proven experience as a Data Analyst or in a similar role, with 7-15 years of hands-on experience in developing data pipelines and managing data infrastructure. Demonstrated expertise in working with Data Bricks for data processing and analysis. Python and SQL experience required Worked on end-to-end Data Product deployment Deployment experience (various databases, server/cloud environment: AWS, Azure, and APIs, ODBCs, web apps) Excellent knowledge or experience in Banking Domain Good written, oral communication, documentation skills with ability to communicate effectively wit...

Job Purpose The Senior Data Engineer will be responsible for designing, building, and maintaining scalable and efficient data pipelines and architectures for the Enterprise Data Platform. This role will focus on enabling high-quality, reliable, and timely data access for analytics, reporting, and business decision-making. Working closely with business analysts, data scientists, and architects, the Senior Data Engineer will ensure data solutions meet business needs and adhere to best practices and governance standards Duties and Responsibilities Design and implement robust, scalable, and high-performance data pipelines and ETL/ELT processes. Develop, optimize, and maintain data architectures ...

Please look for a mid-senior level profile with 68 years of experience. The primary skill set is Data Scientist with strong Azure experience , The candidate should have expertise in the following areas: Core Expertise • End-to-end data science workflow: data preparation, feature engineering, model building, validation, and deployment • Proficiency in descriptive and inferential statistics • Algorithm development for solving business problems Azure Cloud Skills • Hands-on experience with Azure Machine Learning, Databricks, Synapse Analytics, and Data Explorer (KQL) • Skilled in using Azure Notebooks and integrating Azure services with open-source frameworks Programming & Tools • Strong comman...

Job Purpose Duties and Responsibilities Write efficient SQL queries to extract, transform, and load data Develop Python scripts for data processing, analysis, and automation Utilize Databricks to build scalable data pipelines and notebooks Collaborate with cross-functional teams to interpret data requirements Perform exploratory data analysis and generate actionable insights Maintain data integrity and troubleshoot issues in datasets Work within modern cloud environments (Azure, AWS, or GCP) Support initiatives involving AI/ML technologies and tools Recommend, document, and oversee policies and procedures to meet industry best practices and to meet required SLAs. Excellent Communication Requ...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Key Responsibilities: Design, develop, and optimize scalable and reliable ETL pipelines using Python and PySpark . Extract data from diverse data sources and transform it to meet analytical and business needs. Implement robust data validation, error handling, and quality checks within ETL pipelines. Work with large-scale datasets and ensure efficient performance and scalability. Collaborate with data engineers, analysts, and stakeholders to gather requirements and deliver end-to-end data solutions. Deploy and monitor ETL processes on AWS cloud services such as S3, Glue, Lambda, EMR, Redshift, Step Functions , etc. Ensure compliance with data governance and security standards. Troubleshoot an...

Required Skills & Experience 6+ years of experience in Data Engineering (cloud-based preferred). Strong hands-on expertise in Databricks (PySpark, Delta Lake, SQL). Proficiency in AWS data services: S3, Glue, Lambda, Kinesis, Athena, Redshift. Experience in ETL/ELT design patterns and best practices. Strong Python and SQL skills for data manipulation and transformation. Knowledge of data warehousing, dimensional modeling, and lakehouse concepts. Experience with version control (Git) and DevOps tools. Understanding of data security, encryption, and governance on AWS. Good to Have / Preferred AWS certifications: AWS Certified Data Engineer Associate / Professional or AWS Certified Solutions Ar...

Role Purpose Should have minimum of 10+ years of experience. Must have skills DataBricks, Delta Lake, pyspark or scala spark, Unity Catalog. Good to have skills - Azure and/or AWS Cloud >

Role Purpose The purpose of the role is to create exceptional architectural solution design and thought leadership and enable delivery teams to provide exceptional client engagement and satisfaction. Do 1.Develop architectural solutions for the new deals/ major change requests in existing deals Creates an enterprise-wide architecture that ensures systems are scalable, reliable, and manageable. Provide solutioning of RFPs received from clients and ensure overall design assurance Develop a direction to manage the portfolio of to-be-solutions including systems, shared infrastructure services, applications in order to better match business outcome objectives Analyse technology environment, enter...

Roles & Responsibilities:-Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads. -Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and Python-based custom scripts for data ingestion and curation. -Collaborate with Data Analysts and Stakeholders to understand data needs and deliver accurate, performant, and reusable data solutions. -Maintain and Monitor Job Performance, identify bottlenecks, and apply tuning techniques to improve pipeline efficiency on the Databricks platform.Professional & Technical Skills :-Proficient in building scalable, distributed data pipelines u...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Note: Only candidates who have recently worked on AI projects and have hands-on coding experience are eligible to apply. Key Responsibilities Lead the architecture, design, and deployment of scalable data solutions using Databricks and the medallion architecture. Guide technical teams in building batch and streaming data pipelines using Spark, Delta Lake, and MLflow. Collaborate with clients and internal stakeholders to understand business needs and translate them into robust data and AI architectures. Design and prototype Generative AI applications using LLMs, RAG pipelines, and vector stores. Provide thought leadership on the adoption of Agentic AI systems in enterprise environments. Mento...

Job Purpose The Senior Data Engineer will be responsible for designing, building, and maintaining scalable and efficient data pipelines and architectures for the Enterprise Data Platform. This role will focus on enabling high-quality, reliable, and timely data access for analytics, reporting, and business decision-making. Working closely with business analysts, data scientists, and architects, the Senior Data Engineer will ensure data solutions meet business needs and adhere to best practices and governance standards. Duties and Responsibilities Design and implement robust, scalable, and high-performance data pipelines and ETL/ELT processes. Develop, optimize, and maintain data architectures...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Only immediate joiner preferred. Experience: 8-12 years Responsibilities: Design, develop & maintain ETL pipelines using Python, PySpark & SQL on AWS/Azure/GCP. Collaborate with cross-functional teams for data transformation & quality assurance.

About Position: The MDM Developer builds and maintains Master Data Management solutions to ensure high-quality, consistent, and governed data across systems. This role involves developing data integration workflows, collaborating with stakeholders, and supporting data strategies through technical implementation. Role: MDM-Developer Location: All Persistent locations Experience: 4-6 years Job Type: Full Time Employment What You'll Do: Develop and support MDM solutions to meet business data needs. Work with stakeholders to understand and implement data requirements. Ensure data quality, governance, and compliance through technical solutions. Assist in managing development timelines and resolvi...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...