2920 Data Bricks Jobs - Page 40

Collaborate with business stakeholders and other technical team members to acquire data sources that are most relevant to business needs and goals. Demonstrate deep technical and domain knowledge of relational and non-relation databases, Data Warehouses, Data lakes among other structured and unstructured storage options. Determine solutions that are best suited to develop a pipeline for a particular data source. Develop data flow pipelines to extract, transform, and load data from various data sources in various forms, including custom ETL pipelines that enable model and product development. Write custom scripts to extract data from unstructured/semi-structured sources. Provide clear documen...

Role Description Provides leadership for the overall architecture, design, development, and deployment of a full-stack cloud native data analytics platform. Designing & Augmenting Solution architecture for Data Ingestion, Data Preparation, Data Transformation, Data Load, ML & Simulation Modelling, Java BE & FE, State Machine, API Management & Intelligence consumption using data products, on cloud Understand Business Requirements and help in developing High level and Low-level Data Engineering and Data Processing Documentation for the cloud native architecture Developing conceptual, logical and physical target-state architecture, engineering and operational specs. Work with the customer, user...

Data Engineer We're seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that enable data-driven decision making across the organization. Key Responsibilities: Design and implement robust ETL/ELT pipelines for data ingestion, transformation, and loading Build and maintain data orchestration workflows using tools like Apache Airflow, NiFi, or similar platforms Perform comprehensive data cleansing, validation, and quality assurance processes Implement data security best practices including encryption, access controls, and compliance measures Configure and manage authentication systems and identity management solutions Monitor system performa...

Share your resume -ruchi@mydatainsightspvtltd.com Duties: * Design, develop & maintain data pipelines using ADF, SQL & Fabric. * Collaborate with teams on ETL projects. * Optimize database performance through data modeling & query optimization.

Responsibilities • Create, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning. • Develop and maintain core data framework and key infrastructures • Create and support the ETL pipeline to get the data flowing correctly from the existing and new sources to our data warehouse. • Data Warehouse design and data modelling for efficient and cost effective reporting • Collaborate with data analysts, data scientists, and other data consumers within the business to manage the data warehouse table structure and optimize it for reporting. • Constantly striving to improve software development process and team productivity • Define and ...

We are seeking an experienced Data Engineer to join our innovative data team data team and help build scalable data infrastructure, software consultancy, and development services that powers business intelligence, analytics, and machine learning initiatives. The ideal candidate will design, develop, and maintain robust high-performance data pipelines and solutions while ensuring data quality, reliability, and accessibility across the organization working with cutting-edge technologies like Python, Microsoft Fabric, Snowflake, Dataiku, SQL Server, Oracle, PostgreSQL, etc. Required Qualifications 7+ years of experience in Data engineering role. Programming Languages: Proficiency in Python Clou...

About the team: AIML is usedto create chatbots, virtual assistants, and other forms of artificial intelligence software. AIML is also used in research and development of natural language processing systems. What you can look forward to as a AI/ML exper t Lead Development : Own endtoend design, implementation, deployment and maintenance of both traditional ML and Generative AI solutions (e.g., finetuning LLMs, RAG pipelines) Project Execution & Delivery : Translate business requirements into datadriven and GenAIdriven use cases; scope features, estimates, and timelines Technical Leadership & Mentorship : Mentor, review and coach junior/midlevel engineers on best practices in ML, MLOps and Gen...

Data Engineer at NCR Atleos experience working at one of the largest and most recognized financial companies in the world, while being part of a software development team responsible for next generation technologies and solutions. They partner with data and analytics experts to deliver high quality analytical and derived data to our consumers. We are looking for Data Engineer who like to innovate and seek complex problems. We recognize that strength comes from diversity and will embrace your unique skills, curiosity, drive, and passion while giving you the opportunity to grow technically and as an individual. Design is an iterative process, whether for UX, services or infrastructure. Our goa...

Roles & Responsibilities : • We are looking for a strong Senior Data Engineering who will be majorly responsible for designing, building and maintaining ETL/ ELT pipelines . • Integration of data from multiple sources or vendors to provide the holistic insights from data. • You are expected to build and manage Data Lake and Data warehouse solutions, design data models, create ETL processes, implementing data quality mechanisms etc. • Perform EDA (exploratory data analysis) required to troubleshoot data related issues and assist in the resolution of data issues. • Should have experience in client interaction oral and written. • Experience in mentoring juniors and providing required guidance t...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : Python (Programming Language), Microsoft Azure Data Services, PySparkMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typi...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : Python (Programming Language), Microsoft Azure Data Services, PySparkMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typi...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role & responsibilities Data warehouse: Snowflake Programming language: sql Transformation / Orchestration tool : DBT Ticketing tool - Jira For Version control - GIT Lab Visualization: Tableau

Design and implement data architecture solutions that align with business requirements Develop and maintain data models, data dictionaries, and data flow diagrams.

About the Role: Grade Level (for internal use): 11 Whats in it for you: Its a fast-paced agile environment that deals with huge volumes of data, so youll have an opportunity to sharpen your data skills and work on an emerging technology stack. Responsibilities: Architect, design, and develop solutions within a multi-functional Agile team to support key business needs for Commodity Insights Design and implement software components for content systems. Perform analysis and articulate solutions. Design underlying engineering for use in multiple product offerings supporting a large volume of end-users. Manage and improve existing solutions. Solve a variety of complex problems and figure out poss...

Job Description : Senior AI/ML Engineer Experience: 5–8 years Location: Hyderabad Role Overview We are seeking a highly skilled Senior AI/ML Engineer to lead the design, development, and deployment of scalable AI solutions. This role requires expertise in computer vision, NLP, data engineering, and cloud services (Azure preferred). You will collaborate globally and take ownership of end-to-end AI/ML pipelines, contributing to strategic product initiatives. Key Responsibilities Architect and deploy AI/ML pipelines using Azure (Azure ML, Databricks, Cognitive Services, ADLS, etc.) Develop models for Image Processing, Object Detection, Document Parsing, and Information Extraction Lead end-to-en...

SUMMARY This position is responsible for the design, development, and management of data workflows and pipelines in our Integrated Data and Analytics environment. The role combines technical leadership, team leadership, and hands-on development. RESPONSIBILITIES / TASKS Collect, move, store, and prepare data for analytics enablement. Participate in project planning sessions, working closely with business analysts and team members to analyze requirements and provide design recommendations for complex systems. Design and develop new data pipelines for ingesting high-volume data sets. Develop pipelines using disciplined processes, adhering to industry standards and best practices, with full pro...

Job Summary We are seeking a AWS Databricks with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Spark in Scala Delta Sharing and Databricks Unity Catalog . This role involves working with cutting-edge technologies like Databricks CLI Delta Live Pipelines and Structured Streaming. The candidate will play a crucial role in managing risk and ensuring data integrity using tools such as Apache Airflow Amazon S3 and Python. The position is hybrid with no travel Responsibilities Develop and maintain scalable data pipelines using Spark in Scala to ensure efficient data processing and analysis. Implement Delta Sharing and Databricks Unity Catalog to manage an...

Data Bricks and Python Engineer Job Responsibilities 1. Software Development: - Design, develop, test, and deploy high-performance and scalable data solutions using Python,PySpark, SQL - Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. - Implement efficient and maintainable code using best practices and coding standards. 2. Databricks Platform: - Work with Databricks platform for big data processing and analytics. - Develop and maintain ETL processes using Databricks notebooks. - Implement and optimize data pipelines for data transformation and integration. 3. Continuous Learning: - Stay updated on the latest indust...

Notice Period : Immediate - 30 days Mandatory Skills : Big Data, Python, SQL, Spark/Pyspark, AWS Cloud JD and required Skills & Responsibilities : - Actively participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support. - Solve complex business problems by utilizing a disciplined development methodology. - Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies. - Analyse the source and target system data. Map the transformation that meets the requirements. - Interact with the client and onsite coordinators during different phases of a pro...

AWS/Azure/SAP - Master ETL - Master Data Modelling - Master Data Integration & Ingestion - Skill Data Manipulation and Processing - Skill GITHUB, Action, Azure DevOps - Skill Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest - Skill

The ideal candidate for the Data QA position should have 6 to 10 years of experience in ETL+ DWH Testing and Cloud Testing with expertise in AWS (S3 & Glue) and Azure, along with proficiency in SQL Server, including writing SQL queries. Additionally, familiarity with Snowflake, ADF, and API Testing is essential. Key technical skills required for this role include a strong understanding of Boomi or similar integration tools like MuleSoft, Informatica, Talend, or Workato, experience with Data Bricks, in-depth knowledge of ETL Testing, proficiency in writing SQL Queries, and good technical documentation skills. The candidate should also possess strong communication skills to effectively interac...

A career in the Advisory Acceleration Centre at PwC is an opportunity to leverage PwC's global delivery capabilities and provide premium, cost-effective, and high-quality services to support client engagements. As an Azure Senior Developer at PwC - AC, you will collaborate with the Offshore Manager and Onsite Business Analyst to grasp the project requirements and take charge of the complete implementation of Cloud data engineering solutions. Your role will involve utilizing your expertise in Azure cloud services such as Storage services (Blob, ADLS, PaaS SQL), Azure Data Factory, and Azure Synapse. You should excel in planning, organization, and have the ability to lead as a cloud developer ...

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. We are seeking an experienced Data Intelligence Specialist with a background in Supply Chain Management and Finance to join our dynamic team. The ideal candidate will be responsible for designing, developing, and deploying data-driven solutions that enhance supply chain operations and decision-making processes. Your key responsibilities include...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture, and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself and a better working world for all. As a Data Integration Consultant Senior, you will be responsible for designing, developing, and deploying data-driven solutions that enhance supply chain operations and decision-making processes. You will work closely with IT, supply chain, and other stakeholders to understand their data analysis needs and translate them into technical requir...