6547 Big Data Jobs - Page 10

Position Overview: The Databricks Data Engineer role is ideal for a skilled and motivated Databricks Data Engineer to design, build, and optimize data pipelines and analytics solutions on the Databricks Lakehouse Platform. This role is ideal for candidates who have experience with big data technologies and a passion for building robust data systems. Key Responsibilities: Develop and maintain scalable data pipelines using Databricks and Apache Spark (primarily with PySpark). Build and manage Delta Lake tables and optimize them for analytics and machine learning workloads. Integrate data from diverse sources including APIs, cloud storage, databases, and streaming platforms like Kafka. Transfor...

ZSs Architecture & Engineering Expertise Center hosts passionate tech professionals with focus on deep technology skills, incubation of new technologies, build and manage assets, cater to architecture skills needed for client projects. This track is about bringing and nurturing deep technical talent within ZS to engage with technical IT clients and de-risk large scale technology programs that are increasingly under scrutiny for technical, and architectural best practices. In this role, you will be aligned to Life Sciences R&D team of ZS working across multiple clients in designing and developing cutting edge R&D solutions which will help clients to discover and develop innovative medicines t...

Role: Senior Member of Technical Staff Experience: 4 to 9 years Location: Manyata Tech Park, Bangalore Work mode: Hybrid Skills: Design Data Analytics, Data Engineering, Data Warehouse, Java, SQL, Spark & Spark-SQL, Autonomous Data Warehouse, Object Store, Data Flow/DIS (or similar tech stack), exposure to cloud Short description : Looking for a Software Developer (Data Engineer) who are willing to perform Data Engineering tasks with skills sets like SQL, Spark, Big Data Development, Java & Cloud experience. Job description: Design, develop, troubleshoot and debug software programs for databases, applications etc. Strong knowledge of SQL is required. You should be having programming experien...

Key Responsibilities Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources. Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems. Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs. Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery. Data Strategy & Business Value: Art...

Experience: 5 Years Location: iThink, Thane (Hybrid) Shift Timing: 1:30 PM 10:30 PM (India Time) Department: Finance Global Finance Analytics (GFA) CoE About the Role: We are seeking an experienced Data Scientist (5 years) to join our Global Finance Analytics CoE (GFA) team at WTW. The role involves applying advanced analytics, machine learning, and data science to improve financial planning, risk modeling, and strategic decision-making. You will work closely with finance leaders, SMEs, and technology teams to deliver insights that drive growth, efficiency, and performance. Key Responsibilities: Build and deploy predictive models for financial planning, budgeting, and forecasting. Analyze la...

About Iris Software Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation. Key Responsibilities Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources. Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems. Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs. Orchestrate and Manage Workflows: Develop and manage data orch...

About Iris Software Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation. Strong experience in NodeJS, MongoDB, Redis Strong understanding of test-driven development and unit testing. Excellent problem-solving skills and attention to detail. Ability to work independently and as part of a team. Strong communication skills and ability to collaborate effectively with stakeholders. Mandatory Competencies Beh - Communication User Interface - Other User Interfaces - node.JS Programming Language - Java - Java Caching (Redis/Memcache/Hazlecast) Big Data - Big Data - Mongo DB

Core Programming & Languages: Scala (preferred) or Java, with strong understanding of OOP and functional paradigms, collections, immutability, concurrency. Akka Core: Actor model, message-driven architecture, actor lifecycle, supervision, fault tolerance. Akka Ecosystem: Akka Streams, Akka HTTP, Akka Cluster, Akka Persistence, Akka Typed. Distributed Systems & Reactive Principles: Reactive Manifesto (responsive, resilient, elastic, message-driven), event sourcing, CQRS, pub-sub messaging, state consistency, fault tolerance. Mandatory Competencies Programming Language - Scala - Scala Programming Language - Java - OOPS Concepts Beh - Communication

Must have: Minimum 5+ years of experience in a QE/ Agile environment with a focus on technical, automated validations leveraging variety of tools/ technologies/ frameworks. Lead the design and development of end-to-end ETL/ELT data pipelines using PySpark to ingest, transform, and process massive datasets from various sources. Optimize and fine-tune complex PySpark jobs to improve performance, reduce execution time, and minimize computational costs. Write clean, modular, and well-documented code following software development best practices. Extensive experience with at least one major cloud platform (AWS, Azure, or GCP) for building data solutions. Work closely with tech leads, data scienti...

Role & responsibilities Must have Skills Implementing data ingestion pipelines from different types of data sources i.e Databases, S3, Files etc.. Experience in building ETL/ Data Warehouse transformation process. Experience working with structured and unstructured data. Developing Big Data and non-Big Data cloud-based enterprise solutions in PySpark and SparkSQL and related frameworks/libraries, Developing scalable and re-usable, self-service frameworks for data ingestion and processing, Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data, Processing performance analysis and optimization, Bringing best ...

Skills Required: Solid understanding of object-oriented programming and design patterns. 7 to 9 Years of strong experience with bigdata. Comfortable working with large data volumes and able to demonstrate a firm understanding of logical data structures and analysis techniques. Experience in Big data technologies like HDFS, Hive, HBase, Apache Spark, Pyspark & Kafka Proficient in code versioning tools, such as Git, BitBucket, and Jira Strong systems analysis, design and architecture fundamentals, Unit Testing, and otherSDLCactivities Experience in working on Linux shell scripting. Demonstrated analytical and problem-solving skills. Excellent troubleshooting and debugging skills. Strong commun...

About the role Software Engineers at Mastercard design and code a variety of applications covering transaction processing, analytics, user interfaces, and APIs using a blend of cutting-edge technologies across big data, distributed systems, machine learning, and more. As a Software Engineer, you will deliver these products and solutions with speed and agility as part of a small team. This will involve developing high-performing, highly scalable software solutions and products for some of the worlds top brands. Specific tasks vary depending on the project and the business unit that you join in. All staff at Mastercard are expected to demonstrate 'Mastercard Way' cultural values every day - ow...

Product Data & Analytics Team Senior Data Scientist Product Data & Analytics Overview Product Data & Analytics team builds internal analytic partnerships, strengthening focus on the health of the business, portfolio and revenue optimization opportunities, initiative tracking, new product development and Go-To Market strategies. Are you excited about Data Assets and the value they bring to an organization? Are you an evangelist for data driven decision making? Are you motivated to be part of a Global Analytics team that builds large scale Analytical Capabilities supporting end users across 6 continents? Do you want to be the go-to resource for data analytics in the company? The ideal candidat...

Primary Skills: Snowflake, Snow SQL, Snow Pipe, SQL 8+ years of experience as a Snowflake developer or data engineer with a focus on data warehousing and ETL. Snowflake certification(s) is a plus. Strong SQL skills and proficiency in data modeling and database design. Knowledge of cloud data warehousing concepts and best practices. Familiarity with data integration tools and technologies. Solid understanding of data governance, data security, and compliance requirements. Experience with version control systems and deployment processes. Excellent problem-solving and troubleshooting skills. Strong communication and collaboration abilities. Ability to work in an Agile or iterative development e...

Role Overview: As a Solution Engineer at our company, you will work across various technology domains such as network, compute, storage, databases, applications, and business. Your primary responsibility will involve utilizing Big Data and AI features to create solutions that enhance customer application experiences. You will design solutions, validate them with internal and customer teams, and build strong relationships with customers and experts. Key Responsibilities: - Understand application architectures and workflows to identify key touchpoints and metrics for monitoring and analysis. - Perform data analytics and provide valuable insights and recommendations based on the data. - Communi...

As a Solution Architect, you will be responsible for developing effective IT solutions that meet customer needs and constraints. You will ensure the overall robustness of designs across functional and non-functional parameters, including performance, security, usability, and scalability. A strong spirit of innovation and the ability to provide solutions to complex problems independently is crucial for this role. - Proactively develop reusable frameworks and assets to enhance the competitive advantage of the solution. - Maintain a comprehensive understanding of the customer enterprise systems landscape, dependencies, organizational goals, and technologies. - Analyze current processes and prac...

What you will do: ACV’s Machine Learning (ML) team is looking to grow its MLOps team. Multiple ACV operations and product teams rely on the ML team’s solutions. Current deployments drive opportunities in the marketplace, in operations, and sales, to name a few. As ACV has experienced hyper growth over the past few years, the volume, variety, and velocity of these deployments has grown considerably. Thus, the training, deployment, and monitoring needs of the ML team has grown as we’ve gained traction. MLOps is a critical function to help ourselves continue to deliver value to our partners and our customers. Successful candidates will demonstrate excellent skill and maturity, be self-motivated...

As a member of the Finance, Markets and Credit Risk Technology team at Citi, you will play a crucial role in enabling the bank to achieve its day-to-day and long-term growth goals. Your responsibilities will include managing technology standards across functional areas, setting goals, contributing to IT project leadership, and ensuring the team possesses the required skill sets. You will be part of a strategic team developing, enhancing, supporting, and maintaining solutions for Finance Technology. Additionally, you will participate in technical discussions, brainstorming sessions, and gain exposure to Wholesale and Retail businesses across data, risk, and finance. - Manage technology standa...

As the Model/Anlys/Valid Group Manager, you will be responsible for managing complex, critical, and large professional disciplinary areas. You will lead and direct a team of professionals, requiring a comprehensive understanding of multiple areas within a function and how they interact to achieve the function's objectives. Your strong commercial awareness is crucial as you will be accountable for delivering a full range of services to one or more businesses or geographic regions. Excellent communication skills are necessary for negotiating internally, often at a senior level, with some external communication required. You will be held accountable for the end results of your area, with contro...

As an Applications Development Senior Lead at our organization, you will be responsible for managing a team or department to establish and implement new or revised application systems and programs in coordination with the Technology team. Your main goal in this role will be to drive application systems analysis and programming activities. Your key responsibilities will include: - Managing one or more Applications Development teams to achieve established goals - Conducting personnel duties such as performance evaluations, hiring, and disciplinary actions - Providing technical oversight, reviewing and analyzing proposed technical solutions - Contributing to the formulation of strategies for ap...

As a Sr. Technology Consultant at Rockwell Automation, you will play a crucial role in the professional services team, reporting to the Technical Director based at the Electronic City, Bengaluru office, following a hybrid work model. Your primary responsibilities will include: - Leading end-to-end project management - Coordinating cross-functional teams - Ensuring adherence to agile methodologies - Analyzing project risks - Communicating project progress effectively to stakeholders To excel in this role, you should have: - Minimum 6 years of experience - Educational qualification in UG/PG (B.E/B. Tech/M. Tech/MCA) - Proficiency in Project Management Tools like JIRA, Scrum, or Azure - Experie...

As an intern at Cyond, you will be responsible for supporting waterproofing projects through various on-site activities, such as installation and quality control. In addition, you will be involved in preparing Bill of Quantities (BOQs) and quotations for projects. Effective communication with project teams, suppliers, and clients will be essential for successful project execution. - Conduct measurements and inspections to ensure compliance with project specifications - Work closely with senior engineers to resolve technical issues and challenges - Document project progress and maintain accurate records throughout the project lifecycle - Adhere to standards and safety regulations on-site - Co...

As a Data Science Associate Consultant at ZS, you will be responsible for designing, developing, and executing high-impact analytics solutions for large, complex, structured, and unstructured data sets to assist clients in making better fact-based decisions. Your role will involve the following key responsibilities: - Staying updated with the latest developments in Deep Learning and AI research - Implementing and fine-tuning advanced models in deep learning - Collaborating with cross-functional teams to develop and deploy machine learning models in production - Contributing to research projects that advance AI and machine learning - Integrating engineering principles into data science workfl...

Role Overview: You will be responsible for developing and implementing predictive models and machine learning algorithms to address logistics-related challenges like demand forecasting, route optimization, inventory prediction, and shipment delay analysis. This involves analyzing large volumes of structured and unstructured logistics data from systems like TMS (Transportation Management Systems), WMS (Warehouse Management Systems), and ERP platforms. Key Responsibilities: - Designing and maintaining dashboards and visualizations to monitor supply chain KPIs, operational performance, and model outputs using tools such as Power BI, Tableau, or similar platforms. - Collaborating with logistics,...

As a Senior Director of QE Automation at Mobileum, you will lead and manage the Quality Engineering (QE) and Automation teams. Your responsibilities include overseeing quality, risk management, and automation strategies across core network technologies. You will lead a team of Senior Software Development Engineers in Test (SDETs) and collaborate with cross-functional teams to ensure the performance, security, and scalability of systems. Your expertise in backend tools, frameworks, DevOps, and core network technologies is crucial for maintaining system reliability and efficiency. - Drive advanced test automation strategies utilizing the latest AI-powered testing tools to secure, scale, and en...