1597 Spark Jobs - Page 12

Job Description JOB DESCRIPTION Oracle's Data Platform is accelerating enterprise AI and redefining how AI applications are built. The Data Platform team is seeking an experienced Consulting Member of Technical Staff to lead the design, development, delivery, and operations of a modern, scalable platform. You’ll be responsible for, and lead efforts in, designing and building scalable, distributed, and resilient software components and services to support our new product. You’ve built and operated high-scale cloud infrastructure services and understand how to continuously improve the technology. You can balance feature delivery with iteration and incremental improvements. This is a senior tec...

The Role : We are seeking an experienced Network Data Scientist to architect and implement the AI intelligence layer for Networking product, driving the evolution toward autonomous, context-aware, and self-operating network systems. This role blends deep networking expertise, machine learning, and agentic AI systems to power AIOps platformenabling predictive analytics, closed-loop automation, and intelligent remediation across multi-cloud and edge environments. You will design and operationalize AI agents integrated via the Model Context Protocol (MCP) to perform intelligent reasoning and actioning across the network stack. Key Responsibilities AIOps & Autonomous IntelligenceArchitect and de...

Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. Responsibilities Include, But Not Limited To Strong desire to grow a career as a Data Scientist in highly automated industrial manufacturing doing analysis and machine learning on terabytes and petabytes of diverse datasets. Experience in the areas: statistical modeling, feature extraction and analysis, supervised/unsupervised/semi-supervised learning. Exposure to the semiconductor industry is ...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

About the Role: Grade Level (for internal use): 10 The Team: The Data and Research organization delivers a premier data and analytical platform that empowers financial service and corporate firms to confidently make informed, data-driven investment and business decisions. The Data and Research platforms offer deep and differentiated content, fully integrated with robust analytical tools delivered through multiple delivery channels (web, office, mobile). The Impact: The Product Manager, Ownership is an integral role supporting the development, and delivery of the Equity Ownership offering across the S&P Global Desktop Platforms. The Product Manager will also be responsible for interfacing wit...

About the Role: Grade Level (for internal use): 10 The Team: The Data and Research organization delivers a premier data and analytical platform that empowers financial service and corporate firms to confidently make informed, data-driven investment and business decisions. The Data and Research platforms offer deep and differentiated content, fully integrated with robust analytical tools delivered through multiple delivery channels (web, office, mobile). The Impact: The Product Manager, Ownership is an integral role supporting the development, and delivery of the Equity Ownership offering across the S&P Global Desktop Platforms. The Product Manager will also be responsible for interfacing wit...

Job Duties & responsibilities* Structure, define and execute data analysis to uncover insights and inform decision making for digital bank* Engage with business and product teams on the problem formulation and create solution framework* Collaborate with regional & local counterparts to define and align performance metrics* Support ad-hoc data requests for management meetings* Formulate requirements and work with data engineering and technology team to develop and validate automated data pipelines for business performance dashboards* Design A/B test experiments to test the model effectiveness and Analyze to identify the target segments* Drive the testing and deployment of the machine learning...

Develop and optimize Big Data solutions using Apache Spark. Work extensively with PySpark and Data Engineering tools. Handle real-time data processing using Kafka and Spark Streaming. Design and implement ETL pipelines and migrate workflows to Spark. Required Candidate profile Hands-on experience with Hadoop, HDFS, YARN. Strong programming skills in Scala, Java, and Python. Exposure to CI/CD automation for Big Data workflows.

Meeting with managers for company’s Big Data needs Developing big data solutions on AWS using Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, Hadoop Loading disparate data sets & conducting pre-processing services using Athena, Glue, Spark Required Candidate profile Proficient with Python & PySpark Extensive experience with Delta Tables, JSON, Parquet file format AWS data analytics services like Athena, Glue, Redshift, EMR Knowledge of NoSQL and RDBMS databases.

Job Title: Lead Consultant - Vulnerability Operations GCL : E Introduction to role: Are you ready to lead global vulnerability operations that safeguard critically meaningful platforms and keep life-changing science moving? Do you thrive in high-stakes orchestration where every hour matters and precision planning reduces risk across continents? In this role, you will set the rhythm for secure releases, coordinating sophisticated maintenance windows to protect availability for teams who rely on our technology to reach patients. You will partner across regions and platforms to build release strategies that minimize business impact while accelerating vulnerability closure. Your leadership will ...

An experienced Python & PySpark Developer to design, develop, and optimize large-scale data pipelines and ML-driven app This role blends data engineering, machine learning, and cloud development on modern platforms like Azure and Hyperledger Fabric.

About the Team Product Management in Meesho closely resembles our rocketship growth. Because we obsess over understanding customer behaviour, we’ve been able to carve out an e-commerce niche in Tier 2/3/4 towns in Bharat. Our business growth is testimony to a singular focus on how we think of ‘product’ for our unique customers - ones that have barely shopped online, but are now able to because of Meesho. Fun fact: Nearly 7% of India’s households shop with us. We are driven by a ‘user-first’ mindset. We have a strong bias for action. Above all, our team is driven by impact, not features. We drive ‘problem discovery’ & delivery - not only obsess over “what to build”, but execute with rigour to...

Greetings from TCS !!! Job Title : Kafka Developer Job Location : PAN INDIA Experience required : 5-10 Years Job Description: Must Haves: • Design, develop, and maintain Kafka topics, producers, consumers, and streaming applications. • Implement data pipelines for real-time ingestion, processing, and delivery of data. • Integrate Kafka with various data sources, sinks, and analytics platforms. • Optimize Kafka clusters for scalability, performance, and reliability. • Manage Kafka configurations, partitions, replication, and monitoring. • Collaborate with data engineers, developers, and architects to design event-driven systems. • Troubleshoot issues in Kafka clusters and ensure high availabi...

At American Express , our culture is built on a 175-year history of innovation, shared values , and Leadership Behaviors — and an unwavering commitment to back our customers, colleagues, and communities. As part of Team Amex , you’ll experience this powerful backing through holistic well-being, continuous learning, and opportunities to grow as a leader and define the future of American Express. We are seeking a strategic and hands-on Director of Data Engineering to lead the Lumi Migration and Accelerator Engineering initiatives, based in Chennai, India . This leader will drive Lumi’s data modernization journey by developing automation frameworks, accelerators, and validation tools that power...

Company Description About Sopra Steria Sopra Steria, a major Tech player in Europe with 50,000 employees in nearly 30 countries, is recognised for its consulting, digital services and solutions. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2024, t...

We are seeking an experienced Senior Lead Engineer with 10-15 years of hands-on experience in Java development, front-end frameworks (especially React), and integrating Artificial Intelligence (AI) solutions. The Senior Lead Engineer will architect, design, lead, and deliver enterprise-grade web applications while mentoring teams and driving technology strategies. Primary Responsibilities: Technical Leadership: Lead a team of engineers in the design, development, and implementation of high-performance Java backend and React front-end solutions Solution Architecture: Architect scalable, maintainable, and secure systems that solve complex business problems, with a focus on microservices, API i...

About the Team : Would you like to be part of creating a unicorn within a unicornSolve some of the biggest challenges facing the financial inclusion of BharatWell, then heres your chance! Financial Services (FS) is one of the fastest growing new businesses at Meesho. It''s a large 10X opportunity for Meesho to build financial products for Bharat users and serve the unmet needs of millions of our users. And you will be at the center of this journey, building and scaling the business and serving millions of Meesho users. Meesho FS has several lines of products primarily in lending space, service sellers, users and logistics partners of Meesho. We aspire to create one of the countrys largest fi...

As a Data Engineer, you will be responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data initiatives and, visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing Be a key team member that assists in design and develop...

Experience - 4 to 12 Years Location - Pan India (ALL LTIMindtree offices) Notice Period - 0 to 90 days Strong hands on PySpark Apache Spark Data Frames Spark SQL Apache SQL performance tuning Proven data engineering background ETL ELT pipelines orchestration lake house architectures Delta Lake Solid Python for scripting automation and APISDK integration OCI Data bricks Apache Proficiency in SQL ANSI Spark SQL for querying transformation troubleshooting OCI exposure Object Storage ADW Data Flow Data Catalog Debugging mindset diagnose and resolve performance bottlenecks and service disruptions Observability logging metrics s governance lineage cost optimization Testing unit functional SITUAT d...

Role & responsibilities Roles & Responsibilities: 1. Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Used Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API. 2. Work closely with Business Analysts team to review the test results and obtain sign off 3. Prepare necessary design/operations documentation for future usage Perform peers 4. Code quality review and be gatekeeper for quality checks Hands-on coding, usually in a pair programming environment 5. Working in highly collaborative teams and building quality code 6. The candidate must exhibit a good understandin...

Job Title: Mid-level Data Science Associate Consultant Job Type: Full-time Location: Remote / Hybrid India Job Summary: ZS's Insights & Analytics group partners with clients to design and deliver solutions to help them tackle a broad range of business challenges. Our teams work on multiple projects simultaneously, leveraging advanced data analytics and problem-solving techniques. Our recommendations and solutions are based on rigorous research and analysis underpinned by deep expertise and thought leadership. Key Responsibilities: Design and implement advanced analytical and ML models to solve complex business challenges. Apply data mining, predictive modeling, and NLP techniques to extract ...

Job Description Bachelors degree in Computer Science, Engineering, Data Science, or equivalent practical experience. 8+ years of data engineering experience in designing, implementing, and optimizing large-scale data systems. Strong proficiency in Python, with production-level experience in building reusable, scalable data pipelines. Hands-on expertise with Databricks (Delta Lake, Spark, MLflow), and modern orchestration frameworks (Airflow, Prefect, Dagster, etc.). Proven track record of deploying and supporting AI/ML pipelines in production environments. Experience with cloud platforms (AWS, Azure, or GCP) for building secure and scalable data solutions. Familiarity with regulatory complia...

Bachelors degree in Computer Science, Engineering, Data Science, or equivalent practical experience. 8+ years of data engineering experience in designing, implementing, and optimizing large-scale data systems. Strong proficiency in Python, with production-level experience in building reusable, scalable data pipelines. Hands-on expertise with Databricks (Delta Lake, Spark, MLflow), and modern orchestration frameworks (Airflow, Prefect, Dagster, etc.). Proven track record of deploying and supporting AI/ML pipelines in production environments. Experience with cloud platforms (AWS, Azure, or GCP) for building secure and scalable data solutions. Familiarity with regulatory compliance and data gov...

We are looking for a skilled and motivated Senior Systems Engineer with expertise in Data DevOps/MLOps to join our team. The ideal candidate must possess a strong understanding of data engineering, automation for data pipelines, and operationalizing machine learning models. This role requires a collaborative professional capable of building, deploying, and managing scalable data and ML pipelines that meet business objectives. Responsibilities Design, deploy, and manage CI/CD pipelines for data integration and machine learning model deployment Build and maintain infrastructure for data processing and model training using cloud-native tools and services Automate processes for data validation, ...

We are seeking a skilled and passionate Lead Systems Engineer with Data DevOps/MLOps expertise to drive innovation and efficiency across our data and machine learning operations. Responsibilities Design, deploy, and manage CI/CD pipelines for seamless data integration and ML model deployment Establish robust infrastructure for processing, training, and serving machine learning models using cloud-based solutions Automate critical workflows such as data validation, transformation, and orchestration for streamlined operations Collaborate with cross-functional teams, including data scientists and engineers, to integrate ML solutions into production environments Improve model serving, performance...