35346 Spark Jobs - Page 31

You will be a Big Data Developer with at least 12 years of overall experience in the IT industry, including 5 years specifically in Big Data projects. Your main responsibilities will include working on Azure handling Big Data projects, event streaming using Kafka, Scala and Java programming, Spark framework, and performance optimization. You will also be expected to build reusable frameworks with high quality and work on CI/CD practices. - Handle Big Data projects on Azure platform - Utilize Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream, and Big Data technologies - Work on event streaming using Kafka for at least 1 year - Dev...

Job Description: You have a strong proficiency in Python, with expertise in libraries like NumPy, Pandas, TensorFlow, and PyTorch. Familiarity with Java or C++ is a plus. You have a solid grasp of linear algebra, probability, statistics, and algorithms for model development. You also have practical experience with supervised/unsupervised learning, neural networks (CNNs, RNNs), and frameworks like TensorFlow, Keras, or PyTorch. Key Responsibilities: - Strong proficiency in Python, with expertise in libraries like NumPy, Pandas, TensorFlow, and PyTorch - Familiarity with Java or C++ is a plus - Solid grasp of linear algebra, probability, statistics, and algorithms for model development - Pract...

Company Description In the dynamic world of startups, KaroStartup emerged as a spark in 2020, evolving from a humble college project on Instagram to a global platform celebrating young entrepreneurs. Rooted in the heart of innovation, we have grown into a thriving community with over 1,000,000 members worldwide. While our reach is global, our heart beats for Bharat’s young entrepreneurs. We are committed to spotlighting and supporting the incredible talent emerging from the Indian startup ecosystem. Role Description This is a full-time on-site role for a Video Editor located in Noida. The Video Editor will be responsible for producing and editing video content, performing video color grading...

Join us as a Data Analyst at Barclays, responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. To be successful as a Data Analyst you should have experience with: Well-versed hands-on experience in data analysis or performing a data-focused Tech BA role. Working across a complex technical and business stakeholder matrix (multi-geography) to efficiently create process flows and detailed technical r...

Role Overview: You will collaborate with cross-functional teams to design, develop, and implement innovative solutions using Large Language Models (LLMs) and the latest data science technologies. Your role will involve understanding business problems and implementing machine learning models to solve complex business problems. Additionally, you will assist in the analysis and interpretation of complex datasets to extract valuable insights and drive data-driven decision-making. Supporting the development and deployment of machine learning models and algorithms to enhance various aspects of insurance operations will be a key responsibility. You will also contribute to the creation of data pipel...

Job Responsibilities Conduct classroom training / virtual training Develop teaching materials including exercises & assignments Design assessments for various proficiency levels in each competency Enhance course material & course delivery based on feedback to improve training effectiveness Gather feedback from stakeholders, identify actions based on feedback and implement changes Program Management and Governance Location: Mysore, Bangalore Description of the Profile We are looking for trainers with 2 to15 years of teaching or IT experience and technology know-how in one or more of the following areas: Java – Java programming, Spring, Spring Boot, Angular / React, Bootstrap Open source – Pyt...

RoleOverview Job Description Experienced Senior Solution Architect – Data to lead the design and governance ofenterprise-wide data platforms and analytics solutions. Lead design andoptimisation of the data ecosystem for a large engineering enterprise with adiverse application landscape that includes multiple ERPs (Baan, Oracle, SAP),cloud platforms, and SaaS solutions. Demonstratedtechnical expertise with strong architectural leadership is a must for therole. Key Responsibilities Define and govern the enterprise data architecture, ensuring alignment with business strategy and IT standards. Design end-to-end data solutions across ingestion, storage, modelling, analytics, and governance layers...

Role Overview: As a Data Engineer-AIML at the company in India, you will play a crucial role in building and maintaining data architectures to support AIML initiatives. Your primary responsibilities will include: Key Responsibilities: - Designing, developing, and maintaining scalable data pipelines for efficient data ingestion and processing. - Collaborating closely with data scientists and analysts to understand data requirements and ensure high data quality. - Implementing and optimizing ETL processes to improve data retrieval and storage efficiency. - Developing and managing data models and architecture specifically for AIML applications. - Conducting data analysis to extract insights tha...

You are a strategic thinker passionate about driving solutions in Analytics Solutions. You have found the right team. As an Analytics Solutions Associate within the JPMorgan Chase Consumer & Community Banking (CCB) Finance organization, you will support SEC and Regulatory Reporting for the Consumer & Community Banking line of business. **Key Responsibilities:** - Developing SQL queries to extract data from databases. - Using Alteryx to clean, transform, and analyze data from various sources. - Building Tableau dashboards and reports to visualize and present data insights; ensure operating model in place and migration of dashboards or other solutions to production. - Optimizing Tableau workbo...

Role: Principal Data Engineer Level: RL5 Location: Bangalore Years of Experience: 8-10 Years About Role We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About Us Nurtured from the seed of a single great idea - to empower the traveler - MakeMyTrip went on to pioneer India’s online travel industry Founded in the year 2000 by Deep Kalra, MakeMyTrip has since transformed how India travels. One of our most memorable moments has been to ring the bell at NASDAQ in 2010. Post-merger with the Ibibo group in 2017, we created a stronger identity and traction for our portfolio of ...

Role: Lead Data Engineer Level: RL4 Location: Bangalore Years of Experience: 6 -8 Years About The Function At MakeMyTrip (MMT), technology is at the heart of everything we do. As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructure to create seamless and innovative travel experiences. We prioritize a tech-first mindset, where our engineering teams lead the charge in transforming the way people travel. Our culture encourages collaboration, creativity, and thought leadership, empowering engineers to challenge the status quo and develop impactful, game-changing solutions. At MMT, you'll work with the latest technologies,...

Job Description MakeMyTrip data science group is looking for experienced Data Scientists and ML Engineers who would focus on building the next level of AI/ML personalization, ranking, recommendation systems, pricing systems, reinforcement learning/bandit experimentation platform with click stream, customer, entities, and text data. Responsibilities Build and deploy state-of-the-art ML/deep learning models for use cases in hotels, Flights, cross-selling, Ad notification, and a few other problems that straddle across multiple lines of business. Contribute to ML contextual bandit/RL platforms or pricing systems, or causal/uplift (CATE) models, or train advanced recommendation models with repres...

MakeMyTrip data science group is looking for experienced Data Scientists and ML Engineers who would focus on building the next level of AI/ML personalization, ranking, recommendation systems, pricing systems, reinforcement learning/bandit experimentation platform with click stream, customer, entities, and text data. Responsibilities Build and deploy state-of-the-art ML/deep learning models for use cases in hotels, Flights, cross-selling, Ad notification, and a few other problems that straddle across multiple lines of business. Contribute to ML contextual bandit/RL platforms or pricing systems, or causal/uplift (CATE) models, or train advanced recommendation models with representation learnin...

As an experienced IT professional with 5+ years of experience, you should have expertise in Snowflake Administration. In addition to this primary skill, you are expected to possess the following primary and secondary skills: **Primary Skills:** - Snowflake Administration Experience **Secondary Skills:** - Expertise with the Azure Technology stack for data management, data ingestion, capture, processing, curation, and creating consumption layers - Proficiency in giving practical direction within the Azure Native cloud services - Possession of Azure Development Track Certification is preferred - Spark Certification is preferred - Blend of Development, Administration & Support experience in the...

As a Data Engineer at UPS, your role involves participating in the support of batch and real-time data pipelines for Marketing and Finance business units. You will be responsible for integrating data from various sources, performing ETL data conversions, and facilitating data cleansing and enrichment. Your duties will include full systems life cycle management activities, such as analysis, technical requirements, design, coding, testing, and implementation of systems and applications software. Additionally, you will contribute to synthesizing disparate data sources to support reusable and reproducible data assets. **Key Responsibilities:** - Supervising and supporting data engineering projec...

As a Lead Data Scientist in the Finance Analytics team at our company, you will be responsible for analyzing financial data to derive insights, recognize patterns, and suggest automation opportunities within the finance and accounting domains. Your role will involve leveraging your expertise in data engineering and advanced analytics to convert raw financial data into valuable insights, while collaborating closely with finance teams to address business requirements effectively. Key Responsibilities: - Apply advanced analytics techniques to extract insights from financial data sets - Build and optimize data pipelines using Python, Spark, and SQL to prepare data for analysis - Develop and impl...

You are a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. Your focus will be on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions. - Design, develop, and operationalize scalable data pipelines on Databricks following medallion architecture principles. - Migrate and transform large data volumes from traditional on-prem systems (Oracle, Hadoop, Exadata) into cloud data platforms. - Develop efficient Spark (PySpark/Scala) jobs for ingestion, transformation, aggregation, and publishing of data. - Implement dat...

Microsoft runs on trust, and our trusted cloud was built on the foundational principles of security, privacy, compliance, and transparency. We’re looking for people to help us keep that promise every day. Do you have a passion for security and excitement about impacting some of the largest and most complex security challenges Microsoft is involved with? Do you want to help us protect Microsoft customers and their data from adversaries? We are looking for a Security Operations Engineer to help protect our customers and services from those who try to abuse and misuse our services. In this role, you will leverage a mix of data analytics, engineering skills, on-line services experience, and coll...

Microsoft runs on trust, and our trusted cloud was built on the foundational principles of security, privacy, compliance, and transparency. We’re looking for people to help us keep that promise every day. Do you have a passion for security and excitement about impacting some of the largest and most complex security challenges Microsoft is involved with? Do you want to help us protect Microsoft customers and their data from adversaries? We are looking for a Security Operations Engineer to help protect our customers and services from those who try to abuse and misuse our services. In this role, you will leverage a mix of data analytics, engineering skills, on-line services experience, and coll...

Microsoft runs on trust, and our trusted cloud was built on the foundational principles of security, privacy, compliance, and transparency. We’re looking for people to help us keep that promise every day. Do you have a passion for security and excitement about impacting some of the largest and most complex security challenges Microsoft is involved with? Do you want to help us protect Microsoft customers and their data from adversaries? We are looking for a Security Operations Engineer to help protect our customers and services from those who try to abuse and misuse our services. In this role, you will leverage a mix of data analytics, engineering skills, on-line services experience, and coll...

Microsoft runs on trust, and our trusted cloud was built on the foundational principles of security, privacy, compliance, and transparency. We’re looking for people to help us keep that promise every day. Do you have a passion for security and excitement about impacting some of the largest and most complex security challenges Microsoft is involved with? Do you want to help us protect Microsoft customers and their data from adversaries? We are looking for a Security Operations Engineer to help protect our customers and services from those who try to abuse and misuse our services. In this role, you will leverage a mix of data analytics, engineering skills, on-line services experience, and coll...

Microsoft runs on trust, and our trusted cloud was built on the foundational principles of security, privacy, compliance, and transparency. We’re looking for people to help us keep that promise every day. Do you have a passion for security and excitement about impacting some of the largest and most complex security challenges Microsoft is involved with? Do you want to help us protect Microsoft customers and their data from adversaries? We are looking for a Security Operations Engineer to help protect our customers and services from those who try to abuse and misuse our services. In this role, you will leverage a mix of data analytics, engineering skills, on-line services experience, and coll...

Microsoft runs on trust, and our trusted cloud was built on the foundational principles of security, privacy, compliance, and transparency. We’re looking for people to help us keep that promise every day. Do you have a passion for security and excitement about impacting some of the largest and most complex security challenges Microsoft is involved with? Do you want to help us protect Microsoft customers and their data from adversaries? We are looking for a Security Operations Engineer to help protect our customers and services from those who try to abuse and misuse our services. In this role, you will leverage a mix of data analytics, engineering skills, on-line services experience, and coll...

Microsoft runs on trust, and our trusted cloud was built on the foundational principles of security, privacy, compliance, and transparency. We’re looking for people to help us keep that promise every day. Do you have a passion for security and excitement about impacting some of the largest and most complex security challenges Microsoft is involved with? Do you want to help us protect Microsoft customers and their data from adversaries? We are looking for a Security Operations Engineer to help protect our customers and services from those who try to abuse and misuse our services. In this role, you will leverage a mix of data analytics, engineering skills, on-line services experience, and coll...

Microsoft runs on trust, and our trusted cloud was built on the foundational principles of security, privacy, compliance, and transparency. We’re looking for people to help us keep that promise every day. Do you have a passion for security and excitement about impacting some of the largest and most complex security challenges Microsoft is involved with? Do you want to help us protect Microsoft customers and their data from adversaries? We are looking for a Security Operations Engineer to help protect our customers and services from those who try to abuse and misuse our services. In this role, you will leverage a mix of data analytics, engineering skills, on-line services experience, and coll...