9747 Big Data Jobs - Page 41

Role** Big Data Developer 1. Required Technical Skill Set** Hadoop, PySpark, Spark SQL, HIVE 2. No of Requirements** 150 3. Desired Experience Range** 3.5-9 years 4 .Location of Requirement Chennai/Bengaluru/Hyderabad/Pune Desired Competencies (Technical/Behavioral Competency) Must-Have** • Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools. • Strong SQL experience. • Should be able to develop, tweak queries and work on performance enhancement. • Solid understanding of object-oriented programming and HDFS concepts. Good-to-Have • Preferable to have good DWH/ Data Lake knowledge. • The candidate should have good DevOps and Agile Development Framework knowledge. SN R...

Employment Type: Full-time Must Have Skills: Any Cloud, OOP, ETL/ELT, Hive, Scala/Java/React, CI/CD, Kafka/Kinesis, Spark, Spark Streaming, SQL Good to have skills: GIT, Airflow or similar tools, Microservices Experience Level : 3-7 Years Kindly share cv to yogitha@ontimesolutions.in or 9364087225

Scala Developer Experience : 7-12 Years Location : Mumbai Desired Competencies (Technical/Behavioral Competency) Must-Have Minimum 5+ years of experience in development of Spark Scala 2. Experience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive Parquet File format, YARN, MapReduce, Sqoop Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and streaming data processing. 4. Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins, Views etc 5. Experience in debugging the Spark cod...

We are looking for an enthusiastic Junior Software Engineer to contribute to our CrossCore Platform team. Key Responsibilities You will be #LI-hybrid based in Hyderabad and reporting to our Engineering Manager Develop high-quality software in an agile team, ensuring delivery aligned with business requirements and agile principles. An enthusiastic learner, happy to work with both traditional software language development, AI, and in house tooling and products. You will translate business requirements into clean, scalable, low-defect code. Collaborate with cross-functional teams to design, develop, test, and release software. Contribute to development practices that support continuous integrat...

What you'll do: We are looking for a Software Engineer with Python, who will report into Principal Software Engineer and will manage systems as we continue grow trajectory. Important for excelling in this role will be your drive to use best practices and create novel processes and technologies to lead up the quality and interoperability of our segmentation and identity data. Find solution of problems related to the infrastructure. Control dataflow. Architect next-gen data distribution systems. Oversee main production systems to ensure system uptime and quality assurance. Troubleshoot data delivery issues. Collaborate with the Chief Engineer of Data Distributions to align on strategic goals. ...

About The Role We are seeking a skilled and detail-oriented Data Engineer to join our team You will be responsible for designing, developing, and maintaining scalable ETL pipelines, optimizing data infrastructure, and ensuring data integrity through governance best practices This role involves working closely with quantitative teams and developers to build robust data solutions while leveraging cutting-edge big data technologies and cloud platforms Key Responsibilities Design, develop, and maintain scalable ETL pipelines for multi-scale datasets Architect and optimize high-performance data pipelines for seamless data flow and transformation Implement data quality checks and governance proces...

Responsibilities Developing low to high-complexity, secure, governed, high-quality, and efficient data pipelines from a variety of on and off-premise, internal, and external data sources Ensuring that data is cleansed, mapped, transformed, and optimized for storage to meet requirements for business and technical use cases Building data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies Take all requirements into account when creating a proposal Understanding and evaluating the organizational impact of new technologies and digital services Troubleshooting and resolving issues Requireme...

About The Role We are looking for a passionate LLM Engineer Intern to join our team This is an exciting opportunity to work on state-of-the-art Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Generative AI applications You will gain hands-on experience in fine-tuning, deploying, and optimizing LLMs to enhance real-world applications Key Responsibilities Assist in training, fine-tuning, and evaluating LLMs for various tasks Develop and optimize RAG-based architectures for information retrieval Implement and test different prompt engineering techniques to improve model responses Integrate LLMs into existing systems and APIs using FastAPI, Docker, and other relevant tool...

Skills: Python, TensorFlow, PyTorch, Natural Language Processing (NLP), Computer Vision, AWS SageMaker, Machine Learning Model Deployment, Scikit-learn, About The Role Sr AI/ML Developer Experience8-10 Years LocationThane / Vikhroli, Mumbai About The Role We are seeking an experienced AI/ML Developer with 8-10 years of hands-on experience in building and deploying machine learning models at scale The ideal candidate will have a strong background in Python, PySpark, Hadoop, and Hive, along with a deep understanding of machine learning model building, analysis, and optimization As part of our innovative AI/ML team, you will contribute to cutting-edge projects and collaborate with cross-functio...

Skills: Python, TensorFlow, PyTorch, Natural Language Processing (NLP), Computer Vision, AWS SageMaker, Machine Learning Model Deployment, Scikit-learn, Sr AI/ML Developer Experience8-10 Years LocationThane / Vikhroli, Mumbai About The Role We are seeking an experienced AI/ML Developer with 8-10 years of hands-on experience in building and deploying machine learning models at scale The ideal candidate will have a strong background in Python, PySpark, Hadoop, and Hive, along with a deep understanding of machine learning model building, analysis, and optimization As part of our innovative AI/ML team, you will contribute to cutting-edge projects and collaborate with cross-functional teams to de...

As a Senior Technical Engineer or Engineering Manager at NAB India, you will be a part of a dynamic team that is passionate about delivering exceptional outcomes to make a positive difference in the lives of customers and communities. Your role will involve utilizing your deep technical expertise in Java, Python, Microservices, and Big Data to build scalable systems and solve complex problems. You will be expected to demonstrate a mindset for innovation and continuous improvement, while also showcasing strong leadership and collaboration skills. Your drive to make a real impact in various banking sectors such as customer onboarding, personal banking, private banking, corporate and institutio...

As a Lead Data Engineer at our company, you will play a crucial role in re-engineering and automating our Management Information Systems (MIS) reporting processes. Your expertise in data engineering, automation, and Big Data technologies, specifically SAS and PySpark, will be essential in collaborating with the MIS reporting team to streamline processes and implement end-to-end automation solutions. Key Responsibilities: - Conduct in-depth analysis of existing manual MIS reporting processes and data flows within the USPB MIS reporting team to identify inefficiencies and opportunities for standardization and automation. - Design and develop robust, scalable, and automated data pipelines and r...

Role Overview: You will be part of the Remediation & Remuneration COE team within the Analytics & Information Management (AIM) global community at Citi. Your primary responsibility will be to manage the analysis of customer remediation issues in the retail consumer bank globally. This includes executing data remediation approaches, assessing the impact of issues, conducting root cause analysis, and supporting audit processes. Key Responsibilities: - Conduct remediation analysis by implementing comprehensive data remediation approaches for customer issues stemming from policy and governance gaps, self-identification, or internal audit findings. - Identify the size of impacted customers and th...

Role Overview: You will be part of the Client Remediation Analytics team, responsible for managing the analysis of customer remediation issues in the retail consumer bank globally. Your key focus areas will include remediation analysis, impact assessment, issue management, root cause analysis, and audit support. As a Data/Information Management Analyst, you will be expected to integrate subject matter expertise and industry knowledge to contribute to the team's objectives. Key Responsibilities: - Manage the execution of comprehensive data remediation approaches for customer issues - Identify the size of impacted customers and the financial impact - Conduct issue management and root cause ana...

As a ReactJS Lead Engineer at our company, your primary responsibility will be to lead the design and development of Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments. You will be based in either Pune or Ahmedabad, with the requirement of working from office. Key Responsibilities: - Provide expertise in the software development life cycle, from concept to architecture, design, implementation, and testing. - Lead and mentor mid-sized teams effectively. - Ensure adherence to code reviews and development best practices and processes. - Engage in regular client communication. - Estimate efforts, identify risks, and offer technical support when needed. - ...

As an experienced professional with over 3 years of experience in Big Data & data related technologies, you possess expert level understanding of distributed computing principles. Your expertise lies in Apache Spark and you have hands-on programming skills in Python. You are proficient in Hadoop v2, Map Reduce, HDFS, and Sqoop. Additionally, you have experience in building stream-processing systems using technologies like Apache Storm or Spark-Streaming. Key Responsibilities: - Hands-on experience in Apache Spark - Proficient in programming with Python - Strong knowledge of Hadoop v2, Map Reduce, HDFS, and Sqoop - Building stream-processing systems using Apache Storm or Spark-Streaming - Wor...

As a Tech Sales Consultant at Fire AI, you will play a crucial role in driving the adoption of AI solutions among B2B clients. Your passion for technology and sales, coupled with your ability to understand customer needs, will enable you to offer tailored AI solutions to optimize operations and drive revenue growth. **Key Responsibilities:** - Identify and engage potential B2B clients in need of AI solutions. - Conduct product presentations and demos to showcase Fire AI's offerings. - Understand client requirements and recommend appropriate AI solutions. - Build and maintain strong client relationships for long-term partnerships. - Collaborate with technical and product teams to address clie...

As a Data Engineer at our company, you will be a crucial part of the engineering team in Pune. Your primary responsibility will be to design, automate, and optimize data processes using Python within the AWS cloud ecosystem, including Lambda, Glue, and Redshift. **Key Responsibilities:** - Design, develop, and maintain efficient ETL pipelines using Python, SQL, AWS Glue, and Redshift. - Automate data flows and integrations using AWS Lambda and other serverless services. - Propose and implement improvements to existing pipelines for better performance, scalability, and maintainability. - Collaborate on designing scalable, resilient data architectures in AWS. - Manage infrastructure as code us...

Role Overview: You will be part of the AI Business Advisory Team where your main responsibility will be to structure high value business problems and design solutions for the Pharma, Life Sciences, and Healthcare industries by combining the best aspects of machine intelligence and rich domain experience. You will provide thought leadership to clients at the business head level, participate in industry events, conferences, and webinars, and develop Proof of Concepts working with client stakeholders. Your role will also involve understanding and managing client expectations, improvising on new AI solutions, and owning end-to-end delivery of large and complex Analytics & AI-led transformation p...

Responsibilities: As a Machine Learning (ML) Operations Software Engineer within the Operational Artificial Intelligence team you will be responsible for deploying and maintaining machine learning systems in production reliably and efficiently. You will work as part of a team and will be responsible for managing and monitoring production ML systems for their operations, performance and effectiveness. You will be expected to follow processes and practices that allow for scalable deployment of ML models and solutions to production that automate various stages of machine learning life cycle from data collection, preparation, transformation, train, validation, serve and monitor. • Design and bui...

Title and Summary Senior Data Scientist, Product Data & AnalyticsSenior Data Scientist, Product Data & Analytics Our Vision:Product Data & Analytics team builds internal analytic partnerships, strengthening focus on the health of the business, portfolio and revenue optimization opportunities, initiative tracking, new product development and Go-To Market strategies. We are a hands-on global team providing scalable end-to-end data solutions by working closely with the business. We influence decisions across Mastercard through data driven insights. We are a team on analytics engineers, data architects, BI developers, data analysts and data scientists, and fully manage our own data assets and so...

Summary Overview Enterprise Data Solution (EDS) is focused on enabling insights into Mastercard network and help build data-driven products by curating and preparing data in a secure and reliable manner. Moving to a Unified and Fault-Tolerant Architecture for Data Ingestion and Processing is critical to achieving this mission. As a Software Development Engineer (Data Engineering) in Enterprise Data Solution (EDS), you will have the opportunity to build high performance data pipelines to load into Mastercard Data Warehouse. Our Data Warehouse provides analytical capabilities to number of business users who help different customers provide answer to their business problems through data. You wi...

Our Purpose Title and Summary Senior Data Scientist Overview Data & Analytics team builds internal analytic partnerships, strengthening focus on the health of the business, portfolio and revenue optimization opportunities, initiative tracking, new product development and Go-To Market strategies. Are you excited about Data Assets and the value they brings to an organization? Are you an evangelist for data driven decision making? Are you motivated to be part of a Global Analytics team that builds large scale Analytical Capabilities supporting end users across 6 continents? Do you want to be the go-to resource for data analytics in the company? The ideal candidate has a knack for seeing solutio...

locationsIN - Bangalore posted onPosted 28 Days Ago job requisition idR145361 Maersk, the worlds largest integrated logistics company, is transforming how goods move across continents - and at the heart of that shift is data infrastructure . We are building MIDAS , a modern, federated, metadata-driven data platform engineered for composability, governance, and AI-readiness. We are hiring a Senior Engineering Manager to lead platform engineering efforts for MIDAS - designing and scaling a multi-tenant, real-time, contract-first data platform that spans hundreds of internal systems and supports critical customer and operational use cases. This is not just a leadership role. Its a once-in-a-dec...

Description: We are seeking a Staff Software Engineer(5I) (ETL) with 8-10 years of experience to join our ETL Development team. This role will report to the Engineering Manager and the candidate will be involved in the planning, design, and implementation of our centralized data warehouse solution for data acquisition, Ingestion and large data processing and automation/optimization across all the company products. About the Role: Candidate will play a crucial role in designing, developing, and leading the implementation of ETL processes and data architecture solutions. Will collaborate with various stakeholders to ensure the seamless integration, transformation, and loading of data to suppor...