12395 Big Data Jobs - Page 34

The Team: We are looking for a highly motivated, enthusiastic, and skilled engineering leader for S&P Global Energy. We strive to deliver solutions that are sector-specific, data-rich, and hyper-targeted for evolving business needs. The Impact: S&P Global Energy is seeking a Lead Software Developer to provide technical leadership for all stages of software design, development, and maintenance for data processing applications. This person would be part of a development team that manages and supports the internal applications that support Horizon business datasets. This role requires a candidate to handle data processing and develop applications for big data. We have teams composed of individu...

JD - HFM Developer : 5+years of strong HFM development experience Hands on experience in FDMEE Mapping and Loads Experience with shared services Extensively used SmartView Knowledge on creating Rules and Member list Knowledge on creation of application and building metadata in HFM Experience running Consolidations and currency translations Python Scripting and VB Scripting (good to have) Same Posting Description for Internal and External Candidates

Barclaycard Payments is looking for Data Engineer SQL to join our team Design and implement data pipelines, data warehouses, and data lakes that manage appropriate data volumes and velocity. Develop processing and analysis algorithms fit for the intended data complexity and volumes. Collaborate with data scientists to build and deploy machine learning models. Lead and supervise a team, guiding professional development, allocating work requirements, and coordinating resources. Ensure all data is accurate, accessible, and secure. Perform prescribed activities timely and to a high standard, consistently driving continuous improvement. Job Requirements Hands-on experience in developing complex d...

- Design, develop, and maintain large-scale data pipelines and ETL interfaces using DataStage v11.7, integrating data from multiple sources into enterprise data warehouses and Big Data systems. - Deploy, manage, and optimize cloud-based data workflows and infrastructure using AWS, GCP, Azure, Glue, Redshift, and Databricks Data Lakehouse platforms. - Utilize advanced SQL and stored procedures (DB2, SQL Server, Oracle) to design high-performance, reliable, and secure ETL solutions. - Implement best practices and recommendations for ETL processes, data integration, and platform optimization, including DataStage Administration and metadata management. - Collaborate with cross-functional teams t...

SUMMARY Wissen Technology is Hirin g for Data Engineering Support Engineer / Manager About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domai...

Hitachi Digital Services is looking for Data Engineer (GDC) to join our team Design and implement scalable data pipelines using GDC. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data architectures and systems. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data processing workflows for improved performance and efficiency. Participate in code reviews and contribute to the improvement of the overall codebase. Job Requirements Strong understanding of GDC and its applications. Experience with big data technologies such as Hadoop and Spark. Excellent problem-solving s...

Roles and Responsibilities Write maintainable/scalable/efficient code. Design and architect technical solutions for the business problems of a very large e-commerceportal. Work in a cross-functional team, collaborating with peers during the entire SDLC. Follow coding standards, unit-testing, code reviews etc. Follow release cycles and commitment to deadlines. Qualifications & Experience 5-8 years of experience in building large scale applications or products approach; focus onoperational excellence; ability to work with ambiguity. Problem solving skills, data structures and algorithms. Understanding of one or more of RDBMS/NoSQL/Messaging/Caching technologies. Excellent understanding of codi...

6 to 8 years of hands-on experience working on ML engineering Experience in end-to-end model development life cycle spanning (but not limited to) data sampling, model training, deployment, and performance evaluation Expertise in Python with the ability to write performant production-quality code Familiarity with SQL, knowledge of spark and cloud data environments (Azure cloud services) Experience of using Azure DevOps, ADF, MLFlow, Feature Stores etc. Knowledge of building and deploying CI/CD pipelines Validated understanding of machine learning algorithms and techniques Experience working on large scale machine learning projects, handling big data, and distributed computing frameworks like ...

Role Description: As a Senior Data Engineer at Amgen, you will be responsible for managing and optimizing the company''s data infrastructure and architecture You will design and implement data pipelines, develop data models, perform data integration, and ensure data quality and governance Your expertise in data engineering, big data technologies, and data manipulation will contribute to the effective storage, processing, and utilization of large-scale data sets Key Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines to support structured, semi-structured, and unstructured data processing across the Enterprise Data Engineering for Biotech or Pharma functional knowledge ...

The role is responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data governance initiativesand visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing Be a key team member that assists in design and development of the...

What you will do In this vital role you will design, build and maintain data lake solutions for scientific data that drive business decisions for Research. You will build scalable and high-performance data engineering solutions for large scientific datasets and collaborate with Research stakeholders. The ideal candidate possesses experience in the pharmaceutical or biotech industry, demonstrates strong technical skills, has experience with big data technologies, and understands data architecture and ETL processes Design, develop, and implement data pipelines, ETL/ELT processes, and data integration solutions Contribute to data pipeline projects from inception to deployment, manage scope, tim...

Grade Level (for internal use): 09 Position Summary The candidate will work along with other data scientists, data engineers and industry analysts to support activities related to development and maintenance of products that generate key insights on industry trend by applying various machine learning and statistical techniques on proprietary as well as open data sources. The person will work alongside Product managers, Industry Analysts and Technology experts to develop and deliver the product in accordance with customer requirements and agreed timeline. Duties and responsibilities Work as part of analytics team based in Bangalore/Hyderabad/Gurgaon to develop/deploy new products Work as an I...

Role Description: We are looking for highly motivated expert Principal Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks with domain expertise in R&D domain. The ideal candidate will be responsible to design, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in big data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management. Roles & Responsibilities: Architect and maintain robust, scalable data pipel...

Professor (Computer Science and Engineering) Job Description University Overview A respected, research-oriented university located in the tech hub of Southern India, committed to world-class academic excellence. The Role We are seeking a highly accomplished and motivated individual for the senior academic position of Professor within the School of Computer Science and Engineering. The role requires exceptional commitment to high-quality teaching, pioneering research, and institutional leadership. Mandatory Responsibilities and Focus Areas Deliver advanced, high-quality instruction for Undergraduate (UG) and Postgraduate (PG) programs across various core and advanced Computer Science and Engi...

What will you be doing? As a part of this team, youll work alongside the brightest minds. As a Big Data Lead evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders. Design, develop, and maintain highly scalable data processing applications. Job Responsibilities: Write efficient, reusable and well documented code Deliver big data projects using Spark, Scala , Python, SQL Maintain and tune existing Spark applications to the fullest. Find opportunities for optimizing existing spark applications. Work closely with QA, Operations and various teams to deliver error free software on time. Actively lead / participate daily agile / scrum meetings. Tak...

As a Technical Research Engineer at our company located in Gandhipuram, Coimbatore, you will be responsible for various research-related tasks including PhD Journal Paper/Article Writing, PhD Thesis Writing, Document Preparation, and Presentation Preparation. Key Responsibilities: - Write research articles and content with a focus on quality and accuracy - Prepare PhD thesis and related documents - Create presentations for various research projects Qualifications Required: - M.E. or M.Tech. degree - 0-1 years of relevant experience - BE students with 1 year of relevant experience can also apply Additional Company Details: Our company offers a competitive salary ranging from INR 18000 to INR ...

You have an exciting opportunity to join a staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across various sectors. As an on-site Big Data Engineer in India, your role will involve designing, building, and optimizing data pipelines and platform components for critical data applications. **Role Overview:** As a Big Data Engineer, you will be responsible for: - Designing and implementing end-to-end batch and streaming data pipelines using Spark and Hadoop ecosystem components. - Developing ETL jobs and data transformation logic in Python/SQL to ensure scalability and maintainability. - Integrating and processing real-time ...

Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. Good understanding of Hadoop concepts including file system and Map Reduce. 2. Hands on experience on Spark framework, Unix scripting, Hive queries, writing UDF in Hive. Theoretical knowledge and POC alone will not suffice. 3. Good knowledge in Software Development Life Cycle and Project Development Lifecycle. 4. Associate should be able to work independently and should have strong debugging skill in both Hive and Spark. Associate should have experience developing large scale systems, experience debugging and performance tuning, excellent software design skills, communication skills and ability to work with client partners...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

Greetings from Tata Consultancy Services!!! TCS is conducting Weekday Virtual drive for the role of Data Engineer - Spark, Scala Location: Bangalore, Chennai, Pune, Gurugram Experience: 5 - 10 yrs (Accurate) Mode of Interview: Virtual (Team) Date of Interview: 18th Dec ,2025 (Thursday) Notice Period: 0-15/30/45/60 Days or Immediate Joiners are preferred Required Technical Skill : Scala/Spark Responsibilities: Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Experience working on Data Engineering projects Good Understanding of SQL Good understanding of Unix and HDFS commands Communication Experience working on Data Analytics and Pyspark Exposure to Table...

Associate Managing Consultant, Advisors & Consulting Services, Performance Analytics Advisors with Advanced Analytics is charged with servicing Consulting Services, Information Services and Managed Services by centralizing and optimizing the world class Solution Design, analytical, modeling, product development, product management, econometrics, and associated delivery capabilities of the MasterCard Advisors organization. Use broad retail, capital markets, media, and/or payments industry experience and deep knowledge of the application of big data quantitative analytics to provide hands-on support for information product development and custom analytical project delivery that satisfies and r...

Lead Software Engineer - Full Stack ( Java, Micro-services, React / Angular) About the role Software Engineers at Mastercard design and code a variety of applications covering transaction processing, analytics, user interfaces, and APIs using a blend of cutting-edge technologies across big data, distributed systems, machine learning, and more. As a Software Engineer, you will deliver these products and solutions with speed and agility as part of a small team. This will involve developing high-performing, highly scalable software solutions and products for some of the worlds top brands. Specific tasks vary depending on the project and the business unit that you join in. All staff at Mastercar...

About the role Software Engineers at Mastercard design and code a variety of applications covering transaction processing, analytics, user interfaces, and APIs using a blend of cutting-edge technologies across big data, distributed systems, machine learning, and more. As a Software Engineer, you will deliver these products and solutions with speed and agility as part of a small team. This will involve developing high-performing, highly scalable software solutions and products for some of the worlds top brands. Specific tasks vary depending on the project and the business unit that you join in. All staff at Mastercard are expected to demonstrate 'Mastercard Way' cultural values every day - ow...

Overview: At Mastercard, were building the future of intelligent infrastructurewhere data science meets automation, and AI drives operational excellence. We are looking for a Senior Data Scientist to join our Engineering team and lead the transformation of massive operations datasets into predictive insights and autonomous systems. This role is ideal for someone passionate about building scalable machine learning solutions, developing Large Language Models (LLMs), and pioneering agentic AI systems that optimize engineering workflows and decision-making. Role : As a Senior Data Scientist, you will: Analyze large-scale operations data to build predictive models for system performance, anomaly ...

Location:Kochi, Coimbatore, Trivandrum Must have skills:Python/Scala, Pyspark/Pytorch Good to have skills:Redshift Job Summary Youll capture user requirements and translate them into business and digitally enabled solutions across a range of industries. Your responsibilities will include: Roles and Responsibilities Designing, developing, optimizing, and maintaining data pipelines that adhere to ETL principles and business goals Solving complex data problems to deliver insights that helps our business to achieve their goals. Source data (structured unstructured) from various touchpoints, format and organize them into an analyzable format. Creating data products for analytics team members to i...