51 Bigdata Frameworks Jobs

Overview The Loyalty Offers team is looking for a Principal Software Engineer to drive our architecture design & strategy forward by consistently innovating and problem-solving. As a Principal Software Engineer, you will play a critical role in leading the design of our next generation regional and global solutions. You will have the opportunity to work on complex and innovative projects, collaborating with cross-functional teams to drive technical excellence & proactively adding scalability while continuing to add enhanced value to these products. Role: 1.Hands on designing Code, document, components subsystems to a high standard 2.Must be solutions oriented ultimately find and implement th...

Role & responsibilities Deliver high-quality technical solutions and guide the team through all phases of Test Automation. Collaborate with cross-functional teams to understand business requirements and translate them into technical deliverables. Ensure adherence to best practices in coding, testing, and deployment. Utilize AI tools like MCP Server and GitHub Copilot to enhance productivity and solution quality. Work closely with stakeholders to ensure timely delivery of project milestones. Design, develop and maintain automated test scripts for web UI, RESTful APIs and Data testing. Use Playwright with Python for end-to-end UI automation. Leverage Playwright/Requests for API test automation...

Project description We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products . Responsibilities Choosing the right technologies for our use cases, deploy and operate. Setting up Data stores structured, semi structured and non-structured. Secure data at rest via encryption Implement tool to access securely multiple data sources Implement solutions to run real-time analytics Use container technologies Skills Must have 6+ years of relevant technology experience Programming Skills: Strong proficiency in Java or Scala. Solid u...

Work on Apple Maps, developing tools to analyze, visualize, process, manage, and curate large-scale geospatial data. Build scalable, distributed systems that process geospatial data at scale. Collaborate with cross-functional teams to improve the Maps Platform. Key Responsibilities: Design and develop large-scale distributed systems for geospatial data processing. Analyze large datasets to identify and resolve map errors. Implement complex algorithms and integrate solutions into production pipelines. Work with engineering and analyst teams to ensure performance, scalability, and reliability. Key Qualifications: 3+ years of experience in software product development building modern, scalable ...

Role Description: We are looking for an Associate Data Engineer with deep expertise in writing data pipelines to build scalable, high-performance data solutions. The ideal candidate will be responsible for developing, optimizing and maintaining complex data pipelines, integration frameworks, and metadata-driven architectures that enable seamless access and analytics. This role prefers deep understanding of the big data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management. Roles & Responsibilities: Data Engineer who owns development of complex ETL/ELT data pipelines to process lar...

Overview: As a Sr Data Engineer of the AICOE team, you will develop analytical products and solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies The challenge will be to create high-performance algorithms built on data sets measured in the billions of transactions that allow our users to derive insights from big data that in turn drive their businesses with a keen eye for data privacy and governance Role :- Leads talent acquisition efforts and initiatives, facilitates training programs and conducts performance management for team of direct reports Lead teams in the creation of portfolio robust ML solutions through effective...

C1X AdTech Pvt Ltd is a fast-growing, product and engineering-driven AdTech company building next-generation advertising and marketing technology platforms. Our mission is to empower enterprise clients with the smartest marketing solutions, enabling seamless integration with personalization engines and delivering cross-channel marketing capabilities. We are dedicated to enhancing customer engagement and experiences while focusing on increasing Lifetime Value (LTV) through consistent messaging across all channels. Our engineering team spans front end (UI), back end (Java/Node.js APIs), Big Data, and DevOps, working together to deliver scalable, high-performance products for the digital advert...

Job Description Summary As a member of the GE Aerospace Digital Technology organization aligned to the Technology & Operations High Performance Computing as a Service (HPCaaS) team, this role will focus on providing excellent service to Engineering stakeholders while operating a quality production simulation engineering infrastructure environment to deliver critical outcomes. You will work with a global team of like-minded HPC professionals to ensure the stable, reliable performance of our products and services while inspiring evolution and continuous improvement in how we build, operate, monitor, maintain and secure our infrastructure for a globally consistent user experience. You will driv...

Position Overview We are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments. Required Skills and Qualifications Experience : 7+ years of professional experience in PySpark development. Technical Skills : Strong proficiency in PySpark Deep understanding of Apache Spark architecture, distributed computing concepts and parallel processing. Proven experience in building and optimizing complex ETL pipeline using PySpark Experience with var...

Dear Aspirant, Please find the below mentioned job details and if you are suitable to the below role. please share me updated resume to smouni@deloitte.com along with the below details. Skill: Bigdata Developer with AWS Experience: 4 to 10 years Job Locations: Hyderabad only Notice Period: Immediate to 30 days Details Required Name Skill Current Company Name Total years of experience Relevant Exp Current Location Preferred Location Notice Period Current CTC Expected CTC Regards Mounika S

Strong exp in Big Data & Data AnalyticsExperience in building robust ETL pipelines for batch as well as streaming ingestion. Expwith Palantir Foundry ETL type work with databases and Hadoop platforms databases (e.g. Oracle, mySQL, Microsoft SQL).

5+ years of experience in BI and analytics, with specific expertise in Google Looker

Data Bricks and Python Engineer Job Responsibilities 1. Software Development: - Design, develop, test, and deploy high-performance and scalable data solutions using Python,PySpark, SQL - Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. - Implement efficient and maintainable code using best practices and coding standards. 2. Databricks Platform: - Work with Databricks platform for big data processing and analytics. - Develop and maintain ETL processes using Databricks notebooks. - Implement and optimize data pipelines for data transformation and integration. 3. Continuous Learning: - Stay updated on the latest indust...

About Oracle FSGIU - Finergy: The Finergy division within Oracle FSGIU is dedicated to the Banking, Financial Services, and Insurance (BFSI) sector. We offer deep industry knowledge and expertise to address the complex financial needs of our clients. With proven methodologies that accelerate deployment and personalization tools that create loyal customers, Finergy has established itself as a leading provider of end-to-end banking solutions. Our single platform for a wide range of banking services enhances operational efficiency, and our expert consulting services ensure technology aligns with our clients' business goals. Job Summary: We are seeking a skilled Senior Data Migration Engineer wi...

helps employees unleash their potential while creating value for themselves and the company. Additionally, everyone has individual work and personal needs. We seek to enable the best work environment that helps you and the business work together to produce superior results.

Overview The Loyalty Offers team is looking for a Principal Software Engineer to drive our architecture design & strategy forward by consistently innovating and problem-solving. As a Principal Software Engineer, you will play a critical role in leading the design of our next generation regional and global solutions. You will have the opportunity to work on complex and innovative projects, collaborating with cross-functional teams to drive technical excellence & proactively adding scalability while continuing to add enhanced value to these products. Role: 1.Hands on designing Code, document, components subsystems to a high standard 2.Must be solutions oriented ultimately find and implement th...

Job Description: We are seeking a proactive and detail-oriented Production Operations Engineer to join our Data Platforms team. This role plays a critical part in maintaining the stability and reliability of our large-scale data platform by providing hands-on operational support, system monitoring, and first-line incident triage. The ideal candidate is comfortable working in containerized environments, has solid Linux fundamentals, and demonstrates strong discipline in executing standard operating procedures and documenting outcomes. This position requires close collaboration with Shanghai and San Jose based developers and product teams in a cross-timezone environment. Responsibilities: Moni...

1. Software Development: - Design, develop, test, and deploy high-performance and scalable data solutions using Python,PySpark, SQL - Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. - Implement efficient and maintainable code using best practices and coding standards. 2. Databricks Platform: - Work with Databricks platform for big data processing and analytics. - Develop and maintain ETL processes using Databricks notebooks. - Implement and optimize data pipelines for data transformation and integration. 3. Continuous Learning: - Stay updated on the latest industry trends, tools, and technologies related to Python,...

Years : 3+ Notice Period: Immediate Joiners Job description We are seeking a highly skilled and experienced Informatica Developer to join our team. The ideal candidate will have a strong background in data integration, ETL processes, and data warehousing, with at least 3 years of hands-on experience in Informatica development. Key Responsibilities: Design and Development: Develop, implement, and maintain ETL processes using Informatica PowerCenter and other Informatica tools. Data Integration: Integrate data from various sources, ensuring data quality and consistency. Performance Tuning: Optimize ETL processes for performance and scalability. Collaboration: Work closely with business analyst...

As a member of the GE Aerospace Digital Technology organization aligned to the Technology & Operations High Performance Computing as a Service (HPCaaS) team, this role will focus on providing excellent service to Engineering stakeholders while operating a quality production simulation engineering infrastructure environment to deliver critical outcomes. You will work with a global team of like-minded HPC professionals to ensure the stable, reliable performance of our products and services while inspiring evolution and continuous improvement in how we build, operate, monitor, maintain and secure our infrastructure for a globally consistent user experience. You will drive excellence while ident...

We are on the lookout for a data scientist who is passionate about data and problem-solving. The ideal candidate who is eager to learn, can work collaboratively with various teams, and is committed to staying updated with the latest developments in data science and machine learning. We value individuals who are proactive, detail-oriented, and ready to contribute their expertise to our diverse analytical projects. If you are someone who thrives in a challenging environment and is looking for a role where you can make a significant impact, we would love to hear from you. To be successful in this position, a candidates specific skills include, but are not limited to: Partnership: Work closely w...

Data Bricks and Python Engineer Job Responsibilities 1. Software Development: - Design, develop, test, and deploy high-performance and scalable data solutions using Python,PySpark, SQL - Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. - Implement efficient and maintainable code using best practices and coding standards. 2. Databricks Platform: - Work with Databricks platform for big data processing and analytics. - Develop and maintain ETL processes using Databricks notebooks. - Implement and optimize data pipelines for data transformation and integration. 3. Continuous Learning: - Stay updated on the latest indust...

Position Overview We are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments. Required Skills and Qualifications Experience : 7+ years of professional experience in PySpark development. Technical Skills : Strong proficiency in PySpark Deep understanding of Apache Spark architecture, distributed computing concepts and parallel processing. Proven experience in building and optimizing complex ETL pipeline using PySpark Experience with var...

Greetings from LTIMindtree!! About the job Are you looking for a new career challenge? With LTIMindtree, are you ready to embark on a data-driven career? Working for global leading manufacturing client for providing an engaging product experience through best-in-class PIM implementation and building rich, relevant, and trusted product information across channels and digital touchpoints so their end customers can make an informed purchase decision will surely be a fulfilling experience. Location: Pan India . Key Skill : Hadoop-Spark SparkSQL – Java Interested candidates kindly apply in below link and share updated cv to Hemalatha1@ltimindtree.com https://forms.office.com/r/zQucNTxa2U Skills n...

Role & responsibilities Key Skills: Bigdata Frameworks like: Hadoop, Sprak, Pyspark, Hive - Mandatory