50049 Spark Jobs - Page 46

Role Description Senior AWS Data Engineer Experience: 6-12 Role Overview We are looking for a Senior Big Data Engineer to join our team and work closely with project leads and clients. You will design and develop scalable data processing systems, gather and translate complex business requirements into end-to-end technical solutions, and oversee projects from conception through production. You will also mentor junior team members and ensure delivery of high-quality, robust solutions using cutting-edge technologies. Key Responsibilities Design and develop scalable big data pipelines and solutions. Collaborate with project leads and clients to gather and refine requirements. Translate complex b...

Job Summary Core technical skills in Big Data (HDFS, Hive, Spark, HDP/CDP, ETL pipeline, SQL, Ranger, Python), Cloud (either AWS or Azure preferably both) services (S3/ADLS, Delta Lake, KeyVault, Hashicorp, Splunk), DevOps, preferably Data Quality & Governance Knowledge, preferably hands-on experience in tools such DataIku/Dremio or any similar tools or knowledge on any such tools. Should be able to lead project and report timely status. Key Responsibilities Strategy Responsibilities include development, testing and support required for the project Business IT-Prj-IC-T&A DAP GDP Processes As per SCB Governance People & Talent Applicable to SCB Guidelines Risk Management Applicable to SCB Gui...

Java+Big Data Work exp - 5 to 7 yrs Key Responsibilities Design, develop, and maintain Java-based data processing applications. Build and optimize Big Data pipelines using technologies such as Hadoop, Spark, Hive, HBase, Kafka etc. Work on ETL processes , data ingestion, data transformation, and data quality improvements. Implement and optimize distributed data processing solutions for large datasets. Integrate Java applications with Big Data ecosystems (HDFS, Hive, Kafka, etc.). Develop REST APIs and microservices using Java/Spring Boot for data access and processing. Troubleshoot performance issues across complex data pipelines. Collaborate with data engineers, architects, and analysts to ...

Company Description CodeChavo is a global provider of digital transformation solutions, working collaboratively with leading technology companies to deliver impactful results. By combining cutting-edge technology, innovative strategies, and a people-first approach, CodeChavo integrates transformation and agility into its clients' organizations. With deep industry expertise, the company ensures high-quality project execution from design to operation. CodeChavo also supports businesses by outsourcing digital projects and building skilled technology teams. Work location: Noida WFO Job Summary : Build systems for collection & transformation of complex data sets for use in production systems Coll...

The role is responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data governance initiatives and, visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing Be a key team member that assists in design and development of t...

India is among the top ten priority markets for General Mills, and hosts our Global Shared Services Centre. This is the Global Shared Services arm of General Mills Inc., which supports its operations worldwide. With over 1,300 employees in Mumbai, the center has capabilities in the areas of Supply Chain, Finance, HR, Digital and Technology, Sales Capabilities, Consumer Insights, ITQ (R&D & Quality), and Enterprise Business Services. Learning and capacity-building is a key ingredient of our success. Data Scientist II – Decision Sciences About General Mills We make food the world loves: 100 brands. In 100 countries. Across six continents. With iconic brands like Cheerios, Pillsbury, Betty Croc...

Job Title: Sr. Data Engineer (AWS or Azure) Location: Ahmedabad, Gujarat Job Type: Full Time Experience: 4+ years Department: Data Engineering About Simform: Simform is a premier digital engineering company specializing in Cloud, Data, AI/ML, and Experience Engineering to create seamless digital experiences and scalable products. Simform is a strong partner for Microsoft, AWS, Google Cloud, and Databricks. With a presence in 5+ countries, Simform primarily serves North America, the UK, and the Northern European market. Simform takes pride in being one of the most reputed employers in the region, having created a thriving work culture with a high work-life balance that gives a sense of freedo...

Role & responsibilities Design, develop, and maintain data pipelines and workflows using AWS services, including AWS Airflow, EMR, and Lambda. Implement data processing solutions using Apache Spark with Java to handle large datasets efficiently. Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet business needs. Manage and optimize PostgreSQL databases for performance and reliability. Implement AWS Identity and Access Management (IAM) policies to ensure secure access to data and resources. Monitor and troubleshoot data workflows and pipelines to ensure high availability and performance. Document data processes, architectures, and work...

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies. Since our inception, we’ve delivered to 100 million different customers across the region with added predictability, flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities. More About Us We process 250 million API requests and 3TB of data every day. We deliver more than 2 million parcels every day. 100% network coverage with 2600+ hubs and stations...

Title: AWS DE Experience: 6+ years Notice: Immediate to 15 days Role Overview: • The person will be part of the EDP Data Platform (EDP) team for a major Insurance client. He/ She will work with different stakeholders for architecting & Building EDP application platform to support client’s internal data teams to onboard, provision data in Data Cloud. • This application would be architected using Micro Services Architecture to support different workloads like Data marts, Data warehouse, AI/ML. • The person will also be required to participate actively in brainstorming sessions for improvement opportunities and take it to completion • A suitable candidate should have 4+ years of experience in d...

Note : Please do not apply if your salary expectations are higher than the provided Salary Range and experience less than 3 years. If you have experience with Travel Industry and worked on Hotel, Car Rental or Ferry Booking before then we can negotiate the package. Company Description Our company is involved in promoting Greece for the last 25 years through travel sites visited from all around the world with 10 million visitors per year such www.greeka.com, www.ferriesingreece.com etc Through the websites, we provide a range of travel services for a seamless holiday experience such online car rental reservations, ferry tickets, transfers, tours etc….. Role Description We are seeking a highly...

Role: Creative Designer - Branding and Graphics Location: Gurugram, Haryana (On-site) Years of Experience: 1-2 years. About Enout: At Enout, we create unforgettable human experiences for some of the world’s most iconic organizations, including Google, Microsoft, and Amazon. Through meticulously designed off-sites and transformative team-building journeys, we redefine employee engagement with unmatched creativity, precision, and impact. As we grow rapidly and pursue ambitious goals, this is your chance to join a movement that shapes extraordinary experiences while accelerating your personal and professional journey. Role Overview: We are seeking a talented, highly creative, and detail-oriente...

Python Data Engineer: - Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from various sources and storage systems. Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements. Leading the implementation of algorithms and prototypes to transform raw data into useful information. Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI/ML transformations. Creating innovative data validation methods and data analysis tools. Ensuring compliance w...

About JustCo: JustCo is Asia Pacific's leading provider of flexible workspaces for businesses of all sizes seeking flexible work solutions. Founded in 2011 and headquartered in Singapore, JustCo leads Singapore's coworking scene with the largest network, offering close to 50 coworking centres across eight gateway cities in the region. JustCo empowers flexible work across our network of high-quality coworking centres in prime locations, seamlessly integrated with technology to enable our members to work from any of our premises. Beyond flexible workspace solutions, we also strive to be the place that works for all individuals and businesses, revolutionising how people work by providing a plat...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Apache Spark,Google BigQuery,PySpark Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education , Summary: Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive inno...

Proficient in Scala, preferably certification from accredited institution • Experience building enterprise software solutions Knowledge of OOO concepts and patterns • HDFS, Hive, Spark • Build required skill by doing quick research including google search • Preferably compute science background • • Ability to present information in a concise and clear manner. Good-to-Have Basic knowledge of HDFS, Basic knowledge OOO Language such as Java • Scripting language unix/shell, Python

Join the Creative Pulse of Beauty Garage Location: Mumbai, Maharashtra Company: Beauty Garage India Pvt. Ltd. Experience: 1–5 years Industry: Beauty & Personal Care Department: Design & Branding About Beauty Garage Beauty Garage is one of India’s fastest-growing professional beauty brands, delivering premium salon solutions, personal care products, and trend-setting innovations. Our creative team is at the heart of this transformation—crafting impactful visual stories that define the face of beauty. Role Overview We are seeking a passionate and detail-oriented Executive Graphic Designer with strong experience in packaging design (Coreldraw) and a flair for high-impact visual storytelling. Yo...

Job Title: Graphic Designer Location: Noida, for projects across India About Varahe Analytics: Varahe Analytics is one of India’s premier integrated political consulting firms, specializing in building data-driven 360-degree election management. We help our clients with strategic advice and implementation, combining data-backed insights and in-depth ground intelligence into a holistic electoral campaign. We are passionate about our democracy and the politics that shape our world. We draw on some of the sharpest minds from distinguished institutions and diverse professional backgrounds to help us achieve our goal of building electoral strategies that spark conversations, effect change, and he...

Experience- 4 to 8 Years Roles & Responsibilities: 1. Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Used Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API. 2. Work closely with Business Analysts team to review the test results and obtain sign off 3. Prepare necessary design/operations documentation for future usage Perform peers 4. Code quality review and be gatekeeper for quality checks Hands-on coding, usually in a pair programming environment 5. Working in highly collaborative teams and building quality code 6. The candidate must exhibit a good understandi...

Job Overview Summary The Lead Data Architect is a strategic and technical leadership role responsible for architecting, scaling, and evolving enterprise-grade data platforms that enable advanced analytics, AI/ML, and data-driven decision-making. Reporting to the Senior Director of Data Platforms , this role will lead the design and governance of modern data architectures, drive innovation in AI orchestration, and ensure the delivery of secure, compliant, and high-performing data solutions. This position combines hands-on engineering expertise with architectural vision and cross-functional leadership. The Lead Data Architect will guide engineering teams, influence platform strategy, and estab...

Job Description Role: We are currently hiring for the position of Director – LL5, who will serve as the owner and strategic leader of a multidisciplinary team comprising data scientists, data engineers, and software engineers. This role will oversee all stages of analytics services and product development, including: Defining and framing business problems Identifying relevant data sources Designing and developing analytical models Validating model performance and effectiveness Leading product deployment and launch initiatives This is a high-impact leadership opportunity to shape the future of data-driven decision-making at Ford. Scope: Drive AI and Analytics innovation for Finance Modernizat...

Job Title: Senior Java Developer Experience: 8+ Years Location: Hyderabad Employment Type: Full Time (Hybrid Mode) Notice Period: Immediate to 20 Days Only Mandate skills : Core Java, Spring boot, Microservices, AWS, Apache Spark Job Description We are seeking an experienced Senior Java Developer with strong hands-on expertise in building scalable, high-performance applications. The ideal candidate must be proficient in Core Java, Spring Boot, Microservices, AWS, and Apache Spark , and capable of working in a fast-paced, collaborative environment. Key Responsibilities Design, develop, and deploy high-quality applications using Core Java, Spring Boot, and Microservices architecture. Build dis...

Must have: 7+ years of development experience in Java Good background with Spring framework Project experience(s) on Java Spark Job using HDFS Strong SQL backgroundNice to have: Snowflake Airflow, Angular, NodeJS, Tableau Mandatory Competencies Programming Language - Java - Core Java (java 8+) Programming Language - Java - Spring Framework Beh - Communication Database - Database Programming - SQL Big Data - Big Data - SPARK

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : MySQL,Apache Spark,Google BigQuery Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education , Summary: Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innova...

We are looking for Python Develope r with 8-12 Years of experience for Bangalore & Hyderabad location. Need candidates who can join within 15 days. What we need: Strong expertise in Python programming: Deep knowledge of Python language features, libraries, and best pr actices. Extensive experience with Apache Spark and PySpark: Writing optimized Spark jobs, transformations, actions, and working with RDDs and DataFrames. Solid understanding of big data processing concepts: Distributed computing, fault tolerance, partitioning, and data shuffling. Experience with ETL pipeline development: Designing, implementing, and maintaining scalable data pipelines. Proficient in working with large datasets...