35346 Spark Jobs - Page 37

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team through the development process. You will also engage in strategic plann...

PySpark Developer We are looking for skilled PySpark Developers to design and develop scalable data processing solutions. The role involves working with big data platforms , building ETL pipelines , and collaborating with cross-functional teams to ensure data availability, performance, and quality. Experience: 4-10 years (Mandatory) Qualification: BE / B. Tech Location: Pune Contract Duration: 12 Months Salary: Up to 24 LPA Key Responsibilities Design, develop, and optimize ETL/ELT pipelines using PySpark. Ingest, clean, transform, and process structured/semi-structured/unstructured data. Work with large-scale datasets on distributed computing platforms (Hadoop, Spark, Databricks). Integrate...

Job Description We are seeking a data-savvy professional with 6+ years of experience in Python and SQL, who also brings 2–3 years of direct client engagement experience. This role bridges technical data work with consultative client delivery, ideal for someone who can drive insights and manage stakeholder expectations. Write efficient, production-grade Python scripts for data extraction, transformation, and automation tasks. Design and optimize SQL queries to analyze large, complex datasets across multiple sources (Presto Server, Hive, Spark, etc.). Develop and maintain reusable ETL pipelines using Python libraries such as pandas, sqlalchemy, or Airflow or any tools available at client dispo...

Job Requirements At Quest Global, it’s not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better place—to make a positive difference that contributes to a brighter future. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and faster. Job Description Summary The Sr Data Analyst - BI & Reporting will play a key role in developing end-to-end reporting solut...

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies. Since our inception, we’ve delivered to 100 million different customers across the region with added predictability, flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities. More about us: We process 250 million API requests and 3TB of data every day. We deliver more than 2 million parcels every day. 100% network coverage with 2600+ hubs and station...

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies. Since our inception, we’ve delivered to 100 million different customers across the region with added predictability, flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities. More about us: We process 250 million API requests and 3TB of data every day. We deliver more than 2 million parcels every day. 100% network coverage with 2600+ hubs and station...

DESCRIPTION AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and the Ge...

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies. Since our inception, we’ve delivered to 100 million different customers across the region with added predictability, flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities. More about us: We process 250 million API requests and 3TB of data every day. We deliver more than 2 million parcels every day. 100% network coverage with 2600+ hubs and station...

JOB DESCRIPTION Be an integral part of a highly collaborative agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Lead Software Engineer at JPMorgan Chase within the Technology division, you will be an integral part of a highly collaborative agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. You will have the opportunity to build and support high throughput, low latency applications leveraging state-of-the-art machine learning architectures deployed in AWS. You will design and develop secure and scalable microservices, review and debug code, and create architecture an...

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Data Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the ag...

Job Summary We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our team in the Asset & Wealth Management domain. The ideal candidate will have expertise in Spark Streaming Kafka Kafka Connect and Python. This role is hybrid and requires working during the day shift. The candidate will play a crucial role in developing and maintaining our data streaming and processing systems. Responsibilities Develop and maintain data streaming applications using Spark Streaming to ensure real-time data processing. Implement and manage Kafka and Kafka Connect to facilitate seamless data integration and streaming. Write efficient and scalable Python code to support data pro...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. Assistant Project Lead Proje...

Job Summary We are seeking a highly skilled Sr. Support Analyst with 8 to 10 years of experience to join our team. The ideal candidate will have expertise in AWS Lambda AWS IAM Apache Spark Python DB Performance Optimization Data Modelling Amazon S3 and TSQL. Experience in Property & Casualty Insurance is a plus. This is a hybrid role with rotational shifts and no travel required. Should have strong experience in supporting existing environments in above technologies Responsibilities Develop and maintain scalable applications using AWS Lambda and other AWS services. Implement and manage AWS IAM policies to ensure secure access control. Providing support for the already developed framework an...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. Technical Coordinator Integr...

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies. Since our inception, we’ve delivered to 100 million different customers across the region with added predictability, flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities. More about us: We process 250 million API requests and 3TB of data every day. We deliver more than 2 million parcels every day. 100% network coverage with 2600+ hubs and station...

India Information Technology (IT) Group Functions Job Reference # 328742BR City Hyderabad Job Type Full Time Your role Are you passionate about data? Do you enjoy problem solving in elegant ways? Do you enjoy using cutting edge technology and developing a variety of solutions to achieve your goals? We are looking for a hands-on data engineer to: Develop innovative solutions for managing sensitive information Participate in the analysis of business problems, working directly with different teams Be part of the design process for new solutions Experience the reality of day-to-day data management Your team You’ll be working in the Enterprise Data Mesh team in Hyderabad. We are a global team tha...

Job Summary The Sr. Developer role is crucial for driving technical excellence within our hybrid work model. With a focus on Core Java Kafka and Spark the candidate will enhance our Cards & Payments and Asset & Wealth Management domains. This position requires a minimum of 6 years of experience offering a dynamic environment to innovate and contribute to impactful projects. Responsibilities Develop robust applications using Core Java to optimize performance and scalability in our Cards & Payments systems. Implement and manage Kafka for real-time data processing ensuring seamless integration across platforms. Utilize Spark to perform complex data analytics driving insights for Asset & Wealth ...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. What this job involves: Stee...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. Project Manager – Fit-out Pr...

About the Role We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Uber you will play a leading role in designing and building datasets that power analytics for teams across Uber. You will also be working closely with Data Analysts, Data Scientists and stakeholders to gather requirements and translate them into a data engineering roadmap for the team. Minimum Qualifications 4+ years of relevant industry experience. 4+ years of SQL experience. 4+ years of python/java/scala experience. 2+ years of data modeling experience. Experience designing and deploying high performance sy...

Job Summary We are seeking a highly skilled Sr. Developer with 8 to 12 years of experience in Big Data and AWS technologies. The ideal candidate will work in a hybrid model utilizing their expertise in AWS EC2 AWS EMR Amazon S3 Apache Spark and Python to drive innovative solutions. This role offers the opportunity to make a significant impact on our projects and contribute to the companys success. Responsibilities Develop and implement scalable big data solutions using AWS EC2 AWS EMR and Amazon S3 to enhance data processing capabilities. Collaborate with cross-functional teams to design and optimize data pipelines ensuring efficient data flow and storage. Utilize Apache Spark to perform com...

Job Summary We are seeking a Sr. Developer with 6 to 9 years of experience to join our team in a hybrid work model. The ideal candidate will possess strong technical skills in Python Database and SQL and EDA along with domain expertise in Cards & Payments and Asset & Wealth Management. This role involves developing and optimizing data solutions to drive business success. Responsibilities Develop and maintain robust data solutions using Python to support business objectives. Collaborate with cross-functional teams to gather and analyze requirements for data projects. Utilize SQL to extract transform and load data from various sources to ensure data integrity. Conduct exploratory data analysis...

Skills Required: Strong technical acumen in AWS including expert working knowledge of AWS services such as Glue, ,EC2, ECS, Lamda, Step Functions, IAM, Athena, HUE, Presto, S3, Redshift etc. Strong technical acumen in Data Engineering enablement, and working knowledge of frameworks/languages such as Python, SPARK etc. Dremino knowledge is a plus Job Type: Contractual / Temporary Contract length: 6 months Work Location: In person

Company Description ABOUT IQ-EQ We’re a leading Investor Services group offering end-to-end services in administration, accounting, reporting, regulatory and compliance needs of the investment sector worldwide. We employ a global workforce of 5,800+ people across 25 jurisdictions and have assets under administration (AUA) exceeding US$750 billion. We work with 13 of the world’s top-15 private equity firms. Our services are underpinned by a Group-wide commitment to ESG and best-in-class technology including a global data platform and innovative proprietary tools supported by in-house experts. Above all, what makes us different is our people. Operating as trusted partners to our clients, we de...

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. Primary Responsibilities: Support the full data engineering lifecycle including research, proof of concepts, design...