35104 Spark Jobs - Page 5

Come build the platform that powers Microsoft’s partner ecosystem. In Partner Center & Marketplace (PCM)—a core part of Microsoft’s Commerce + Ecosystems (C+E) division—you’ll help deliver the foundational services and experiences that enable partners to build, publish, sell, and grow with Microsoft—and help customers discover and deploy 1P/3P solutions. You’ll leverage GitHub Copilot, and the latest generative AI models as you work across APIs, big data, services, and user experiences that operate at global scale— making it simpler, more secure, and more intelligent for partners and sellers to do business with Microsoft. The Microsoft Partner Center is a centralized online portal that enabl...

Role & Responsibilities Lead and mentor a team of data engineers, ensuring high performance and career growth. Architect and optimize scalable data infrastructure, ensuring high availability and reliability. Drive the development and implementation of data governance frameworks and best practices. Work closely with cross-functional teams to define and execute a data roadmap. Optimize data processing workflows for performance and cost efficiency. Ensure data security, compliance, and quality across all data platforms. Foster a culture of innovation and technical excellence within the data team. Ideal Candidate 10+ years of experience in software/data engineering, with at least 3+ years in a l...

Position - Data Engineer Location - Remote Experience - 10+ Years Position - Contract Timings - UK timings for now. Skillsets needed: Microsoft Fabric: 1. pipelines 2. dataflow gen2 3. notebooks (python and spark sql) 4. CI/CD in fabric 5. security in fabric 6. direct lake models in fabric 7. DAX GCP: 1. Bigquery 2. cloud functions 3. pub/sub

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating with Integration A...

Job Title : GCP Data Engineer Job Location – Chennai / Hyderabd / Bangalore / Pune / Gurgoan/ Noida / NCR Experience: 5 to 10 Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions. Requirement: Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems. Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETL Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc Should have experience in SQL/Data Warehouse Expert in pro...

About Agora Circle Agora Circle is a modern learning and collaboration channel built with a mission to spark awareness and revolution within the retail trading community. Our goal is to become the ultimate one-stop destination for financial knowledge, empowering traders, investors, and enthusiasts with the insights, tools, and understanding they need to thrive in today’s markets. We bring together educators, creators, and thought leaders to share ideas, insights, and inspiration through engaging conversations and creative storytelling. From market strategy deep-dives to thought-provoking discussions on finance, innovation, and personal growth, our content is designed to inform, inspire, and ...

Hiring Software Engineers who thrive in building scalable, high-performance data platforms to improve efficiency, insights, and user experience. Salary : INR 15,00,000 - 25,00,000 / year Responsibilities Collaborate: Work closely with product managers, engineers to understand requirements, technical specifications, and deliver quality software. Explain designs to teammates to for alignment and approval Ensure solutions are designed and developed using a scalable, highly resilient cloud-native architecture Development: Design and implement large datasets and complex data pipelines using technologies like Python, Java, Databricks, Hive and Spark Participate in design reviews with peers to prov...

Job Title : GCP Data Engineer Job Location – Chennai / Hyderabd / Bangalore / Pune / Gurgoan/ Noida / NCR Experience: 5 to 10 Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions. Requirement: Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems. Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETL Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc Should have experience in SQL/Data Warehouse Expert in pro...

Job Summary: We are seeking an experienced Data Engineer with strong expertise in AWS cloud services and Databricks to design and implement scalable, high-performance data pipelines. The role involves building and optimizing ETL/ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI/ML, and business intelligence use cases. Key Responsibilities: Design, develop, and maintain data pipelines and workflows using AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena) and Databricks . Build and optimize ETL/ELT processes for large-scale structured and unstructured datasets. Leverage Databricks for data engineering, advanced analytics, and machine l...

We are in the process of enhancing our platform team to perform our product implementations and workflow automations across markets. We are seeking a highly skilled Senior Platform Engineer with experience in Python/Java/Scala Application frameworks, SQL and a strong foundation in cloud technologies like Kubernetes and Docker. Knowledge of Data Engineering and integration with third-party APIs will be a plus. As a key member of the SaaS platform team, You will be responsible for defining the workflow, fit our product into that workflow, deploy our product and deliver the workflow on the product including any additional utilities and upstream/downstream system integrations required. You will ...

About the job Role : Senior Data Scientist (AI & Data) Location: Remote (Work from Home) We’re hiring a Senior Data Scientist to build the next generation of intelligent decision systems that power pricing, supply optimization, ranking, and personalization in our global B2B hotel marketplace. This is a high-impact role at the intersection of machine learning, optimization, and product engineering, where you’ll leverage deep statistical modeling and modern ML techniques to make real-time decisions at scale. You’ll collaborate closely with Product, Engineering, and Data Platform teams to operationalize data science models that directly improve revenue, conversion, and marketplace efficiency. Y...

We’re looking for talented Data & AI/ML Engineers with strong hands-on experience in the AWS ecosystem . You’ll work on exciting data and machine learning projects, building pipelines, deploying models, and leveraging AWS services to deliver scalable solutions. Key Skills Data Engineering (ETL, data modeling, AWS Glue, Spark, Airflow) Machine Learning (SageMaker, TensorFlow, PyTorch, Scikit-learn) AWS Services (Redshift, S3, Lambda, EC2, Kinesis, IAM) Programming: Python (must), SQL CI/CD, Docker, Terraform (nice to have) What We're Looking for 3–5+ years of experience in Data or ML Engineering Strong understanding of AWS cloud services Hands-on with AI/ML model deployment or data pipelines ...

About Happiest Minds:** Happiest Minds is a leading digital transformation and technology services company, empowered by the mission of enhancing the happiness of our customers, employees, and society at large. We provide cutting-edge solutions leveraging advanced technologies to drive meaningful outcomes for our clients. Location: Manyata Tech Park. JD: Need someone with GCP + Looker / LookML experience Strong knowledge of data processing in GCP , Spark Deep understanding of Big Query architecture, best practices, and performance optimization. Experience with DataProc for running Hadoop/ Spark jobs on GCP. Proficiency in LookML for building data models and metrics. Knowledge of building rep...

Hiring Management/Creative Intern @Idiotic Media Location: Sector 53, Gurugram (On-Site) Duration: 6 Months Stipend: Yes, it’s paid 💸 Perks: Certificate + LOR + Real-world madness About Idiotic Media: At Idiotic Media, we don’t do boring. We craft viral campaigns, engineer influencer buzz, and turn digital chaos into creative gold. We're looking for a Management Intern who's a curious explorer, a multitasking ninja, and secretly loves the thrill of doing a bit of everything . What You’ll Be Doing (aka Your Daily Circus): 🔍 Research: Dig deep into trends, consumer behavior, brand strategies, and memes (yes, memes count). Turn data into insights that spark big ideas. 📣 Influencer Marketing: Hu...

🚀 We’re Hiring: Senior Data Engineer (Hands-On Role | Contract | Immediate Joiners Preferred| Multi-Loc in India) 📍 Location: Hybrid – Office in Gurgaon 💻 Remote Option: Can be considered for exceptional candidates ⏰ Work Type: Full-time Contract (6 Months – Likely to Extend) 📅 Notice Period: Immediate to Max 20 Days 🧑‍💻 Experience Required: 6+ Years About the Role We are seeking a hands-on Senior Data Engineer with strong expertise in Databricks, Spark, AWS, and MLOps for a 6-month contract role (extendable) . The candidate will design and implement scalable data pipelines, productionize ML workflows, and ensure system observability. This is a coding-heavy, execution-focused role best suite...

Job Title : GCP Data Engineer Job Location – Chennai / Hyderabd / Bangalore / Pune / Gurgoan/ Noida / NCR Experience: 5 to 10 Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions. Requirement: Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems. Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETL Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc Should have experience in SQL/Data Warehouse Expert in pro...

Dear Applicants, Greeting from TCS! I hope your day is going well! At Tata Consultancy Services, were looking for someone like you for an Associate Consultant position. This opportunity aligns nicely with your experience in creating immersive technologies and innovative solutions. TCS has urgent requirements for "Python Pyspark" Education: Minimum 15 years of full-time education (10th, 12th and Graduation) Skills: Digital : PySpark, Python, Apache Spark. AWS Role: Python Pyspark Exp: <8yrs Location: Chennai/Pune/Kochi/Kolkata ---------------------------------------------------------------- Lets connect soon!!

Ready to shape the future of work? At Genpact, we don’t just adapt to change—we drive it. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges. If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that’s shaping the future, this is your moment. Genpact (NYSE: G) is an advanced technology serv...

Job Title: Director — Data Scientist Location: Bengaluru Experience: 14+ Years Responsibilities Build end to end DS/AI/ML solutions. Own analyses, model training, deployment, business impact A/B evaluation, and subsequent iterations, for best-in-class data science models. Primary focus on dynamic pricing and discounting modules for various lines of business (flights, hotels, domestic, international, B2C meta) and potentially other products of both brands MakeMyTrip and GoIbibo. Work with stakeholders at various stages of the project, lead project development. Conduct iterative experiments, demonstrating incremental lift in business metrics due to AI/ML initiatives. Improve the system quality...

Brandtech+ (formerly known as OLIVER+) is a global team of creative thinkers, tech-savvy trendsetters, and production pros specialising in film, CGI, automation, AI, motion design, and digital/print content. We partner with over 300 clients in 40+ countries and counting. Our focus is to connect clients with high-quality solutions, talent and ambitious opportunities worldwide. As a part of The Brandtech Group , we're at the forefront of leveraging cutting-edge AI technology to revolutionise how we create and deliver work. Our AI solutions enhance efficiency, spark creativity, and drive insightful decision-making, empowering our teams to produce innovative and impactful results. Role: Jr. Proj...

Company Overview Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milest...

Hello Visionary! We empower our people to stay resilient and relevant in a constantly evolving world. We’re looking for people who are always searching for creative ways to grow and learn. People who want to make a real impact, now and in the future. Does that sound like you? Then it seems like you’d make a great addition to our vibrant team. We are looking for AI/ML Engineer . Before our software developers write even a single line of code, they have to understand what drives our customers. What is the environment? What is the user story based on? Implementation means – trying, testing, and improving outcomes until a final solution emerges. Knowledge means exchange – discussions with collea...

Content Creator Location: Financial District, Hyderabad Working Hours: Monday to Friday, 9:00 AM to 6:00 PM About: Fluid Touch is a product development company headquartered in Singapore with a state-of-the-art development center in Hyderabad that has created internationally acclaimed apps in the realm of digital note-taking, journaling, and productivity. Our flagship app, Noteshelf, ranks among the top 10 productivity apps globally, with over 10 million paid users worldwide. Our other award-winning apps are Whink and GoJournal. Job Description: We’re on the hunt for a creative spark—someone who’s not afraid to experiment, push boundaries, and tell our story in exciting new ways. If you eat,...

Job Title: Python Developer Experience Level: 6-7 Years Location : Hyderabad Job Description We are seeking an experienced Lead Python Developer with a proven track record of building scalable and secure applications, specifically in the travel and tourism industry. The ideal candidate should possess in-depth knowledge of Python, modern development frameworks, and expertise in integrating third-party travel APIs. This role demands a leader who can foster innovation while adhering to industry standards for security, scalability, and performance. Roles and Responsibilities Application Development: Architect and develop robust, high-performance applications using Python frameworks such as Djang...

TCS has been a great pioneer in feeding the fire of Young techies like you. We are global leaders in the technology arena and there's nothing that can stop us from growing together. TCS Hiring for skill " AI/ML ". Role: Engineer Required Technical Skill Set: AI/ML Experience: 5 to 10 Yrs Work Location: Hyd, Noida, Chennai, Mumbai Desired Competencies: Must-Have: AI/ML, Azure ML Studio, AI/ML On Databricks, Python & CICD Devops. Supervised and unsupervised ML and Predictive Analytics using Python • Feature generation through data exploration and SME requirements • Relational database querying • Applying computational algorithms and statistical methods to structured and unstructured data • Com...