35104 Spark Jobs - Page 6

Ǫualifications Bachelor's degree in Engineering, Computer Science, or relevant field. 10+ years of relevant and recent experience in a Data Engineer role. 5+ years recent experience with Apache Spark and solid understanding of the fundamentals. Deep understanding of Big Data concepts and distributed systems. Strong coding skills with Scala, Python, Java and/or other languages and the ability to quickly switch between them with ease. Advanced working SǪL knowledge and experience working with a variety of relational databases such as Postgres and/or MySǪL. Cloud Experience with DataBricks Experience working with data stored in many formats including Delta Tables, Parquet, CSV and JSON. Comfort...

Tech Stack Modeling & ML Frameworks:Python, scikit-learn, PyTorch, TensorFlow — spanning classical ML, deep learning, and transformer-based architectures. Includes modern ensemble methods (XGBoost, LightGBM) for large-scale structured modeling. Applied Domains: Ranking, Recommendation, Dynamic Pricing, Forecasting, Supply–Demand Optimization, Semantic Search, NLP/NLU, Generative Content Systems Data & Compute: Databricks, PySpark, AWS (S3, Glue, EMR, Athena), ScyllaDB, MongoDB, Redis Experimentation & Optimization: MLflow, Airflow, SageMaker, Bayesian Optimization, Bandit/Sequential Experimentation LLMs & GenAI: Claude, OpenAI GPT-4, SLMs, LangChain, Cursor IDE, RAG Pipelines, Embedding Mode...

Job Title-Data Engineer Exp-6-8 Yeras Location- Mumbai Job Responsibilities- Actionable · Designing and implementing data storage solutions on Azure · Building and maintaining data pipelines for data integration and processing · Optimizing data processing performance through tuning and monitoring · Developing and maintaining data models and schemas · Ensuring data security and privacy prerequisites are followed · Designing and developing BI reports and dashboards · Collect data from various sources, transform into a practical format, and load into the appropriate data storage solution on Azure using tools such as Azure Data Factory and Azure Databricks. · Develop and maintain data models and...

GCP/Bigdata Provides technical leadership in Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies. Must have : Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer servics) Should be aware with columnar database e.g parquet, ORC etc Visualize and evangelize next generation infrastructure in Cloud platform/Big Data space (Batch, Near Real-time, Real-time technologies). Passionate for continuous learning, experimenting, applying and contributing towards cutting edge open source technologies and software paradigms Developin...

About: At Infarsight, we simplify complex operations across Finance, HR, Operations, and Supply Chain using platforms like Task Sight, Trip Sight, and Fleet Sight. Our engineering teams build scalable software, and our data solutions unlock real-time insights to help businesses move faster and smarter. Role Overview: As an AWS Data Engineer, you’ll design and build cloud-native data pipelines, collaborate across teams, and lead innovation in data engineering practices. Your work will directly impact our ability to deliver high-quality, secure, and scalable data solutions. Key Responsibilities: Develop, deploy, and maintain automated, test-driven data pipelines in AWS. Collaborate with data s...

Company Description GlobalLogic, a Hitachi Group company, is a trusted partner in design, data, and digital engineering for the world’s largest and most innovative companies. Since our inception in 2000, we have been at the forefront of the digital revolution, helping to create some of the most widely used digital products and experiences. Our purpose is to positively impact society and the planet through cutting-edge technology. Together with our clients, we are engineering impact through intelligent products, platforms, and services designed for desirability and excellence. Our people-first culture fosters teamwork, supported by flexible delivery options, including onshore, nearshore, and ...

About Us: Planet Spark is reshaping the EdTech landscape by equipping kids and young adults with future-ready skills like public speaking, and more. We're on a mission to spark curiosity, creativity, and confidence in learners worldwide. If you're passionate about meaningful impact, growth, and innovation—you're in the right place. Location: Gurgaon (On-site) Experience Level: Entry to Early Career (Freshers welcome!) Shift Options: Domestic | Middle East | International Working Days: 5 days/week (Wednesday & Thursday off) | Weekend availability required Target Joiners: Any (Bachelor’s or Master’s) 🔥 What You'll Be Owning (Your Impact): Lead Activation: Engage daily with high-intent leads th...

Hello Visionary! We empower our people to stay resilient and relevant in a constantly changing world. We’re looking for people who are always searching for creative ways to grow and learn. People who want to make a real impact, now and in the future. Does that sound like you? Then it seems like you’d make a great addition to our vibrant team. We are seeking an experienced Data Scientist with a strong foundation in Python, Machine Learning, and Cloud-based Analytics. You will play a key role in building data-driven energy optimization solutions across buildings and campuses. From time-series analysis to predictive maintenance, you’ll work on impactful projects that accelerate energy efficienc...

Role: Senior Data Engineer (Python, Spark, SQL, AWS) Experience: 5–10 years Location: Hyderabad Work Mode: Hybrid (3 days/week in-office) Join Time: Immediate Must-Have Technical Skills: Strong programming skills in Python and/or Scala Hands-on experience with Apache Spark for big data processing on AWS cloud Proficiency with AWS services such as S3, Glue, Redshift, EMR, Lambda Strong SQL skills for data transformation and analytics Experience in Infrastructure as Code (IaC) using Terraform Expertise in setting up and managing CI/CD pipelines with Jenkins Responsibilities: Design, build, and optimize scalable data pipelines on AWS Implement data ingestion, transformation, and integration sol...

Senior & Lead Data Engineer – Python & GCP Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) & ELT data pipelines. The role involves working with customers directly, gathering requirements, discovery phase, designing, architecting the solution, using various GCP services, implementing data transformations, data ingestion, data quality, and consistency across systems, and pos...

Job Title - Senior Data Engineer Job Description - Bachelor's degree in computer science, Information Systems, or related field. 3.5+ years of experience in data platform operations or support roles. Proven expertise in Greenplum (PostgreSQL-based MPP), AWS (S3, EC2, Glue, Lambda) etc. Hands on experience in Databricks (Spark, Delta Lake, notebooks, Informatica PowerCenter), Cognos reporting, Power BI, DAX, data modeling, report publishing, ITIL Certification. Excellent communication and stakeholder engagement skills. Ability to work independently and manage multiple priorities. Certifications in AWS, Databricks and Power BI is desirable. Experience with Agile methodologies and DevOps practi...

Job Description Oracle’s Forward Deployed Engineer (FDE) team is hiring a Principal Solutions Architect - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle’s Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Collaborate across product, engineering, and field teams to address complex AI/ML archit...

Job Description Oracle’s Forward Deployed Engineer (FDE) team is hiring a Principal Solutions Architect - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle’s Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Collaborate across product, engineering, and field teams to address complex AI/ML archit...

Job Description Oracle’s Forward Deployed Engineer (FDE) team is hiring a Principal Software Development Engineer - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle’s Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Design, implement, and maintain scalable software components and services that...

Who We Are Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact. To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate...

About Client: Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business Focus on Digital Engineering, Cloud Services, AI and Data Analytics, Enterprise Applications ( SAP, Oracle, Sales Force ), IT Infrastructure, Business Process Out Source. Major delivery centers in India, including cities like Chennai, Pune, Hyderabad, and Bengaluru. Offices in over 35 countries. India is a major operational hub, with as its U....

About Us: Planet Spark is reshaping the EdTech landscape by equipping kids and young adults with future-ready skills like public speaking, and more. We're on a mission to spark curiosity, creativity, and confidence in learners worldwide. If you're passionate about meaningful impact, growth, and innovation—you're in the right place. Location: Gurgaon (On-site) Experience Level: Entry to Early Career (Freshers welcome!) Shift Options: Domestic | Middle East | International Working Days: 5 days/week (Wednesday & Thursday off) | Weekend availability required Target Joiners: Any (Bachelor’s or Master’s) 🔥 What You'll Be Owning (Your Impact): Lead Activation: Engage daily with high-intent leads th...

Job Description Oracle’s Forward Deployed Engineer (FDE) team is hiring a Principal Software Development Engineer - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle’s Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Design, implement, and maintain scalable software components and services that...

Job Description Oracle’s Forward Deployed Engineer (FDE) team is hiring a Principal Solutions Architect - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle’s Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Collaborate across product, engineering, and field teams to address complex AI/ML archit...

Job Description Oracle’s Forward Deployed Engineer (FDE) team is hiring a Principal Solutions Architect - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle’s Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Collaborate across product, engineering, and field teams to address complex AI/ML archit...

About Us: Planet Spark is reshaping the EdTech landscape by equipping kids and young adults with future-ready skills like public speaking, and more. We're on a mission to spark curiosity, creativity, and confidence in learners worldwide. If you're passionate about meaningful impact, growth, and innovation—you're in the right place. Location: Gurgaon (On-site) Experience Level: Entry to Early Career (Freshers welcome!) Shift Options: Domestic | Middle East | International Working Days: 5 days/week (Wednesday & Thursday off) | Weekend availability required Target Joiners: Any (Bachelor’s or Master’s) 🔥 What You'll Be Owning (Your Impact): Lead Activation: Engage daily with high-intent leads th...

Job Title: AWS Data Engineer Location: Hyderabad / Noida / Gurugram / Delhi About Our Client Our Client is a leading technology consulting and services company guided by an ‘experience-led everything’ philosophy. We believe that true success comes from placing our clients at the center of everything we do and taking ownership of their outcomes. While technology drives transformation, it’s the focus on meaningful experiences — both for our clients and our workforce — that shapes our approach, solutions, and culture. Headquartered in Pune, India, our diverse team of over 10,000 professionals across 30+ global locations collaborate to design digital experiences that are engineered into scalable...

Job Description Oracle’s Forward Deployed Engineer (FDE) team is hiring a Principal Software Development Engineer - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle’s Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Design, implement, and maintain scalable software components and services that...

Job Description Oracle’s Forward Deployed Engineer (FDE) team is hiring a Principal Solutions Architect - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle’s Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Collaborate across product, engineering, and field teams to address complex AI/ML archit...

Job Description Oracle’s Forward Deployed Engineer (FDE) team is hiring a Principal Solutions Architect - AI Data Platform to help global customers unlock the full potential of their data. You will provide expert architectural guidance focused on designing, optimizing, and scaling modern AI/ML-centric data platforms. As a key member of Oracle’s Analytics and AI Service Excellence organization, you will work closely with enterprise customers, product management, and engineering to ensure seamless adoption of Oracle AI Data Platform, Gen AI services, and associated cloud technologies. Key Responsibilities: Collaborate across product, engineering, and field teams to address complex AI/ML archit...