50049 Spark Jobs - Page 18

Job description Hiring for Spark Developer Mandatory Skills: Spark, Python, SQL Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed functional...

Job description Hiring for Spark Developer Mandatory Skills: Spark, Python, SQL Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed functional...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

ROLE TITLE: End User Computing & Digital Workplace Specialist LOCATION: Pune Ice Cream Office Company Overview If you are in the Unilever Ice Cream business or consider choosing to work for the Unilever Ice Cream business, you will work for the Global, leading Ice Cream player with €7.9bn Turn Over in 2023. The Ice Cream business is operating in a highly attractive category, as we are part of the 1 trillion snacking and refreshment industry, growing consistently at high pace. We have strong brands equities: 5 of top 10 selling brands including Wall’s, Magnum, Ben & Jerry’s. We are investing to unlock the full growth potential of Ice Cream as a standalone entity, once we separate from Unileve...

Databricks, PySpark, Azure Data Factory, Python

Senior Data Engineer - GCP Native Platform Location: Fully Remote (Pan - India) Role Summary Seeking an experienced Senior Data Engineer to design and build scalable data pipelines on Google Cloud Platform. You will implement data solutions using BigQuery, Dataflow, Cloud Composer, and modern engineering practices while mentoring junior team members and driving technical excellence. Key Responsibilities Pipeline Development & Engineering Build and optimize batch and streaming data pipelines using Dataflow (Apache Beam). Develop and maintain Airflow DAGs in Cloud Composer for workflow orchestration. Implement ELT processes using Dataform (SQLX) for transformations, testing, and documentation....

About the Role The Data Platform team is part of the Platform org which is based in Bangalore and is responsible for building Uber's Data Lake for the rest of the company. Team owns end to end charters for multiple batch data areas around storage (HDFS and Cloud Storage), Analytics (Hive, Spark), Pipeline Orchestration and Authoring, Data Quality, Metadata and Lineage, Jupyter Notebooks, Data LifeCycle Management, and Data Engineering. Team drives multiple global efforts around cloud migration and disaster recovery. We have an eclectic team with a diverse set of backgrounds from companies such as Facebook, Google, Cloudera, Amazon, Microsoft, LinkedIn, Twitter, other startups and college gra...

About The Role Do Research, design, develop, and modify computer vision and machine learning. algorithms and models, leveraging experience with technologies such as Caffe, Torch, or TensorFlow. Shape product strategy for highly contextualized applied ML/AI solutions by engaging with customers, solution teams, discovery workshops and prototyping initiatives. Help build a high-impact ML/AI team by supporting recruitment, training and development of team members. Serve as evangelist by engaging in the broader ML/AI community through research, speaking/teaching, formal collaborations and/or other channels. Knowledge & Abilities- Designing integrations of and tuning machine learning & computer vi...

Experience: 8- 12 Years Type: Full-time / On-site / Hybrid Role Overview: We are seeking a highly skilled Technical Lead with strong Cloud (GCP) experience to design, develop, and lead scalable data engineering solutions. The ideal candidate will be hands-on, capable of working in an agile, multidisciplinary DevOps environment, and proficient with modern data processing tools and cloud-based services. Key Responsibilities: Lead end-to-end cloud data engineering initiatives on Google Cloud Platform (GCP). Architect, design, and build data pipelines using DataFlow, Pub/Sub, BigQuery, and DataProc . Work closely with cross-functional teams in an agile DevOps setup to deliver scalable data solut...

Principal Development Software Engineer, Distributed Cloud Data Platform - QA We are looking for a Principal QA Engineer with expertise in data systems, observability, and automation to join our Distributed Cloud Data Platform team to lead the quality strategy for next-generation data infrastructure that serve s mission-critical workloads across our SaaS platform . This is a hands-on, technical role where you will design test frameworks, define data validation strategies, lead performance benchmarking, and mentor team on reliability, automation, and test best practices for large-scale distributed data systems throughout the development lifecycle. Key Responsibilities Quality Strategy & Autom...

What Youll Do Plan, deploy and manage the testing effort for any given engagement / release; Ability to handle multiple projects and teams; Work closely with developers, business analysts and project managers to define the appropriate testingapproach; Define key test processes, best practices, KPIs, collateral; Co-create the test strategies for automation projects for the chosen area of expertise. Implement Automation framework on projects; Train self in at least an area of expertise like but not limited to - Selenium, RPA, AIML, Validated Testing Oversee all aspects of quality assurance including establishing metrics, applying industry best practices, and developing new tools and processes ...

Skill Required: Digital : BigData and Hadoop Ecosystems Experience Range in Required Skills: 2-4 Years. Job Description: Skillset SQL, Bigdata (Hadoop, Pyspark), Jupyter Notebooks with Strong Analytical skills.Data visualization Power BI and Tableau is a Plus. Location is Mumbai , need to work from client location Worli Essential Skills: Skillset SQL, Bigdata (Hadoop, Pyspark), Jupyter Notebooks with Strong Analytical skills.Data visualization Power BI and Tableau is a Plus. Location is Mumbai , need to work from client location Worli

What Will Your Role Look Like Develop end-to-end data science and GenAI solutions for enterprise data products. Design, build, and deploy predictive models, advanced ML algorithms, and GenAI systems that drive actionable insights. Collaborate with business teams to understand analytics needs and translate them into technical solutions. Work on RAG pipelines, knowledge graphs, and hybrid AI search systems. Conduct research, rapid prototyping, and experimentation on state-of-the-art AI/ML/LLM technologies. Monitor and optimize model performance in production using modern MLOps practices. Mentor junior team members and contribute to best practices in AI/ML development. Why You Will Love This Ro...

? Strong programming skills in Python, PySpark, and SQL. ? Solid experience building and optimizing ETL or ELT workflows using technologies such as Spark, Snowflake, Airflow, and/or Azure Data Factory. ? Strong ability to craft and optimize complex SQL queries, stored procedures, and data transformations. ? Experience developing and maintaining scalable, high-performance data models. ? Hands-on experience with Snowflake, including the use of Snowpark for in-platform data processing. ? Experience integrating external data sources and APIs into data workflows. ? Good experience in Azure cloud infrastructure ? Familiarity with data governance and data quality frameworks (e.g., Microsoft Purview...

Title and Summary Lead Data Engineer Job Overview: Leads software engineering projects and creates the development and delivery of enhanced software solutions. Researches alternative technical solutions for changing business needs. Responsible for assuring the daily activities of the team meet the requirements of SLAs. Major Accountabilities: Successfully lead major projects and complex assignments with broad scope and long-term business implications. Create solutions with high level of innovation, cost effectiveness, high quality and faster time to market. Lead day to day system development and maintenance activities of the team to meet service level agreements (SLAs). Collaborate with busi...

PepsiCo Data Analytics & AI Overview: With data deeply embedded in our DNA, PepsiCo Data, Analytics and AI (DA&AI) transforms data into consumer delight. We build and organize business-ready data that allows PepsiCos leaders to solve their problems with the highest degree of confidence. Our platform of data products and services ensures data is activated at scale. This enables new revenue streams, deeper partner relationships, new consumer experiences, and innovation across the enterprise. The Data Science Pillar in DA&AI will be the organization where Data Scientist and ML Engineers report to in the broader D+A Organization. Also DS will lead, facilitate and collaborate on the larger DS com...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating w...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the development of custom software solutions that involve designing, coding, and enhancing various components across systems or applications. Your typical day will include co...

About The Role Project Role : Tech Delivery&Op Excellence Practitioner Project Role Description : Understand how to deliver value to clients, and use that commercial competency to apply methods or certifications appropriately. Attention to detail and deep expertise allow them to see inherent risks or improvement opportunities that others may not. Work directly with client teams to ensure a high standard of delivery and operational excellence are met. Must have skills : Microsoft Power Business Intelligence (BI) Good to have skills : Data Science Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are looking for a highly skilled An...

Role Description As a Senior Data Science and Modeling Specialist at Incedo, you will be responsible for developing and deploying predictive models and machine learning algorithms to support business decision-making. You will work with data scientists, data engineers, and business analysts to understand business requirements and develop data-driven solutions. You will be skilled in programming languages such as Python or R and have experience in data science tools such as TensorFlow or Keras. You will be responsible for ensuring that models are accurate, efficient, and scalable. Roles & Responsibilities : Developing and implementing machine learning models and algorithms to solve complex bus...

Experience-5+ Years Position- Sr. Data Engineer & Lead Data Engineer Location-Bangalore(WFO-4Days) Notice Period-Immediate Skills: Python, Pyspark, SQL, Apache spark, Kafka, Cloud(AWS, GCP, Azure) Experience with various stages of software development, including design, development, testing, and deployment. Strong programming skills in Python, SQL etc. Deep expertise with cloud platforms like AWS, Azure, or GCP. Hands-on experience with Databricks, Snowflake, AWS RDS, Azure SQL, or GCP Cloud SQL, Apache Spark and Apache Airflow. Strong understanding of Lakehouse architecture, Data Mesh principles, data governance frameworks, and modern data pipelines. Apply to: hrteam10@ontimesolutions.in

Educational Requirements MCA,MSc,Bachelor of Engineering,BBA,BSc Service Line Data & Analytics Unit Responsibilities Engage with Business / Stakeholders with status update on progress of development and issue fix Setup Standards related to Coding, Pipelines and Documentation Understand the requirements from the business and translate it into an appropriate technical requirement. Define key business problems to be solved; formulate high level solution approaches and identify data to solve those problems, develop, analyze/draw conclusions and present to client. Engage with Business / Stakeholders with status update on progress of development and issue fix Technical and Professional Requirement...

Position Summary Job Title: Senior Data Engineer Location: India Project: Enterprise Data Hub (EDH) About The Role We are seeking a highly skilled and hands-on Senior Data Engineer to join our EDH initiative. This role demands deep expertise in building scalable data pipelines and automation frameworks using Databricks and the Azure ecosystem. The ideal candidate will have a strong engineering mindset, leadership experience, and a passion for solving complex data challenges. Location: Mumbai - India What will your job entail? Key Responsibilities Design, develop, and optimize scalable data pipelines using Databricks and Apache Spark Implement job orchestration and automation using tools like...

Role: Senior Analyst Location: Bengaluru WHAT YOU’LL DO We’re MiQ, a global programmatic media partner for marketers and agencies. Our people are at the heart of everything we do, so you will be too. No matter the role or the location, we’re all united in the vision to lead the programmatic industry and make it better. As part of DnA team, you will work as an independent individual contributor who is an analytics expert with technical proficiency. You will be responsible for bringing new analytics ideas and innovation to the campaign optimization strategies, KPI reporting, automation, and QBR/Insights. You will also be the face of the project execution team to build cutting-edge technical to...