23086 Pyspark Jobs - Page 41

Designation: Senior Analyst Experience: 3 to 5 years Location: Chennai, Tamil Nadu (CHN) Job Description: Develop data models and machine learning solutions using predictive analytics and NLP-based techniques. Leverage generative AI to uncover complex data patterns, generate predictive insights, and enhance analytical models. Experience in building AI-based chatbots using agentic AI frameworks (good to have). Work directly with external clients to identify and understand analytical requirements. Responsibilities: Proven experience in Machine Learning and AI-related roles. Strong proficiency in SQL and Python for data manipulation and analysis. Hands-on experience with Databricks for data eng...

DESCRIPTION Are you passionate about transforming complex data into actionable business insights at a global scale? RBS Brand Experience (formerly APIE) is seeking an experienced Business Intelligence Engineer who thrives on ambiguity and can decipher evolving business needs to shape data-driven solutions. As a Business Intelligence Engineer, you'll be at the intersection of data and business strategy, translating complex requirements into actionable analytics solutions. You'll partner with stakeholders to unlock insights that elevate our global work authorization experiences and drive program scalability. Key job responsibilities A successful candidate will demonstrate: Advanced SQL skills ...

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Databrick ,Python within the AWS cloud ecosystem, including Hadoop, Pyspark, Nifi The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities: Design, develop, and maintain efficient processes using Databrick , ...

Experience : 3.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Aria Intelligent Solutions) (*Note: This is a requirement for one of Uplers' client - Aria Intelligent Solutions) What do you need for this opportunity? Must have skills required: Databricks, Develop and deploy production-ready solutions on AWS, PySpark, hands-on experience in applied ML, or forecasting., Time Series Aria Intelligent Solutions is Looking for: Key Skills  4–6 years of hands-on experience in applied ML, time ser...

Position:- Cloud Data Architect (Azure & AWS) Technology- Cloud Data Architect, Azure, AWS AWS Glue, S3, Redshift, and EMR, Data Factory, Data Lake, Synapse, and Databricks Experience 10+ years Work Location - Navi Mumbai Job Description Deep expertise in Azure and AWS data ecosystems to lead end-to- end solutioning covering data ingestion, transformation, governance, security, and analytics platform design Solution Architecture & Delivery Design, architect, and implement modern cloud-native data platforms on Azure and AWS tailored to client needs Build data lakehouse solutions using Azure Synapse, Databricks, AWS Redshift, Glue, EMR, and Delta Lake Lead the development of ETL/ELT pipelines ...

OVERVIEW OF THE ROLE As a Databricks Architect, You will play a pivotal role in leading and architecting data solutions that align with our business goals and technical requirements. Your expertise in Databricks and Azure technologies will be instrumental in driving data initiatives and ensuring seamless integration across projects. This position offers the opportunity to make a significant impact on the company's objectives by delivering data-driven insights and fostering collaboration among cross-functional teams. DETAILED RESPONSIBILITIES - Lead the data solutions stream within the program, ensuring timely and quality delivery of data components. - Oversee the development and execution of...

Apply for this Job Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins. Why join Coupa? 🔹 Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend. 🔹 Collaborative Culture: We value collaboration and tea...

Riverion is looking for an experienced Azure Data Engineer to join our growing data team in India. This role is ideal for someone with a strong foundation in cloud-based data engineering, who thrives on solving complex data challenges and building scalable solutions using Azure technologies. If you're passionate about data, performance optimization, and automation, we’d love to hear from you Who You Are A data engineering professional with 4–5 years of experience, specializing in Azure-based solutions. Proficient in SQL, with expertise in advanced query writing, stored procedures, and performance tuning. Skilled in Python for data manipulation, automation, and integration tasks. Experienced ...

Role & responsibilities 1• Developing, managing and optimizing robust and reliable data pipelines using azure native capabilities. 2• Implement ADF workflows that perform data ingestion, data integration/ETL, statistical model executions etc. 3• Creating architecture for data solutions with high performance characteristics 4• Bringing data and analytics products to production 5• Implement CI/CD pipelines for data solutions 6• Build dashboards for data stewards and business reporting 7• Design & build RDBMS data models Preferred candidate profile 5+ of Relevant Experience in Data Engineering Notice Period - 15 Days Joiners only

Build and deploy ML/LLM systems on Azure, design RAG and multi-agent workflows, integrate models with Azure data pipelines, optimize model performance, implement MLOps, and ensure Azure-based governance and compliance. Required Candidate profile Azure-focused ML engineer with strong LLM, RAG, Databricks, and DevOps skills. Able to design scalable ML systems, integrate Azure data services, and deliver enterprise AI solutions end-to-end.

Role Purpose The Senior Data & Analytics Architect will play a pivotal role in designing and delivering enterprise-grade data solutions across global markets. This role requires in-depth technical expertise in cloud-native platforms—particularly Databricks—alongside a strategic consulting mindset. The lead will lead cross-functional teams, drive innovation, and ensure data platforms are scalable, secure, and aligned with business goals fro Global enterprises. The person should be hands-on with the Databricks platform, Azure Data Factory, and with a good understanding of platform engineering and operations also. Key Responsibilities 1. Architecture & Solution Design Lead the design and implem...

Role Description ROLE: Senior-Level Data Scientist Requirement Professional experience of 10+ years in business analysis, requirement gathering, solution workflow design for AI/ML/Analytics project Experience in programming skills in Python and SQL Strong understanding of ML libraries and applications e.g., Time series analysis, Neural Net, SVMs, boosting methods and implementation using Python Experience in Deep learning techniques Excellent Communication skills to effectively collaborate with business SMEs, UX team Intermediate knowledge with Dev Ops practices, including CICD, Automation, Build Management, and Versioning Understanding of Cloud services, including Microsoft Azure, GCP or Am...

Responsibilities: Only 6+ allowed Design, develop & maintain ETL processes using AWS Glue, lambda, Python & SQL Optimize performance with Airflow workflows or Step Functions Sound knowledge on Python, spark & optimisation techniques Knowledge of Redshift Office cab/shuttle

Role: Associate Architect - Data Experience Level: 6 to 9 Years Work location: Mumbai, Bangalore, Trivandrum Notice Period: 0-45 days only Role & Responsibilities: 5+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business Intelligence/Artificial Intelligence solutions on Cloud (GCP/AWS/Azure) Ability to understand business requirements, translate them into functional and non-functional areas, and define non-functional boundaries in terms of Availability, Scalability, Performance, Security, Resilience etc. Experience in architecting, designing, and implementing end-to-end data pipelines and data integration solutions for varied s...

Design and develop ML/GenAI models, build agentic AI systems, deploy models using TorchServe/Docker, create fraud/risk models, ensure explainability/governance, optimize ML performance, and mentor junior data scientists. Required Candidate profile Expert in ML/Deep Learning, GenAI, Transformers, and PySpark. Skilled in building agentic AI, deploying models, ensuring governance, and delivering scalable AI solutions across cloud platforms

Job Overview: We are seeking an experienced Senior Developer with strong expertise in Python, Node.js, Azure, and a proven track record of migrating cloud applications from AWS to Azure. This role requires hands-on experience in PySpark, Databricks, and Azure data services such as ADF and Synapse Spark. The ideal candidate will lead end-to-end modernization and migration initiatives, code remediation, and deployment of serverless and microservices-based applications in Azure. Key Responsibilities: Lead the migration of Python and Node.js applications from AWS to Azure. Analyze legacy AWS architecture, source code, and cloud service dependencies to identify and implement code refactoring and ...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. Function Description: Launched in 2012, Amex Offers is a digital advertising platform that connects Merchants and brands with the tens of millions of American Expr...

Requisition ID: 7554 Location: Thane (W), MH, IN, 400604 Business Unit / Group Function: Information Technology Work Arrangement: Onsite Level of Experience: Intermediate Job Highlights Design, build, and operate secure, transparent data pipelines—moving and transforming data from SAP BW/ERP, OSIsoft PI, Dynamics CRM, web APIs, SFTP, and file shares to drive analytics and AI initiatives. Develop scalable batch and streaming processes using PySpark, working in environments like Azure Synapse. Build, test, and deploy CI/CD workflows for data pipelines (using Git, Azure DevOps, DataLake, ADF, Synapse Pipelines). Maintain documentation, unit tests, and code reviews for robustness and maintainabi...

Job Title: Senior Data Engineer Experience: 6+ Years Employment Type: Contract Location: Remote Overview We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines. The ideal candidate will have strong experience with Azure Data Factory (ADF), Azure Synapse, PySpark, and SQL, along with solid data orchestration and integration skills. DP-600 certification is mandatory. Key Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines. Build and optimize data workflows using ADF, Synapse, and PySpark. Write and tune SQL queries for transformation and performance. Integrate and orchestrate d...

Educational Requirements MCA,MSc,Bachelor of Engineering,BBA,BCom Service Line Data & Analytics Unit Responsibilities Roles & Responsibilities: Understand the requirements from the business and translate it into an appropriate technical requirement. Responsible for successful delivery of MLOps solutions and services in client consulting environments; Define key business problems to be solved; formulate high level solution approaches and identify data to solve those problems, develop, analyze/draw conclusions and present to client. Assist clients with operationalization metrics to track performance of ML Models Help team with ML Pipelines from creation to execution Guide team to debug on issu...

Role Overview: You will be responsible for designing and deploying predictive models, building ML pipelines, optimizing model performance, implementing Delta Lake, enabling CI/CD for ML pipelines, and troubleshooting issues in Spark Jobs and Databricks Environment. As a Senior Programmer Analyst in AI-ML Engineering, you are expected to have strong technical expertise and experience in Python, PySpark, MLflow, and predictive modeling techniques. Key Responsibilities: - Design and deploy predictive models (e.g., forecasting, churn analysis, fraud detection) using Python/SQL, Spark MLlib, and Databricks ML. - Build end-to-end ML pipelines (data ingestion, feature engineering, model training, d...

As a Data Engineer at our company, you will play a crucial role in designing, building, and maintaining end-to-end data platforms to support product-performance analytics. Your responsibilities will include: - Engineering robust ETL/ELT pipelines and data models for processing structured and unstructured product and customer data. - Managing data lake migrations and ensuring One-Lake availability for various stakeholders. - Implementing CI/CD for data deployments, ensuring pipeline observability, and maintaining data quality. - Creating dashboards and visual insights for Product, Marketing, and Engineering teams. - Collaborating with cross-functional teams, mentoring junior engineers, and es...

As a Senior Data Engineer in the EY GDS Data and Analytics (D&A) team, you will have the opportunity to leverage your strong technology and data understanding in the big data engineering space to design, develop, and manage data solutions using Microsoft Fabric. Your role will be crucial in implementing ETL/ELT processes, creating and maintaining data models, and collaborating with cross-functional teams to deliver data solutions that meet business needs. Additionally, you will play a key role in optimizing code for data processing and analysis, implementing DevOps practices, and monitoring data pipelines for reliability and performance. **Key Responsibilities:** - Design, develop, and manag...

In this role at EY, you will be responsible for providing expert level data solutions using software to process, store, and serve data to others. You will test data quality, optimize data availability, and ensure that data pipelines are scalable, repeatable, and secure. Your role will involve utilizing deep analytical skills on internal and external data, as well as leading, instructing, and mentoring newer Data Engineering crew. Key Responsibilities: - Write ETL (Extract / Transform / Load) processes, design database systems, and develop tools for real-time and offline analytic processing. - Troubleshoot software and processes for data consistency and integrity, integrating complex and larg...

We are hiring for Azure databricks Engineer for EY GDS. Exp Range: 4-7yrs Location: Kolkata/Trivandrum/Coimbatore/Kochi We have virtual interviews planned for 22nd Nov'2025, If interested kindly apply for the role via below link & keep yourself available for the same https://careers.ey.com/job-invite/1650765/ Your key responsibilities Architecting big data solutions in a cloud environment using Azure Cloud services ETL design, development, and deployment to Cloud Service Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams Develop standardized practices for delivering new products and capabilities using Big Data technologies, including data ac...