15947 Pyspark Jobs - Page 30

In-depth expertise in Azure Data Factory and Databricks , including building scalable data pipelines, orchestrating complex workflows, implementing dynamic and parameterized pipelines, and optimizing Spark-based data transformations for large-scale integrations. Hands-on experience with Databricks Unity Catalog for centralized data governance, fine-grained access control, auditing, and managing data assets securely across multiple workspaces. Expert-level knowledge in RDBMS (SQL Server) with clear understanding of SQL query writing, object creation and management and performance and optimisation of DB/DWH operations. Good understanding of Transactional and Dimensional Data Modelling, Star Sc...

At Citi we’re not just building technology, we’re building the future of banking. Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with laser focused on evolving the ways of doing things. As one of the world’s most global banks we’re changing how the world does business Shape your Career with Citi We’re currently looking for a high caliber professional to join our team as 25907705 Officer, Big Data developer -C11- Hybrid based in Pune , India. Being part of our team means that we’ll provide you with the resources to meet your unique needs, empower you to...

Company Description MarsDevs is a remote-first, offshore digital product development company, committed to delivering high-quality code and long-lasting technical architectures. We specialize in building MVPs, mobile and web applications, and SaaS products for startups and SMBs. Our services include systematic project analysis, UI/UX design, technical consulting, application deployment, and ongoing support. Based in India, MarsDevs has successfully delivered over 60 solutions across 10 countries and 12 industry verticals in the last four years. About The Role We are hiring a Senior Developer with strong expertise in PySpark, Machine Learning, Generative AI, SQL, Data Warehousing, and Microso...

Role Overview: You will be responsible for designing and implementing scalable data solutions using Big Data technologies and Google Cloud Platform services. Your role will involve optimizing data pipelines, collaborating with cross-functional teams, ensuring data quality, and staying updated with emerging trends in GCP data analytics. Key Responsibilities: - Design, develop, and optimize data pipelines using GCP BigQuery, Dataflow, and Apache Airflow - Utilize the Big Data Hadoop ecosystem to manage and process large datasets efficiently - Collaborate with cross-functional teams to gather requirements and deliver reliable data solutions - Ensure data quality, consistency, and integrity acro...

Role Overview: As a Python Data Analytics Engineer at HARMAN Automotive, you will play a crucial role in working with big data, performing machine learning, and analyzing data using Python. You will engineer audio systems and integrated technology platforms to enhance the driving experience by combining ingenuity, in-depth research, collaboration, design, and engineering excellence. Key Responsibilities: - Work with big data using Python libraries like PySpark, NumPy, and Pandas. - Develop and implement machine learning models to analyze data and drive insights. - Analyze complex data sets to identify trends, patterns, and correlations. - Develop and maintain Python-based data analytics scri...

As an AI/ML Scientist at our company, your role will involve collaborating with business, platform, and technology stakeholders to understand project scopes. You will be responsible for performing comprehensive exploratory data analysis to derive inferences for further solutioning, experimentation, and evaluation. Additionally, you will design, develop, and deploy robust enterprise AI solutions using Generative AI, NLP, machine learning, and other technologies. Your focus should always be on providing business value while ensuring technical sustainability. It will be part of your responsibility to promote and drive the adoption of cutting-edge data science and AI practices within the team. S...

As an Analyst in the Analytics and Information Management (AIM) team at Citi, your role involves leveraging data to provide reporting and business insights support to the North America Consumer bank. You will work on various projects related to credit card portfolio analysis, campaign impacts assessment, opportunity sizing, and process efficacy. Your primary responsibilities include: - Drive multiple projects involving large and complex data sets using programming tools such as SQL, SAS, SAS Macro, Python, and Pyspark - Provide financial estimates by analyzing credit card business financials and historical trends - Partner with stakeholders to drive tangible outcomes and propose solutions ba...

Role Overview: At PwC, as a Senior Associate in the Data Science - Conversational AI domain, you will focus on leveraging data to drive insights and make informed business decisions. Your role will involve utilizing advanced analytics techniques to extract insights from large datasets, drive data-driven decision-making, and provide business recommendations to project teams. You will work as an integral part of business analytics teams, leading high-end analytics consulting engagements and collaborating with clients and consultants in the U.S. Key Responsibilities: - Develop and execute project & analysis plans under the guidance of the project manager. - Translate business needs into data sc...

As a Senior Engineer in the Enterprise Data Platform team at Magna, your role is crucial in designing, constructing, and managing scalable, secure, and high-performance data infrastructure across Azure, AWS, and Databricks. You will be expected to demonstrate expertise in cloud administration, CI/CD automation, and innovation in developing ingestion patterns and reference architectures for the platform. **Key Responsibilities:** - **Platform Engineering & Administration** - Administer and optimize Azure and AWS cloud environments, including resource provisioning, access control, monitoring, and cost management. - Manage and maintain Databricks workspaces, clusters, jobs, notebooks, and user ...

As a Palantir Foundry Developer, your role will involve designing, developing, and maintaining data pipelines, applications, and reports within the Palantir Foundry platform. You should have over 8 years of IT experience, with at least 2 years of specific experience in working with Palantir and Python. Your primary focus will be on leveraging the Workshop application to create user interfaces, dashboards, and workflows that facilitate data-driven decision-making. Collaboration with cross-functional teams is crucial to deliver high-quality data solutions while maintaining performance and data integrity. Responsibilities: - Develop and maintain data pipelines using Python, PySpark, and SQL wit...

Role Overview: You will be responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing, and analyzing large volumes of data efficiently and accurately. Collaborating with business and technology stakeholders to understand current and future data requirements will be a key aspect of your role. Key Responsibilities: - Collaborate with business and technology stakeholders to understand current and future data requirements - Design, build, and maintain reliable, efficient, and scalable data infrastructure for data collection, storage, transformation, and analysis - Plan, design, build, and maintain scalabl...

Role Overview: As a Data Engineer at Wipro in Pan India, your primary responsibility will be to work with Azure and Databricks skill sets. The team needs to be ramped up within 2 weeks, so we are looking for immediate and pre-screened quality candidates. You may need to adjust the count of roles based on how quickly we can close the positions. Preference is for candidates from Pune or Mumbai locations to co-locate with the rest of the team. Key Responsibilities: - Work with Azure and Databricks technologies - Utilize Azure ADF for data integration - Hands-on experience in Python Pyspark programming - Perform performance tuning for optimized data processing - Proficiency in Relational Databas...

You are a passionate team member of AiEdge Analytics, a group of certified experts with extensive experience in Microsoft Technologies for Data Engineering, Data Analytics, and Business Intelligence. By transforming raw data into valuable insights, you drive innovation and empower clients through expertise in Microsoft Data Analytics and AI-driven solutions. Your focus on data security and lasting partnerships ensures the delivery of high-quality, cost-optimized solutions that positively impact various industries and society. As an Azure Data Engineer on a contract basis with AiEdge Analytics, you will: - Utilize your 5-8 years of experience in Data Engineering, particularly with Extract Tra...

About the Role We’re hiring a hands-on Data Analyst to turn business questions into reliable datasets, clear visuals, and automated workflows. You’ll build and maintain Power BI dashboards, shape data models, and orchestrate pipelines using Microsoft Fabric. You’ll also own Make.com automation for API-based data acquisition and notifications, perform web scraping (ethically and compliantly), and write Python to automate, cleanse, and enrich data. The ideal candidate is equal parts analyst and problem-solver, comfortable moving from stakeholder requirements to production-grade dashboards and automations. What You’ll Do Business Intelligence & Visualization Build, iterate, and maintain Power B...

Hi, Wishes from GSN!!! Pleasure connecting with you!!! We been into Corporate Search Services for Identifying & Bringing in Stellar Talented Professionals for our reputed IT / Non-IT clients in India. We have been successfully providing results to various potential needs of our clients for the last 20 years. At present, GSN is hiring DATA ENGINEER for one of our leading MNC client. PFB the details for your better understanding : 1. WORK LOCATION : CHENNAI 2. Job Role: DATA ENGINEER 3. EXPERIENCE : 3 to 6 yrs (relevant) 4. CTC Range: 12LPA to 20 LPA 5. Work Type : WFO - Hybrid Who are we looking for : A Data Engineer focuses on enhancing and supporting existing Data & Analytics solutions by l...

Project Role : Large Language Model Architect Project Role Description : Architect large language models (LLM) that can process and generate natural language. Design neural network parameters, trained on large quantities of unlabeled text data. Must have skills : Large Language Models Good to have skills : NA Minimum 12 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education SUMMARY: We are seeking a Senior Technical – GenAI Lead with deep expertise in Python, AI/ML concepts, and data engineering to spearhead the design and development of Data Agents powered by Agentic AI. As a senior technical leader, you will drive solution architecture, guide teams, and ...

Project Role : Large Language Model Architect Project Role Description : Architect large language models (LLM) that can process and generate natural language. Design neural network parameters, trained on large quantities of unlabeled text data. Must have skills : Large Language Models Good to have skills : NA Minimum 12 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education SUMMARY: We are seeking a Senior Technical – GenAI Lead with deep expertise in Python, AI/ML concepts, and data engineering to spearhead the design and development of Data Agents powered by Agentic AI. As a senior technical leader, you will drive solution architecture, guide teams, and ...

Project Role : Large Language Model Architect Project Role Description : Architect large language models (LLM) that can process and generate natural language. Design neural network parameters, trained on large quantities of unlabeled text data. Must have skills : Large Language Models Good to have skills : NA Minimum 12 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education SUMMARY: We are seeking a Senior Technical – GenAI Lead with deep expertise in Python, AI/ML concepts, and data engineering to spearhead the design and development of Data Agents powered by Agentic AI. As a senior technical leader, you will drive solution architecture, guide teams, and ...

Experience : 4.00 + years Salary : INR 1500000-3000000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: NuStudio.AI) (*Note: This is a requirement for one of Uplers' client - AI-first, API-powered Data Platform) What do you need for this opportunity? Must have skills required: Databricks, dbt, Delta Lake, Spark, Unity catalog, AI, Airflow, Cloud Function, Cloud Storage, Databricks Workflows, Dataflow, ETL/ELT, Functions), GCP (BigQuery, Pub/Sub, PySpark, AWS, Hadoop AI-first, API-powered Data Platform is Looking for: We’re scalin...

Experience : 3.00 + years Salary : INR 2500000.00 / year (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: NA) (*Note: This is a requirement for one of Uplers' client - Nomupay) What do you need for this opportunity? Must have skills required: Apache Hudi, Flink, Iceberg, AWS, Python, PySpark, Batch Processing, Apache Spark Nomupay is Looking for: 📈 Opportunity in a company with a solid track record of performance 🤝 Opportunity to work with diverse, global teams 🚀 Rapid career advancement with opportunities to learn 💰 Competitive salary ...

Experience : 4.00 + years Salary : INR 1500000-3000000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: NuStudio.AI) (*Note: This is a requirement for one of Uplers' client - AI-first, API-powered Data Platform) What do you need for this opportunity? Must have skills required: Databricks, dbt, Delta Lake, Spark, Unity catalog, AI, Airflow, Cloud Function, Cloud Storage, Databricks Workflows, Dataflow, ETL/ELT, Functions), GCP (BigQuery, Pub/Sub, PySpark, AWS, Hadoop AI-first, API-powered Data Platform is Looking for: We’re scalin...

Experience : 3.00 + years Salary : INR 2500000.00 / year (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: NA) (*Note: This is a requirement for one of Uplers' client - Nomupay) What do you need for this opportunity? Must have skills required: Apache Hudi, Flink, Iceberg, AWS, Python, PySpark, Batch Processing, Apache Spark Nomupay is Looking for: 📈 Opportunity in a company with a solid track record of performance 🤝 Opportunity to work with diverse, global teams 🚀 Rapid career advancement with opportunities to learn 💰 Competitive salary ...

Experience : 4.00 + years Salary : INR 1500000-3000000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: NuStudio.AI) (*Note: This is a requirement for one of Uplers' client - AI-first, API-powered Data Platform) What do you need for this opportunity? Must have skills required: Databricks, dbt, Delta Lake, Spark, Unity catalog, AI, Airflow, Cloud Function, Cloud Storage, Databricks Workflows, Dataflow, ETL/ELT, Functions), GCP (BigQuery, Pub/Sub, PySpark, AWS, Hadoop AI-first, API-powered Data Platform is Looking for: We’re scalin...

Experience : 4.00 + years Salary : INR 1500000-3000000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: NuStudio.AI) (*Note: This is a requirement for one of Uplers' client - AI-first, API-powered Data Platform) What do you need for this opportunity? Must have skills required: Databricks, dbt, Delta Lake, Spark, Unity catalog, AI, Airflow, Cloud Function, Cloud Storage, Databricks Workflows, Dataflow, ETL/ELT, Functions), GCP (BigQuery, Pub/Sub, PySpark, AWS, Hadoop AI-first, API-powered Data Platform is Looking for: We’re scalin...

Experience : 3.00 + years Salary : INR 2500000.00 / year (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: NA) (*Note: This is a requirement for one of Uplers' client - Nomupay) What do you need for this opportunity? Must have skills required: Apache Hudi, Flink, Iceberg, AWS, Python, PySpark, Batch Processing, Apache Spark Nomupay is Looking for: 📈 Opportunity in a company with a solid track record of performance 🤝 Opportunity to work with diverse, global teams 🚀 Rapid career advancement with opportunities to learn 💰 Competitive salary ...