23086 Pyspark Jobs - Page 30

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will be at the forefront of designing, building, and configuring applications. Your typical day will involve collaborating with various stakeholders to gather requirements, overseeing the development process, and ensuring that the applications meet the specified needs. You will also be responsible for troubleshooting issues and provi...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various stakeholders to gather requirements, overseeing the development process, and ensuring that the applications meet the specified needs. You will also engage in problem-solvi...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will also engage...

About Position: We are hiring MS Fabric Architect with hands on experience on Architect, MS Fabric, SQL, Azure, Python, Pyspark. Role: MS Fabric Architect Location: Pune, Bangalore Experience: 15 to 18 Years Job Type: Full Time Employment What You'll Do: Strong knowledge of Life Science domain, especially in CRO business is a plus. Excellent knowledge of languages like Python, SQL, Pyspark, Azure MS Fabric skills, Databricks is a plus. Proven record of working as delivery lead, engaging with customer architects/ business stakeholders and delivery personnel, owning smooth deliveries Should have worked as technical architect and delivered complex, critical, secure, available, and scalable proj...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : PySpark Good to have skills : Java Enterprise Edition, Google BigQuery, Google Cloud Platform Architecture Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing i...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will be responsible for implementing the design, which includes various relevant data platform components. Extensive experience in building and managing modern data platforms on Azure using Lakehouse architecture. The ideal candidate will have strong hands-on experience in PySpark, SQL, and Azu...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Roles & Responsibilities :Provide operational support for Azure Databricks clusters, jobs, notebooks, and workspaces.Monitor platform health, job performance, and troubleshoot issues related to pipelines, clusters, and data latency.Handle incident management, root cause analysis (RCA), and L2/L3 problem resolution for Databric...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Roles & Responsibilities :Provide operational support for Azure Databricks clusters, jobs, notebooks, and workspaces.Monitor platform health, job performance, and troubleshoot issues related to pipelines, clusters, and data latency.Handle incident management, root cause analysis (RCA), and L2/L3 problem resolution for Databric...

About The Role Project Role : Data Science Practitioner Project Role Description : Formulating, design and deliver AI/ML-based decision-making frameworks and models for business outcomes. Measure and justify AI/ML based solution values. Must have skills : Data Science Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Design, develop, and deploy Python-based applications leveraging Generative AI models, LLMs, and AI-powered APIs for enterprise and product use cases.Roles & Responsibilities:- Develop AI-powered applications integrating LLMs (OpenAI GPT, Claude, LLaMA, Mistral, etc.) via APIs and SDKs - Fine-tu...

About The Role Project Role : Large Language Model Architect Project Role Description : Architect large language models (LLM) that can process and generate natural language. Design neural network parameters, trained on large quantities of unlabeled text data. Must have skills : Large Language Models Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education SUMMARY:We are seeking a Senior Technical GenAI Lead with deep expertise in Python, AI/ML concepts, and data engineering to spearhead the design and development of Data Agents powered by Agentic AI. As a senior technical leader, you will drive solution architecture, guide...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Roles & Responsibilities :Provide operational support for Azure Databricks clusters, jobs, notebooks, and workspaces.Monitor platform health, job performance, and troubleshoot issues related to pipelines, clusters, and data latency.Handle incident management, root cause analysis (RCA), and L2/L3 problem resolution for Databric...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Analytics Services Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Roles & Responsibilities:-Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads.-Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and Python-based custom scripts for data ingestion and curation.-Collaborate with Data Ana...

Position Summary The candidate will work along with other data scientists and data engineers to support activities related to development and maintenance of products that generate key insights on industry trend by applying various machine learning and statistical techniques on proprietary as well as open data sources. The person will work alongside Product managers, Industry Analysts and Technology experts to develop and deliver the product in accordance with customer requirements and agreed timeline. The candidate should have 10+ years work experience in developing products/services using Data Science and Analytics. Duties and responsibilities Work as part of analytics team based in Bangalo...

About Position: We are seeking Data Engineer with hands-on experience in Spark, Pyspark, AWS, Java, Python etc., Role: Data Engineer Location: All Persistent Locations Experience: 6 to 10 Years Job Type: Full Time Employment What You'll Do: Design, build, and maintain data pipelines to move and process large datasets efficiently. Work closely with cross-functional teams to ensure data accuracy, reliability, and availability. Optimize data workflows to enhance performance and scalability. Use AWS services and big data tools to handle real-world data challenges. Write and maintain clean, reusable code using Python, Java, and SQL. Implement best practices for data security, quality, and governa...

Role & responsibilities Preferred candidate profile Experience Required: 4 years Domain: Clinical & Healthcare( Main ) Location: Bangalore L Job Responsibilities Design, develop, and optimize scalable big data pipelines using Hadoop, Spark, and related technologies. Build and maintain ETL workflows for ingesting, transforming, and processing large datasets from diverse sources. Implement data models and validation rules to ensure data quality and support advanced analytics. Collaborate with data analysts, business teams, and other stakeholders to deliver business intelligence solutions. Automate data validation, performance monitoring, and reporting using tools like Airflow, BigQuery, and Sn...

Greetings from Tata Consultancy Services Unleash innovation with cloud at TCS!!! Join the In-Person Interview on 22nd November 2025 and Pave your path to value with TCS Team. Interview will be Offline on 22nd November 2025 at TCS Bengaluru(Venue will be shared in the call letter upon confirmation). PFB the Job Description:- Job Title: Azure Data Engineer Experience Required: 4 to 10 Years Location: Bengaluru Job Description: Strong hands-on experience with Databricks and Apache Airflow for data orchestration. Expertise in PySpark , SQL , and Python for large-scale data processing. Proven experience in building and maintaining scalable data pipelines in a cloud environment. Experience leading...

Job Description At Oracle Health, we put humans at the heart of every conversation. Our mission is to create a human-centric healthcare experience powered by unified global data. As a global leader we’re looking for a Data Engineer with BI to join an exciting project for replacing existing Data warehouse systems with the Oracle's own data warehouse to manage storage of all the internal corporate data to provide insights that will help our teams to make critical business decisions Join us and create the future! Responsibilities Career Level - IC3 Roles and Responsibilities Proficient in writing and optimising SQL queries for data extraction Translate client requirements to technical design th...

Greetings from Tata Consultancy Services Unleash innovation with cloud at TCS!!! Join the In-Person Interview on 22nd November 2025 and Pave your path to value with TCS Team. Interview will be Offline on 15th November 2025 at TCS Hyderabad (Venue will be shared in the call letter upon confirmation). PFB the Job Description:- Job Title: Azure Data Analyst Experience Required: 4 to 10 Years Location: Hyderabad Job Description: 1) Build, monitor, schedule ADF pipelines 2) Develop PowerBI reports/metrics with good work exp of developing DAX queries 3) Proficient in SQL queries, filter, joins, group bys, sub queries, indexing, optimization etc. 4)Design, develop, and maintain data pipelines and M...

Design and implement frameworks to automate and deploy Management Information System (MIS), data integration, and manual operations workflows, streamlining processes and reducing manual effort. Create databases and data marts that are required for performing analysis quickly and efficiently. Work with product & data teams to get the build data pipelines required for creating the required databases/data marts Perform analysis and provide data-backed recommendations for solving difficult problems and improving operational efficiency Work along with the collections strategy team in getting the recommendations implemented and understanding the improvements because of the recommendations Must hav...

Design, build, deploy machine learning, statistical, optimization models into Uber production systems for a wide range of applications. Collaborate with multi-functional teams across areas such as product, engineering, operations, and design to drive system development end-to-end from conceptualisation to productionization. Understanding product performance and to find opportunities within data. Basic Qualifications ---- 3+ years of proven experience as a Machine Learning Scientist, Machine Learning Engineer, Research Scientist or equivalent. Experience in production coding and deploying ML, statistical, optimization models in real-time systems. Ability to use Python or other programming lan...

A person with strong technical skills who can understand complex financial analyses in Excel and partner effectively with the business to write code in Python that will be used for data and report automation processes. Ideally 3+ years experience doing data-heavy work in a financial or economic-adjacent field (or equivalent) Can understand a complex Excel financial model, breaking it down into manageable components Can partner closely with the business to specify and understand business requirements, ask clarifying questions, and write down the goals and technical specifications in documentation Prior experience writing complex logic in Python code to transform time series data Can write aud...

Design, develop, and maintain ETL pipelines using AWS Glue, Redshift, and other AWS services. Optimize data models and queries for performance, scalability, and reliability. Collaborate with data architects, analysts, and business teams to understand requirements and deliver data solutions. Implement data quality, governance, and security standards across data pipelines. Automate workflows, monitoring, and performance tuning in AWS environments. Manage data ingestion from multiple structured and unstructured sources. Troubleshoot and resolve data processing issues in production environments. Required Skills: Strong experience in AWS Redshift (performance tuning, schema design, and data wareh...

Design, code, and develop new features/fix bugs/add enhancements Analyze and improve efficiency, scalability and stability of various system resources Lead and Mentor junior engineers and drive a culture of technical perfection. Drive creative and innovative solutions to complex problems, exemplifying good technical discernment. Drive improvements and new approaches to address potential systemic pain points and technical debt, anticipate and avoid problems. Take a hands-on approach in the development of prototypes, independently and with others, to establish design decisions and/or technical feasibility. Evaluate, Install, Setup, Maintain and Upgrade, Data Engineering, Machine Learning and C...

Design, build, and own the Finance Data Cube , integrating financial, customer, and operational datasets. Model data to support CLTV, Contribution Margin , and other profitability KPIs across multiple dimensions (customer, product, LOB, geography, etc.) Be a data architect for Finance , bring different data into cohesive and answer critical questions Leverage AI tools to automate data summarization, anomaly detection, and narrative insights for Finance stakeholders. Scale data infrastructure to support large volumes and complex financial models. Translate complex financial concepts and KPIs into scalable, maintainable data models. Implement strong controls for data quality, lineage, and gove...