15947 Pyspark Jobs - Page 23

Summary: 0 Duties & Responsibilities: Job Description Summary We are seeking a motivated, talented Machine Learning Intern to join our team and contribute to AI and ML projects. The internship gives an opportunity to work with experienced Data Engineers, Scientists, gain hands-on in developing and upgrading AI/ML models. The internship offers the candidate an excellent chance to apply his knowledge and learning on ML algorithms to solve real world problems in Telecom domain around Network Monitoring and troubleshooting, deploying trained models and improve the evaluation scores of the models. Job Description Develop production-ready implementations of proposed solutions across different ML a...

We are seeking a dedicated and detail-oriented Business Technology Associate Consultant with 3+ years of experience in data management and analysis. The successful candidate will leverage their expertise in Knowledge Graph, Neo4j or AWS Neptune or Anzo knowledge graph Database , Graph development, and cloud technologies such as AWS and Snowflake/Databricks to enhance our data quality and support Master Data Management (MDM) initiatives. You will be part of our Supply Chain and Manufacturing team , working closely with cross-functional teams and clients to ensure data integrity and deliver actionable insights. What youll do : We are looking for experienced Knowledge Graph developers who have ...

What Youll Do Design and implement technical features leveraging best practices for technology stack being used Collaborate with client-facing teams to understand solution context and contribute to technical requirement gathering and analysis Work with technical architects on the team to validate design and implementation approach Write production-ready code that is easily testable, understood by other developers, and accounts for edge cases and errors Ensure the highest quality of deliverables by following architecture/design guidelines, coding best practices, periodic design/code reviews Write unit tests as well as higher-level tests to handle expected edge cases and errors gracefully, as ...

Position Overview We are seeking an experienced Data Engineer with strong expertise in Databricks, Azure Data Services ecosystem (ADF, ADLS, Microsoft Fabric, Synapse, etc.), Python, PySpark, and databases . The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and solutions to enable advanced analytics, business intelligence, and AI-driven initiatives. Key Responsibilities Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks . Work with Azure Data Lake Storage (ADLS) , Microsoft Fabric , and Azure Synapse Analytics to build robust data platforms. Develop scalable ETL/ELT solutions leveraging Python, PySp...

Senior/Lead Data Engineer - Databricks We are seeking a highly skilled and experienced Data Engineering Lead with a strong background in the retail domain and exceptional programming abilities. As a Lead, you will play a pivotal role in implementing, and optimizing data architecture to support our retail business operations and analytics initiatives. Your expertise in Spark programming, optimization techniques, and familiarity with Databricks and CI/CD practices will be instrumental in ensuring the efficient and effective management of our data ecosystem. Imp Pointers as below skills should be in the CV Data Platform (Data Engineers) Data Lake: AWS S3 / Azure / Dell Cloud Data Lake with Delt...

Assistant Manager EXL/AM/1492313 ServicesGurgaon Posted On 24 Sep 2025 End Date 08 Nov 2025 Required Experience 1 - 3 Years Basic Section Number Of Positions 2 Band B1 Band Name Assistant Manager Cost Code D014365 Campus/Non Campus NON CAMPUS Employment Type Permanent Requisition Type New Max CTC 700000.0000 - 1200000.0000 Complexity Level Not Applicable Work Type Hybrid – Working Partly From Home And Partly From Office Organisational Group Analytics Sub Group Banking & Financial Services Organization Services LOB Banking & Financial Services SBU Analytics Country India City Gurgaon Center Gurgaon-SEZ BPO Solutions Skills Skill SQL PYTHON Minimum Qualification B.TECH/B.E Certification No dat...

Responsibilities: * Design, develop & maintain data pipelines using Snowflake, Python, SQL & AWS. * Optimize performance & ensure data accuracy through ETL processes.

Role: Data Architect Location: Delhi Mode: Hybrid Type: Contract Job Description: We are looking for an experienced Data Architect with strong expertise in data modeling , Azure data services , and data pipeline development . The ideal candidate will have hands-on experience with ADF , Databricks , and PySpark (mandatory), and be proficient in SQL . Strong stakeholder management skills are essential for collaborating with cross-functional teams and translating business needs into scalable data solutions. Key Skills Required: Proven experience as a Data Architect Strong data modeling skills (conceptual, logical, physical) Hands-on with Azure Tech Stack (e.g., Azure Data Factory, Azure Databri...

ZS's Scaled AI practice is part of ZS's rich and advanced AI ecosystem, in the Associate Consultant role, focused on creating continuous business value for clients using a range of innovative machine learning, deep learning, and engineering capabilities.Being part of Scaled AI practice allows you to collaborate with data scientists to create state-of-the-art AI models, create and use cutting-edge ML platforms, create and deploy advanced ML pipelines and manage the complete ML lifecycle. What Youll Do Experience in creating GenAI applications such as answering engines, extraction components, and content authoring. Strong knowledge in developing RAG-based pipelines using frameworks like LangCh...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage. Why PWC At PwC, you will be par...

6+ Noida Greeting from Ashratechnologies We are Hiring Role: Data Engineer Exp: 6+Years Locations; Noida,Gurugram Data Engineer (AWS + pySpark) JD as provided below 6+ years of overall IT experience, which includes hands on experience in Big Data technologies. Mandatory - Hands on experience in Python and PySpark. Build pySpark applications using Spark Dataframes in Python. Worked on optimizing spark jobs that processes huge volumes of data. Hands on experience in version control tools like Git. Worked on Amazon’s Analytics services like Amazon EMR, Amazon Athena, AWS Glue. Worked on Amazon’s Compute services like Amazon Lambda, Amazon EC2 and Amazon’s Storage service like S3 and few other s...

Key Responsibilities: • Development and deployment of advanced data science solutions to enhance the battery swapping ecosystem. • Design, build, and maintain machine learning pipelines, with a focus on time series forecasting, anomaly detection, and real-time predictive analytics. • Take end-to-end ownership of projects, from problem definition and data acquisition to model deployment and performance monitoring. • Collaborate cross-functionally with engineering, product, and business teams to align data solutions with organizational goals. • Communicate insights and recommendations effectively to both technical and non-technical stakeholders. Required Skills & Qualifications: • Minimum 4 ye...

7 - 9 Years 2 Openings Kolkata, Pune Role description Role Proficiency: Independently provides expertise on data analysis techniques using software tools; streamlining business processes and managing team Outcomes: Managing and designing the reporting environment including data sources security and metadata. Providing technical expertise on data storage structures data mining and data cleansing. Supporting the data warehouse in identifying and revising reporting requirements. Supporting initiatives for data integrity and normalization. Assessing tests and implementing new or upgraded software and assisting with strategic decisions on new systems. Synthesize both quantitative and qualitative ...

Skills : Data Engineer, DataBricks/Kafka/Snowflake, Datalake, SSIS,Talend, T-SQL Experience: Total Experience: 7 to 10 years, Relevant Experience: 1-2 projects if candidates have done it is sufficient, In Kafka is mandatory Snowflake and in Kafka, more than 2 years will work Specific Domain / Industry :Healthcare Experience is required . Notice Period: 0-30 days Education BE, ME, BTECH, MTECH, MCA Location - Bengaluru,Chennai,Hyderabad,Pune

As a Lead Data Engineer , you will lead, design, implement, and maintain data processing pipelines and workflows using Databricks on the Azure platform. Your expertise in PySpark, SQL, Databricks, test-driven development, and Docker will be essential to the success of our data engineering initiatives. Roles and responsibilities: Collaborate with cross-functional teams to understand data requirements and design scalable and efficient data processing solutions. Develop and maintain data pipelines using PySpark and SQL on the Databricks platform. Optimise and tune data processing jobs for performance and reliability. Implement automated testing and monitoring processes to ensure data quality an...

Skills Mandatory - Azure Fabric, Databricks, Data Modelling Skills - Primary - PySpark, Databricks, SQL, Python Skills - Good to have - Azure Data Factory,CICD, Azure Devops, Airflow Qualification - Bachelors Degree Total Experience 3-8 years Relevant Experience 3 years Work Location Cochin/TVM /Remote Job Purpose Own the end-to-end data lifecycle by collaborating with cross-functional teams in an Agile, sprint-based environment to achieve business goals. Job Description / Duties & Responsibilities Data Lifecycle Ownership: • Design, build, and maintain scalable data pipelines to ingest raw data into our data lake (bronze layer). • Develop and implement robust data models, transforming and e...

Data Engineer 3-5 yrs Bangalore Pyspark AWS DBT Kafka CI/CD Snowflake

Data Engineer (3-4 yrs) needed with strong PySpark, AWS, Airflow & Kafka skills. Build & maintain scalable data pipelines. Immediate to 30 days notice period. Max CTC 15 LPA. Join us to drive data solutions & analytics.

Hi, 𝐆𝐫𝐞𝐚𝐭 𝐎𝐩𝐩𝐨𝐫𝐭𝐮𝐧𝐢𝐭𝐲 𝐟𝐨𝐫 𝐃𝐚𝐭𝐚 𝐒𝐜𝐢𝐞𝐧𝐜𝐞 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐬❗ We’re hiring a Data Scientist at Abbacus Technologies. Key Responsibilities: • Decode legacy data flows and design modern ELT patterns. • Develop scalable data models using Domain-Driven Design. • Build efficient ELT pipelines with Snowflake & Matillion. • Ensure high data quality and governance standards. • Lead technical best practices in SQL, Python/PySpark, and CI/CD. Requirements : • Strong experience in data modeling (Star/Snowflake, DDD, Data Vault). • Expertise in SQL and cloud warehouses (Snowflake, Redshift, BigQuery). • Proficiency in Python (PySpark is a plus). • Background in complex industries like telecom or healthcare is desir...

Role: Data Architect Location: Delhi Mode: Hybrid Type: Contract Job Description: We are looking for an experienced Data Architect with strong expertise in data modeling , Azure data services , and data pipeline development . The ideal candidate will have hands-on experience with ADF , Databricks , and PySpark (mandatory), and be proficient in SQL . Strong stakeholder management skills are essential for collaborating with cross-functional teams and translating business needs into scalable data solutions. Key Skills Required: Proven experience as a Data Architect Strong data modeling skills (conceptual, logical, physical) Hands-on with Azure Tech Stack (e.g., Azure Data Factory, Azure Databri...

Join us as a Quality Automation Specialist, Selenium In this key role, youll be undertaking and enabling automated testing activities in all delivery models Well look to you to support teams to develop quality solutions and enable continuous integration and assurance of defect free deployment of customer value Youll be working closely with feature teams and a variety of stakeholders, giving you great exposure to professional development opportunities We're offering this role at associate vice president level What you'll do Joining us in a highly collaborative role, youll be contributing to the transformation of testing using quality processes, tools, and methodologies, significantly improvin...

Design, develop, and maintain scalable data pipelines using Python and modern data engineering tools. Understanding of banking data models, financial reporting, and regulatory compliance . Integrate data from legacy banking platforms into modern data lakes and warehouses. Collaborate with business analysts, architects, and operations teams to understand core banking workflows and data requirements. Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Databricks, Synapse (Azure SQL DW), and Azure Data Lake. Perform data analysis and transformation using PySpark on Azure Databricks or Apache Spark. Design and implement data models optimized for storage and...

- Proficient in designing and implementing predictive analytics techniques like Regression, Classification, Time Series Forecasting, Clustering, etc. - Hands-on experience in developing machine learning models such as Linear & Logistic Regression, Decision Tree, Random Forest, XGBoost, KNN, SVM, Neural Networks, Deep Learning, LSTM, and Clustering algorithms like K-means or Agglomerative Clustering, etc. - Good hands-on experience in analytical tools/languages such as Python, Pyspark, Excel. Contact- 9987334349

Dear candidate!!!!!. We have an exciting Opportunity. Company Name: TOP MNC Job Posting:Data Engineer Only Female Candidates only Profile Matched Candidates Acknowledge to mail Mandatory skill: Pyspark ,Advanced SQL , DWH experience , ( Synapse or Redshift or Databricks ) ( Oracle or SQL Server ) Location: Bangalore Experience Level: 9 to 13 Employment Type: Full Time

Job Title: Data Engineer Location: PAN India Exp range: 6-8 years CONTRACT 2 HIRE Shift: 2pm - 11pm Skill Required: Digital : Apache Spark~Digital : Python for Data Science~Digital : PySpark~MySQL Role required for Data Engineer with Data science " Job Description: Must have: Candidate must have expertise/experience with below tasks - Candidate must have experience on Linux, git, CICD, Release management, production deployment and support. - Strong Knowledge on Apache Spark is MUST - Strong Knowledge of PySpark is MUST - Strong Knowledge on SQL is MUST - Good Knowledge of Data Science workload - Good Knowledge on Kubernetes/Docker - Good Knowledge of Python is MUST - Good Knowledge of Java l...