Pyspark Developer Cognizant Technology Solutions India Pvt Ltd

4.0 - 8.0 years

3 - 6 Lacs

hyderabad, telangana, india

On-site

Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data processing pipelines using PySpark. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop high-quality code in Python using Spark's APIs (e.g., Dataframe, Dataset) and Hive queries. Troubleshoot complex issues related to data processing, query performance, and system errors. Desired Candidate Profile 4-8 years of experience working with PySpark/Hive technologies.

Posted 1 week ago

Apply

Data Engineer Tekgence Inc

8.0 - 12.0 years

0 Lacs

maharashtra

On-site

As a Data Engineer, you will be responsible for building scalable data pipelines using PySpark. Your role will involve implementing complex business logic using Spark SQL, DataFrame, and RDD APIs. You should have strong programming skills in Python, with a solid understanding of data structures, algorithms, and software engineering principles. Your expertise in designing, developing, and maintaining batch and streaming data pipelines will be crucial. You should be familiar with ETL/ELT processes and best practices for data transformation, data quality, and performance optimization. Knowledge of the modern data engineering ecosystem, including distributed data processing, storage systems, and...

Posted 1 week ago

Apply

Python Developer TECHY GEEKS

9.0 - 13.0 years

0 Lacs

chennai, tamil nadu

On-site

You should have 9+ years of experience and be located in Chennai. You must possess in-depth knowledge of Python and have good experience in creating APIs using FastAPI. It is essential to have exposure to data libraries like Pandas, DataFrame, NumPy etc., as well as knowledge in Apache open-source components. Experience with Apache Spark, Lakehouse architecture, and Open table formats is required. You should also have knowledge in automated unit testing, preferably using PyTest, and exposure in distributed computing. Experience working in a Linux environment is necessary, and working knowledge in Kubernetes would be an added advantage. Basic exposure to ML and MLOps would also be advantageou...

Posted 1 month ago

Apply

Python Backend developer TECHY GEEKS

9.0 - 13.0 years

0 Lacs

chennai, tamil nadu

On-site

As an ideal candidate for this role, you should possess in-depth knowledge of Python and have good experience in creating APIs using FastAPI. You should also have exposure to data libraries like Pandas, DataFrame, NumPy, as well as knowledge in Apache open-source components and Apache Spark. Familiarity with Lakehouse architecture and Open table formats is also desirable. Additionally, you should be well-versed in automated unit testing, preferably using PyTest, and have exposure to distributed computing. Experience working in a Linux environment is a must, while working knowledge in Kubernetes would be considered an added advantage. Basic exposure to ML and MLOps would also be advantageous ...

Posted 1 month ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.