Home
Jobs
Prodian logo

Data Engineer (Python)

2 - 4 years

12 - 13 Lacs

Chennai

Posted:3 months ago| Platform: Naukri logo

Apply

Skills Required

Automation orchestration Data modeling Data processing Distribution system Analytics Python HBase

Work Mode

Work from Office

Job Type

Full Time

Job Description

Design, develop, and maintain large-scale distributed data processing systems using Hadoop, HDFS, MapReduce, and Spark. Build scalable data pipelines for batch and real-time processing using PySpark and Spark Streaming. Work with HBase to manage structured and semi-structured data storage, ensuring efficient querying and data integrity. Optimize and troubleshoot performance issues in distributed systems to ensurehigh availability and reliability. Write clean, maintainable, and efficient code using Python for data processing and automation tasks. Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver effective solutions. Implement best practices for data governance, security, and compliance. Monitor, troubleshoot, and improve ETL processes and workflows. Stay updated with emerging trends and technologies in big data and analytics. Desired Profile: Bachelors or Master s degree in Computer Science, Data Engineering, or a related field. 2+ years of hands-on experience with big data technologies like Hadoop, HDFS, HBase, and MapReduce. Strong programming skills in Python. Experience with designing and managing scalable, distributed data architectures. Hands-on experience with data integration, ETL development, and workflow orchestration tools. Solid understanding of database systems and data modeling Familiarity with cloud platforms (AWS, Azure, GCP) is a plus.

More Jobs at Prodian

Data Engineer (Python)

Chennai

2 - 4 yrs
|

INR 12 - 13 Lacs

PL/SQL Developer

Chennai

2.0 - 3.0 yrs
|

INR 2 - 6 Lacs

Exception Handling

Chennai

3.0 - 3.0 yrs
|

INR 2 - 6 Lacs

Accounts Executive

Chennai

3.0 - 5.0 yrs
|

INR 1 - 4 Lacs

PL/SQL Developer

Chennai

2.0 - 3.0 yrs
|

INR 2 - 6 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Automation Interview Now

My Connections Prodian

Download Chrome Extension (See your connection in the Prodian )

chrome image
Download Now
Prodian
Prodian
www.prodian.com

Real Estate

Tech City

200 Employees

6 Jobs

    Key People

  • Jane Doe

    CEO

  • John Smith

    CTO

RecommendedJobs for You

algoleap logo

Data Engineer (Python)

algoleap

Hyderabad, Telangana, India

Consulting Krew logo

Data Engineer (Python)

Consulting Krew

Bengaluru

Nucleusteq logo

Data Engineer (Python)

Nucleusteq

Hyderabad

Prodian logo

Data Engineer (Python)

Prodian

Chennai

Principal Engineer - Software Dev

Lennox India Technology Centre Litc

Chennai, Tamil Nadu, India

Specialist - Digital Technologies

Lennox India Technology Centre Litc

Chennai, Tamil Nadu, India

SAP PP QM Professional

Systechcorp Private Limited

Bengaluru / Bangalore, Karnataka, India

SAP PP QM Professional

Systechcorp Private Limited

Hyderabad / Secunderabad, Telangana, Telangana, India

SAP PP QM Professional

Systechcorp Private Limited

Delhi, Delhi, India

Java Developer

Vimerse Infotech

Noida, Uttar Pradesh, India