Home
Jobs
Companies
Resume
Rarr Technologies logo

Python Data Engineer

3 - 4 years

5 - 6 Lacs

Bengaluru

Posted:1 week ago| Platform: Naukri logo

Apply

Skills Required

Data analysis github Multithreading GIT Linux Data processing JSON Object oriented programming SQL Python

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are seeking a skilled Python Data Engineer (some overlap with Developer skills) to join our dynamic team. In this role, you will be responsible for developing and maintaining preprocessing scripts for streaming data from video OTT platform. You will work closely with our data engineering team to ensure seamless data integration and processing. You will also be responsible for optimizing SQL querying for optimized performance. Key Responsibilities: - Develop and maintain preprocessing scripts to handle streaming data from a video OTT platform. - Retrieve data from data lakes or data warehouses, process it according to business needs, and load it back into the data warehouse. - Utilize GitHub or similar repositories to manage code versions and collaborate with team members. - Access servers directly to test and debug scripts, ensuring optimal performance. - Analyse data within data warehouses using SQL to identify anomalies and prepare data for processing. - Optimize SQL queries for faster execution with optimized memory consumption. - Implement and manage Redis queues or sets to control the flow of data processing tasks. Required Knowledge and Skills: - Proficiency in Python, with a strong understanding of object-oriented programming and familiar with packages such as Pandas, NumPy, OS, SYS, datetime, JSON, and traceback. - Expertise in exception handling, logging, file handling, and multiprocessing/multithreading. - Strong knowledge of SQL for data analysis and processing. - Strong knowledge of Spark with hands-on PySpark experience. - Experience with Redis, Git and Linux commands. Python

More Jobs at Rarr Technologies

JAVA Backend Developer

Gurgaon

5 - 9 yrs
|

INR 6 - 10 Lacs

Dotnet Developer

Ranchi

3 - 6 yrs
|

INR 4 - 8 Lacs

Technical Business Analyst

Gurgaon

5 - 10 yrs
|

INR 6 - 10 Lacs

Operation Executive

Gandhidham

3 - 5 yrs
|

INR 2 - 6 Lacs

HADOOP ADMIN

Bengaluru

6 - 10 yrs
|

INR 5 - 9 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Data Analysis Interview Now
Rarr Technologies
Rarr Technologies
www.rarr-technologies.com

Information Technology

San Francisco

50-100 Employees

839 Jobs

    Key People

  • Jane Doe

    CEO

  • John Smith

    CTO

RecommendedJobs for You

Zentek Infosoft logo

Python Data Engineer

Zentek Infosoft

Pune, Mumbai (All Areas)

WIN Home Inspection logo

Python Data Engineer

WIN Home Inspection

Greater Delhi Area

Citiustech Healthcare Technology Private Limited logo

Python Data Engineer

Citiustech Healthcare Technology Private Limited

Bengaluru / Bangalore, Karnataka, India

GAVS Technologies logo

Python Data Engineer

GAVS Technologies

Pune

Rarr Technologies logo

Python Data Engineer

Rarr Technologies

Bengaluru

CIEL HR logo

Python Data Engineer

CIEL HR

Bengaluru

Riskspan logo

Python Data Engineer

Riskspan

Mumbai

Needo'need Recruitment Consultancy logo

Python Data Engineer

Needo'need Recruitment Consultancy

Pune

Talworx Solutions logo

Python Data Engineer

Talworx Solutions

Bengaluru

Talworx Solutions logo

Python Data Engineer

Talworx Solutions

Hyderabad, Bengaluru