Data Engineer

Scoutit

2 years

21 - 24 Lacs

mumbai metropolitan region

Posted:1 month ago| Platform:

Apply

Skills Required

data analyze security pipeline scalability reliability linux tooling aws json sql excel encoding python scripting

Work Mode

On-site

Job Type

Full Time

Job Description

We are looking for

Data Engineers

Salary

: INR 21,00,000 - 24,00,000 / year

Responsibilities

Analyze, parse and clean large datasets of structured and unstructured data
Collaborate closely with security analysts and lead developers to understand bottlenecks and to prioritize, correct and ingest cleaned data
Develop data ingestion frameworks to handle high-volume and high-variety data, including structured and unstructured data recovered from +2000 data sources across the deep, dark and open web
Implement data quality control measures to detect and handle data anomalies, duplicates, and inconsistencies
Work towards optimizing data pipeline performance for scalability, reliability, and latency
Troubleshoot data pipeline issues and data quality problems

Eligibility

2 years of relevant work experience
Strong command of Linux CLI tooling and AWS CLI
Deep understanding of common data formats such csv, json, sql, excel files
Deep understanding of file encoding and related issues
Strong Python scripting skills to develop tooling
Strong problem-solving skills, with the ability to troubleshoot complex data pipeline issues

(*Note: This is a requirement for one of Scout's clients)
Skills: datasets,aws,unstructured data

More Jobs at Scoutit

Graduate Engineer Trainee (GET)

pune, maharashtra, india

Experience: Not specified

INR 7 - 10 Lacs

Associate Software Developer

noida, uttar pradesh, india

Experience: Not specified

INR 6 - 10 Lacs

Graduate Engineer Trainee (GET)

bengaluru, karnataka, india

Experience: Not specified

INR 7 - 10 Lacs

Junior Software Engineer

india

Experience: Not specified

INR 4 - 7 Lacs

Data Analyst Associate

india

Experience: Not specified

INR 6 - 8 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.