As a Data Engineer, you will play a pivotal role in supporting the development of key data engineering components for our Data Fabric and Exposure Management products.
In this exciting role, you'll work with open-source big data technologies to help us collect, transport, transform, and ingest massive amounts of data in a distributed architecture.

If you thrive in an environment that encourages continuous learning, embraces modern technology, and values the power of data, this is the perfect opportunity for you.

Key accountabilities

The ideal candidate would be a self-motivated individual with strong technology skills, commitment to quality and positive work ethic, who can

Design, develop, and deploy data management modules, including data ingestion, parsing, scheduling, and processing, using agile practices
Conduct unit, system, and integration testing of developed modules, ensuring high-quality data solutions Select and integrate Big Data tools and frameworks to meet capability requirements Collaborate with client and partner teams to deliver effective data solutions and resolve operational issues promptly Stay updated on industry trends and best practices in Data Engineering and Open-Source Big Data technologies Contribute to agile teamwork and follow a personal education plan for technology stack and solution architecture Build processes for data transformation, structures, metadata, and workload management

Skills and Experience

Relevant experience in data engineering with open-source big data tools (Hadoop, Spark, Kafka) and NoSQL databases (Postgres, MongoDB, Elastic) Skilled in data pipeline management (eg, Airflow), AWS services (EC2, EMR, RDS), and stream processing (eg, Spark-Streaming) Proficient in object-oriented and functional programming languages (Python, Java, Scala), and data lake concepts (ingestion, transformation). Strong understanding of Hadoop and Spark frameworks, Agile methodology, and scalable big data architectures

Excellent communication, with a self-motivated and analytical mindset for fast-paced environments
Experience working with cross-functional teams to optimize big data pipelines and solutions

Education

masters/bachelors in Computer Science Engineering.

More Jobs at Prevalent Ai India

Junior Systems Engineer

kochi

2.0 - 6.0 yrs

INR 6 - 9 Lacs

Security Architect

kochi

3.0 - 8.0 yrs

INR 5 - 10 Lacs

Data Engineer

kochi

3.0 - 6.0 yrs

INR 14 - 16 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Big Data Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Prevalent Ai India

Artificial Intelligence / Technology

Bangalore

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Data Engineer