3 - 7 years

0 Lacs

Posted:1 day ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As a Backend Engineer specializing in Data Collection & Processing, your role is crucial in building robust, scalable systems for data acquisition, transformation, and analysis. You will directly contribute to detecting fraud and enabling secure transactions by performing the following key responsibilities: - Design and implement scalable data ingestion pipelines for collecting structured and unstructured data from browsers, APIs, and external sources. - Develop robust ETL/ELT pipelines to clean, transform, and normalize large datasets. - Build and maintain secure, high-performance RESTful and event-driven APIs. - Integrate with third-party data sources including public APIs, internal systems, and dark web monitoring services. - Ensure high availability, fault tolerance, and real-time performance across services. - Collaborate closely with data scientists, threat analysts, and frontend engineers to support end-to-end data workflows. - Implement security, authentication, and authorization best practices across backend systems. - Write clean, maintainable, and well-tested code. Qualifications required for this role include: - Bachelors or Masters degree in Computer Science, Engineering, or related field. - 3+ years of backend development experience with languages such as Python, Node.js, Go, or Java. - Strong understanding of REST APIs, microservices architecture, and event-driven systems. - Experience with data pipeline technologies: Apache Kafka, Redis Streams, RabbitMQ, Airflow, or similar. - Proficiency in working with databases like PostgreSQL, MongoDB, Elasticsearch, or ClickHouse. - Familiarity with containerized environments (Docker, Kubernetes). - Exposure to data privacy and security best practices. - Experience with cloud platforms (AWS, GCP, or Azure). Additionally, it would be nice to have: - Experience integrating with OSINT or threat intelligence APIs. - Exposure to web scraping, crawling, or browser-based data capture. - Background in real-time analytics or fraud detection systems. - Familiarity with GraphQL or gRPC. This role offers you the opportunity to work on cutting-edge technologies and make a significant impact on data processing and security systems. As a Backend Engineer specializing in Data Collection & Processing, your role is crucial in building robust, scalable systems for data acquisition, transformation, and analysis. You will directly contribute to detecting fraud and enabling secure transactions by performing the following key responsibilities: - Design and implement scalable data ingestion pipelines for collecting structured and unstructured data from browsers, APIs, and external sources. - Develop robust ETL/ELT pipelines to clean, transform, and normalize large datasets. - Build and maintain secure, high-performance RESTful and event-driven APIs. - Integrate with third-party data sources including public APIs, internal systems, and dark web monitoring services. - Ensure high availability, fault tolerance, and real-time performance across services. - Collaborate closely with data scientists, threat analysts, and frontend engineers to support end-to-end data workflows. - Implement security, authentication, and authorization best practices across backend systems. - Write clean, maintainable, and well-tested code. Qualifications required for this role include: - Bachelors or Masters degree in Computer Science, Engineering, or related field. - 3+ years of backend development experience with languages such as Python, Node.js, Go, or Java. - Strong understanding of REST APIs, microservices architecture, and event-driven systems. - Experience with data pipeline technologies: Apache Kafka, Redis Streams, RabbitMQ, Airflow, or similar. - Proficiency in working with databases like PostgreSQL, MongoDB, Elasticsearch, or ClickHouse. - Familiarity with containerized environments (Docker, Kubernetes). - Exposure to data privacy and security best practices. - Experience with cloud platforms (AWS, GCP, or Azure). Additionally, it would be nice to have: - Experience integrating with OSINT or threat intelligence APIs. - Exposure to web scraping, crawling, or browser-based data capture. - Background in real-time analytics or fraud detection systems. - Familiarity with GraphQL or gRPC. This role offers you the opportunity to work on cutting-edge technologies and make a significant impact on data processing and security systems.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

chennai, tamil nadu, india

chennai, tamil nadu, india

hyderabad, telangana, india

gurugram, haryana, india

coimbatore, tamil nadu, india