Senior Backend Data & Integration Engineer BEO Software Private Limited

4.0 - 8.0 years

0 Lacs

kochi, kerala

On-site

As a Data Engineer, your primary objective will be to build data pipelines for crawling, parsing, deduplication, and embeddings while connecting external systems and interfaces. Your responsibilities will include: - Developing crawling and fetching pipelines with an API-first approach, utilizing playwright/requests as necessary. - Parsing and normalizing job postings & CVs, implementing deduplication/delta logic such as seen hash and repost heuristics. - Implementing embeddings and enabling similarity search, managing Azure OpenAI and vector persistence in pgvector. - Integrating with systems like HR4YOU (API/webhooks/CSV import), SerpAPI, BA job board, and email/SMTP. - Implementing batch/s...

Posted 1 month ago

AI Match Score

Apply

Backend Data & Integration Engineer BEO software

4.0 - 8.0 years

0 Lacs

kochi, kerala

On-site

As a Data Engineer at our company located in Kochi, you will be responsible for building data pipelines and connecting external systems and interfaces. Your role objective includes developing crawling/fetch pipelines, parsing/normalization of job postings & CVs, and embeddings/similarity search. Some key responsibilities include: - Development of crawling/fetch pipelines using an API-first approach; utilizing playwright/requests where permitted - Parsing/normalization of job postings & CVs, implementing deduplication/delta logic, and managing repost heuristics - Implementing embeddings/similarity search, controlling Azure OpenAI, and maintaining vector persistence in pgvector - Integrating w...

Posted 1 month ago

AI Match Score

Apply

Backend Data & Integration Engineer BEO Software Private Limited

4.0 - 8.0 years

0 Lacs

kochi, kerala

On-site

As a Data Engineer, your main objective will be to build data pipelines for crawling, parsing, and connecting external systems and interfaces. This includes developing crawling and fetching pipelines using an API-first approach and tools like playwright and requests. You will also be responsible for parsing and normalizing job postings and CVs, implementing deduplication and delta logic, and working on embeddings and similarity search. Additionally, you will be involved in integrating with various systems such as HR4YOU, SerpAPI, BA job board, and email/SMTP. Your role will also require you to work on batch and stream processing using Azure Functions or container jobs, implementing retry/bac...

Posted 1 month ago

AI Match Score

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.