Posted:1 day ago|
Platform:
Work from Office
Full Time
Role objective: Build data pipelines (crawling/parsing, deduplication/delta, embeddings) and connect external systems and interfaces.
Tasks Development of crawling/fetch pipelines (API-first; playwright/requests only where permitted) Parsing/normalization of job postings & CVs, deduplication/delta logic (seen hash, repost heuristics) Embeddings/similarity search (controlling Azure OpenAI, vector persistence in pgvector) Integrations: HR4YOU (API/webhooks/CSV import), SerpAPI, BA job board, email/SMTP Batch/stream processing (Azure Functions/container jobs), retry/backoff, dead-letter queues Telemetry for data quality (freshness, duplicate rate, coverage, cost per 1,000 items) Collaboration with FE for exports (CSV/Excel, presigned URLs) and admin configuration
Desired Candidate Profile
4+ years of backend/data engineering experience Python (FastAPI, pydantic, httpx/requests, Playwright/Selenium), solid TypeScript for smaller services/SDKs Azure: Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics Messaging: Service Bus/Queues, idempotence & exactly-once semantics, pragmatic approach Databases: PostgreSQL, pgvector, query design & performance tuning Clean ETL/ELT patterns, testability (pytest), observability (OpenTelemetry) Nice-to-haves NLP/IE experience (spaCy/regex/rapidfuzz), document parsing (pdfminer/textract) Experience with license/ToS-compliant data retrieval, captcha/anti-bot strategies (legally compliant) Working method: API-first, clean code, trunk-based development, mandatory code reviews Tools/stack: GitHub, GitHub Actions/Azure DevOps, Docker, pnpm/Turborepo (Monorepo), Jira/Linear, Notion/Confluence On-call/support: rotating, "you build it, you run it"
Drop Resume Here
Allowed file types : .doc, .docx, .pdf. Maximum 2 files
Year of Birth What is your current locationCan you relocate to KochiTotal years of experienceDoes your employer approve of notice period buyout optionBackend & Data Engineering
ETL/ELT Pipelines & Observability
Reference link 1
+ Add another link How did you come to know about BEO Softwares Pvt. Ltd.
BEO Software
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
kochi
6.0 - 10.0 Lacs P.A.
kochi
5.0 - 9.0 Lacs P.A.
kochi
6.0 - 10.0 Lacs P.A.
kochi
5.0 - 9.0 Lacs P.A.
9.0 - 14.0 Lacs P.A.
11.0 - 15.0 Lacs P.A.
13.0 - 18.0 Lacs P.A.
12.0 - 17.0 Lacs P.A.
1.0 - 4.0 Lacs P.A.
noida, chennai, gurugram
5.0 - 8.0 Lacs P.A.
