AI/ML & Data Engineer

As an experienced Machine Learning/Natural Language Processing professional with 4-6 years of experience, preferably in document-heavy domains such as finance, legal, or policy, you will have the following key responsibilities: - Data Ingestion and Preprocessing: - Build and maintain data pipelines to ingest unstructured data from PDFs, gazettes, HTML circulars, etc. - Process data extraction, parsing, and normalization. - NLP & LLM Modeling: - Fine-tune or prompt-tune Large Language Models (LLMs) for summarization, classification, and change detection in regulations. - Develop embeddings for semantic similarity. - Knowledge Graph Engineering: - Design entity relationships (regulation, control, policy) and implement retrieval over Neo4j or similar graph DBs. - Information Retrieval (RAG): - Build RAG pipelines for natural language querying of regulations. - Annotation and Validation: - Annotate training data by collaborating with Subject Matter Experts (SMEs) and validate model outputs. - MLOps: - Build Continuous Integration/Continuous Deployment (CI/CD) for model retraining, versioning, and evaluation (precision, recall, BLEU, etc.). - API and Integration: - Expose ML models as REST APIs (FastAPI) for integration with product frontend. In addition to the responsibilities listed above, you should possess the following skills: - Languages: Python, SQL - AI/ML/NLP: Hugging Face Transformers, OpenAI API, Spacy, Scikit-Learn, LangChain, RAG, LLM prompt-tuning, LLM fine-tuning - Vector Search: Pinecone, Weaviate, FAISS - Data Engineering: Airflow, Kafka, OCR (Tesseract, pdfminer) - MLOps: MLflow, Docker If you are interested in working with cutting-edge technologies and contributing to a dynamic team, apply now for this exciting opportunity in Chennai.,