Home
Jobs

Back-End Developer – AI-Driven Data Quality Assessment

5 years

0 Lacs

Hyderabad Telangana India

Posted:2 weeks ago| Platform: Linkedin logo

Apply

Skills Required

developer ai data assessment pipeline profiling checks openai azure processing security compliance scalability development api integration python pyspark sql postgresql server analysis authentication oauth docker apache airflow workflow orchestration aws gcp retrieval tuning engineering metrics efficiency coordination

Work Mode

On-site

Job Type

Full Time

Job Description

Key Responsibilities Develop a backend pipeline to ingest, profile, and assess client asset data files. Implement data profiling and data quality checks using appropriate libraries and frameworks. Integrate LLM-based assessments by calling APIs (e.g., OpenAI, Azure AI). Optimize processing for large datasets with efficient workflows. Collaborate with front-end developers, data quality teams, and business stakeholders. Ensure security and compliance in handling client data. Maintain scalability and performance in cloud or on-prem infrastructure. Required Skills & Experience 5+ years of experience in backend development , focusing on data processing and API integration. Strong Python skills, with experience in Pandas, PySpark, or similar libraries for handling large datasets. Proficiency in SQL and experience with PostgreSQL, Snowflake, or MS SQL Server. Experience integrating with LLM APIs (e.g., OpenAI, Azure AI) for text-based analysis. Hands-on experience with RESTful APIs and authentication methods (OAuth, API keys). Strong understanding of data quality and profiling techniques. Knowledge of Docker and containerized deployments. Nice-to-Have Skills Experience with Apache Airflow for workflow orchestration. Exposure to cloud platforms (AWS, Azure, GCP) for scalable backend development. Experience with vector databases and embedding-based retrieval (e.g., Pinecone, Weaviate). Familiarity with LLM fine-tuning or prompt engineering. Success Metrics Successful implementation of the automated data profiling and LLM-based assessment pipeline. Scalability and efficiency in processing large client data files. Accurate and meaningful AI-driven assessments delivered via API calls. On-time delivery of backend features in coordination with the front-end team. Show more Show less

More Jobs at algoleap

Data Engineer

Hyderabad, Telangana, India

Experience: Not specified

|

Salary: Not disclosed

Full Stack Developer

Hyderabad, Telangana, India

Experience: Not specified

|

Salary: Not disclosed

Fullstack Developer

Hyderabad, Telangana, India

Experience: Not specified

|

Salary: Not disclosed

Data Scientist (Analytics)

Bangalore North Rural, Karnataka, India

Experience: Not specified

|

Salary: Not disclosed

Storage L1

Bengaluru, Karnataka, India

1 - 3 yrs
|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Developer Interview Now

My Connections algoleap

Download Chrome Extension (See your connection in the algoleap )

chrome image
Download Now
algoleap

54 Jobs

RecommendedJobs for You

algoleap logo

Back-End Developer – AI-Driven Data Quality Assessment

algoleap

Hyderabad, Telangana, India

algoleap logo

Back-End Developer – AI-Driven Data Quality Assessment

algoleap

Hyderabad, Telangana, India