Job Summary: We are seeking a skilled and detail-oriented Big Data Engineer with strong expertise in Apache Spark to join our data team. Key Responsibilities: Design and develop scalable data processing solutions using Apache Spark (Core, SQL, Streaming, MLlib). Build and optimize data pipelines and ETL processes for structured and unstructured data. Collaborate with data scientists, analysts, and software engineers to integrate Spark-based data products. Ensure data quality, integrity, and security across the data lifecycle. Monitor, troubleshoot, and improve performance of Spark jobs in production. Integrate Spark with cloud platforms such as AWS, Azure, or GCP. Required Skills and Qualifications: 3+ years of hands-on experience with Apache Spark in large-scale data environments. Strong proficiency in Scala, Python , or Java (with a preference for Scala). Experience with data storage technologies such as HDFS, Hive, HBase, S3 , etc. Familiarity with SQL , Kafka , Airflow , and NoSQL databases . Experience with containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus. Solid understanding of distributed systems and parallel computing.
Location: Bangalore, Chennai, Pune, Hyderabad and Vadodara EXP : 4-7 YRS Key Responsibilities: Develop and deploy Generative AI solutions for clinical, Utilization Management, Care Management Build Agentic AI systems that autonomously execute multi-step tasks across healthcare operations (e.g., Prior Auth, eligibility checks ). Collaborate with cross-functional teams to integrate AI solutions into existing healthcare platforms and workflows. Design and implement APIs, microservices, and cloud-native components to support AI agents. Optimize performance, scalability, and reliability of AI-driven applications. Ensure compliance with healthcare regulations (HIPAA, HITECH) and data privacy standards. Stay current with advancements in LLMs, agent frameworks (LangChain, AutoGen, Copilot Studio), and healthcare tech. Required Skills & Qualifications: 4-10+ years of software development experience, with strong proficiency in Python, .NET, or Java. Hands-on experience with LLMs, transformers, and prompt engineering. Experience with agentic frameworks (e.g., LangChain, AutoGPT, Microsoft Copilot Studio). Strong understanding of REST APIs, microservices architecture, and cloud platforms (Azure, AWS, GCP). Familiarity with healthcare data formats and standards: FHIR, HL7, EDI, ICD/CPT codes. Experience integrating with healthcare systems (e.g., Guiding Care) Strong problem-solving skills and ability to work in agile environments.