6547 Big Data Jobs - Page 31

Key Responsibilities: Build and maintain ML pipelines for training, validation, deployment, and monitoring Implement CI/CD for ML artifacts, including data versioning and model registries Monitor model performance and drift; trigger retraining workflows as needed Manage infrastructure (cloud, containerized, on-prem) for high-availability AI services Collaborate with data, ML, and ops teams to deliver frictionless MLOps lifecycle Required Skills: Strong knowledge of MLOps tools (MLflow, Kubeflow, SageMaker, Vertex AI) Proficiency in Python, Bash, Docker, and Kubernetes Familiarity with cloud infra (AWS/GCP/Azure) and IaC (Terraform, CloudFormation) Experience in model monitoring, logging, and...

3+ years experienced engineer who has worked on GCP environment and its relevant tools/services. (Big Query, Data Proc, Data flow, Cloud Storage, Terraform, Tekton , Cloudrun , Cloud scheduler, Astronomer/Airflow, Pub/sub, Kafka, Cloud Spanner streaming etc) 1 or 2 + years of strong experience in Python development (Object oriented/Functional Programming, Pandas, Pyspark etc) 1 or 2 + years of strong experience in SQL Language (CTEs, Window functions, Aggregate functions etc) Keywords :dataproc,pyspark,data flow,kafka,cloud storage,terraform,oops,cloud spanner,hadoop,java,hive,spark,mapreduce,big data,gcp,aws,javascript,mysql,postgresql,sql server,oracle,bigtable,software development,sql*,py...

Job Application Link: https://app.fabrichq.ai/jobs/e1003d62-f76d-4ee1-b787-da40ce6f717f Job Summary: You will act as a key member of the Data consulting team, working directly with partners and senior stakeholders. You will design and implement big data and analytics solutions. Communication and organisational skills are key for this position. Key Responsibilities Develop data solutions within a Big Data Azure and/or other cloud environments Working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams Build and design Data Architectures using Azure Data factory, Databricks, Data lake, Synapse Liaising with CTO, Product Owners and other Operations t...

INTRODUCTION TO EVERNORTH: Evernorth Health Services India, established in Hyderabad in 2024, is an innovation hub for Evernorth Health Services, the pharmacy, care and benefits division of The Cigna Group. The innovation hub will support innovation-focused areas, such as generative AI, product development, process improvement, analytics, and software engineering across The Cigna Group and its businesses. Evernorth Health Services India builds on The Cigna Group s existing presence in India. About Evernorth Health Services: Evernorth Health Services (Evernorth) is the pharmacy, care and benefits solution division of The Cigna Group - a Fortune 16 global health company with 75,000 employees, ...

INTRODUCTION TO EVERNORTH: Evernorth Health Services India, established in Hyderabad in 2024, is an innovation hub for Evernorth Health Services, the pharmacy, care and benefits division of The Cigna Group. The innovation hub will support innovation-focused areas, such as generative AI, product development, process improvement, analytics, and software engineering across The Cigna Group and its businesses. Evernorth Health Services India builds on The Cigna Group s existing presence in India. About Evernorth Health Services: Evernorth Health Services (Evernorth) is the pharmacy, care and benefits solution division of The Cigna Group - a Fortune 16 global health company with 75, 000 employees,...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

NTT DATA Services currently seeks Python Hadoop Developer to join our team in Responsibilities Skillset: Python, Hadoop, ETL, RDBMS, Unix, GCP Vertex AI Responsibilities: Data Ingestion Pipelines, AIML Model deployments, Data Engineering, ML Engineering with Python.

Role Overview: As the Client Remediation Issue Management Lead, you will be responsible for managing a professional team to integrate subject matter and industry expertise within a defined area. Your role will involve contributing to standards, coordinating objectives, and ensuring volume, quality, timeliness, and delivery of end results. Your communication and diplomacy skills will be crucial in guiding and influencing colleagues and regulators. You will also have indirect responsibility for identifying and validating client population analytics for remediation issues. Key Responsibilities: - Manage and drive the client remediation process in alignment with procedures and policies. - Ensure...

As a Data Analytics Sr Lead Analyst at our company, you will be a strategic professional who closely follows the latest trends in the Data Science/Data Mining/Big Data field and adapts them for application within your role and the business. Your excellent communication skills will be crucial for negotiating internally, often at a senior level, and leveraging diplomacy to guide, influence, and convince internal and external stakeholders. You will serve as the subject matter expert for strategic data analysis, identifying insights and implications, making strategic recommendations, and developing data displays that clearly communicate complex analysis. Additionally, you will apply ingenuity an...

Role Overview: As a member of the Energy & Environment Advisory team, you will help organizations navigate through the challenges of energy transition and sustainability goals. Your role will involve utilizing domain expertise in Power & Energy, Environment & Water, Homes & Buildings, and Oil & Gas to deliver actionable plans and concepts for growth in existing and new markets. Key Responsibilities: - Manage a module of work or a small project with a 1-2 member team, heading client teams and structuring analyses to address critical client questions - Act as a role model internally, develop expert status with middle management level client staff, and start taking on business development tasks...

As a Data Science Decision Analyst Assistant Vice President at Barclays, you will embark on a transformative journey to shape the future by providing guidance on coding efficiency and working with Big Data. Your role will involve safeguarding the business and customers from financial risks while also offering competitive benefits and opportunities for career advancement in the banking industry. **Key Responsibilities:** - Ability to work dedicated shifts between 12 Noon IST to 12 AM IST. - Minimum 6 years of experience in Data Science Domain focusing on Analytics and Reporting. - Mandatory proficiency in writing, studying, and correcting Python and SQL code. - Working with Big Data and artic...

Role Overview: As a Senior Specialist Automation Engineer, you will play a crucial role in overseeing the integration of shop floor equipment with IT and OT systems across various domains. Your main responsibility will be to ensure the efficient flow of data from the shop floor to the enterprise level. Working alongside a team of experts, you will be responsible for coordinating and implementing the necessary middleware setup to facilitate data transfer. This will involve defining data points based on specific business requirements and industry best practices. In addition, you will oversee the configuration of end-to-end interfaces and conduct thorough interface qualification processes. Your...

As a Senior Backend and Infra Engineer, you will be responsible for designing and delivering secure, distributed, scalable, and fault-tolerant services, end-user applications, and APIs. You will work on cloud-hosted (AWS) SaaS systems, focusing on automation and agile engineering practices. Your role will involve working on complex, event-driven services and ensuring code quality, scalability, latency, and platform stability. **Responsibilities:** - Work with architects and stakeholders to refine requirements, propose technical solutions, and provide estimates. - Implement solutions with a focus on efficiency and quality. - Take ownership of implemented solutions, supporting them from proof ...

Role Overview: At Goldman Sachs, the Digitization & Workflow Engineering team is seeking a Market Data Vendor Manager in Bengaluru. This role involves managing vendor relationships, negotiating data licensing terms, and ensuring compliance with firm policies and standards. You will collaborate with various internal stakeholders to understand client requirements, support strategic projects, and drive industry change in digital rights. As the primary representative for the firm, you will be responsible for maintaining the firm's reputation with suppliers and overseeing vendor relationships. Key Responsibilities: - Manage over 400 vendor relationships and negotiate data licensing and commercial...

Position Overview We are seeking a highly skilled and motivated Big Data Engineer to join our dynamic team in either Mumbai City or Bangalore . As a Big Data Engineer, you will play a crucial role in designing, developing, and maintaining scalable data processing systems that enable our organization to harness the power of big data. With an annual salary of 26,00,000 , this full-time position offers an exciting opportunity to work with cutting-edge technologies in a collaborative environment. Key Responsibilities Design and implement robust big data solutions using technologies such as Hadoop, Spark, and Apache Spark. Develop and maintain data pipelines to ensure efficient data processing an...

Develop and maintain Python scripts to support the deployment and integration of GenAI models. Automate data ingestion, preprocessing, and model execution workflows using Python and other relevant tools. Build interfaces between GenAI models and existing systems or APIs. Monitor and optimize performance of deployed models and pipelines. Ensure robust logging, error handling, and system reliability. Stay updated with advancements in GenAI technologies and suggest improvements. Experience in Agile Development Process. Excellent communication skills, problem solving and debugging and troubleshooting Skills. Mandatory Competencies Data Science and Machine Learning - Data Science and Machine Lear...

Design and implement scalable data processing solutions usingApache SparkandJava. Develop and maintain high-performance backend services and APIs. Collaborate with data scientists, analysts, and other engineers to understand data requirements. Optimize Spark jobs for performance and cost-efficiency. Ensure code quality through unit testing, integration testing, and code reviews. Work with large-scale datasets in distributed environments (e.g., Hadoop, AWS EMR, Databricks). Monitor and troubleshoot production systems and pipelines. Experience in Agile Development Process. Excellent communication skills, problem solving and debugging and troubleshooting Skills. Mandatory Competencies Architect...

Professional Experience / Qualifications 8 - 10 years prior experience in Java, spring boot, SQL, REST APIS. Must be hands on! Hands on experience on Java 11+. Atleast 2-3 years of experience/exposure on Spark SQL, Containerization like Docker Nice to have Databricks on AWS, Glue, EMR. S3 Excellent Analytical skills and quick to turn around on issues Must be aware of design principles, patterns in software. Great interpersonal and communication skills Financial services domain is preferred and any knowledge to Market risk technology will be a great advantage. Education Qualification : B.Tech or MCA Mandatory Competencies Programming Language - Java - Core Java (java 8+) Middleware - Java Mid...

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL

AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow

Python 4/5 years of experience Kubernetes/Docker Containerization API development Relational and NoSQL DB Version control GitHub Airflow Python libraries Pandas, flask, FastAPI Mandatory Competencies Programming Language - Python - Panda Big Data - Big Data - Mongo DB DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - Containerization (Docker, Kubernetes) Beh - Communication and collaboration Database - No SQL - Elastic, Solr, Lucene etc

About the Team When 5% of Indian households shop with us, its important to build resilient systems to manage millions of orders every day. Weve done this with zero downtime! ?? Sounds impossible? Well, thats the kind of Engineering muscle that has helped Meesho become the e-commerce giant that it is today. We value speed over perfection and see failures as opportunities to become better. Weve taken steps to inculcate a strong Founders Mindset across our engineering teams, making us grow and move fast. We place special emphasis on the continuous growth of each team member - and we do this with regular 1-1s and open communication. As a Database Engineer II, you will be part of self-starters wh...

About the Team Our Data Science team is the Avengers to Meeshos S.H.I.E.L.D ???. And why not? We are the ones who assemble during the toughest challenges and devise creative solutions, building intelligent systems for millions of our users looking at a thousand different categories of products. Weve barely scratched the surface, and have amazing challenges in charting the future of commerce for Bharat. Our typical day involves dealing with fraud detection, inventory optimisation, and platform vernacularisation. As Data Scientist, you will navigate uncharted territories with us, discovering new paths to creating solutions for our users.?? You will be at the forefront of interesting challenges...

About the Team Our Data Science team is the Avengers to Meeshos S.H.I.E.L.D ???. And why not? We are the ones who assemble during the toughest challenges and devise creative solutions, building intelligent systems for millions of our users looking at a thousand different categories of products. Weve barely scratched the surface, and have amazing challenges in charting the future of commerce for Bharat. Our typical day involves dealing with fraud detection, inventory optimisation, and platform vernacularisation. As Lead Data Scientist, you will navigate uncharted territories with us, discovering new paths to creating solutions for our users.?? You will be at the forefront of interesting chall...

We have developed API gateway aggregators using frameworks like Hystrix and spring-cloud-gateway for circuit breaking and parallel processing. Our serving microservices handle more than 15K RPS on normal days and during saledays this can go to 30K RPS. Being a consumer app, these systems have SLAs of ~10ms Our distributed scheduler tracks more than 50 million shipments periodically fromdifferent partners and does async processing involving RDBMS. We use an in-house video streaming platform to support a wide variety of devices and networks. What Youll Do Design and implement scalable and fault-tolerant data pipelines (batch and streaming) using frameworks like Apache Spark , Flink , and Kafka...