6.0 - 10.0 years

16 - 30 Lacs

pune, chennai

Hybrid

Key Responsibilities: Data Pipeline Development: Design, build, and maintain robust, scalable, and efficient ETL/ELT data pipelines using Scala and Apache Spark for large-scale batch and real-time data processing. Real-time Streaming: Develop and manage high-throughput, low-latency data ingestion and streaming applications using Apache Kafka (producers, consumers, Kafka Streams, or ksqlDB where applicable). Spark Expertise: Apply in-depth knowledge of Spark internals, Spark SQL, DataFrames API, and RDDs. Optimize Spark jobs for performance, efficiency, and resource utilization through meticulous tuning (e.g., partitioning, caching, shuffle optimizations). Data Modeling & SQL: Design and impl...

Posted Date not available

Apply

Machine Learning Engineer - Python/LLM Vayuz Technologies

8.0 - 10.0 years

3 - 7 Lacs

bengaluru

Work from Office

Must have : - Strong on programming languages like Python, Java - One cloud hands-on experience (GCP preferred) - Experience working with Dockers - Environments managing (e.g venv, pip, poetry, etc.) - Experience with orchestrators like Vertex AI pipelines, Airflow, etc. - Understanding of full ML Cycle end-to-end - Data engineering, Feature Engineering techniques - Experience with ML modelling and evaluation metrics - Experience with Tensorflow, Pytorch or another framework - Experience with Models monitoring - Advance SQL knowledge - Aware of Streaming concepts like Windowing , Late arrival , Triggers etc. Good to have : - Hyperparameter tuning experience. - Proficient in either Apache Spa...

Posted Date not available

Apply

Software Engineer - Big Data ZS

2.0 - 5.0 years

4 - 7 Lacs

pune

Work from Office

about our diversity, equity, and inclusion efforts and the networks ZS supports to assist our ZSers in cultivating community spaces, obtaining the resources they need to thrive, and sharing the messages they are passionate about. ZSs Platform Development team designs, implements, tests and supports ZSs ZAIDYN Platform which helps drive superior customer experiences and revenue outcomes through integrated products analytics. Whether writing distributed optimization algorithms or advanced mapping and visualization interfaces, you will have an opportunity to solve challenging problems, make an immediate impact and contribute to bring better health outcomes. What you'll do: As part of our full-s...

Posted Date not available

Apply

Big Data Architect Talent Corner Hr Services

10.0 - 15.0 years

15 - 25 Lacs

pune

Work from Office

Designing and implementing scalable and resilient data architectures for both batch and streaming data processing. Developing data models and database structures. Ensuring data security, integrity, and compliance with relevant regulations. Required Candidate profile Experience in Hadoop, Spark, NoSQL databases. Cloud exposure: AWS, Azure, GCP. Coding skills in Python, Java, Scala, and Spark frameworks. Hands-on with ETL tools and building data pipelines.

Posted Date not available

Apply

Consultant Specialist Careernet

6.0 - 8.0 years

15 - 18 Lacs

bengaluru

Work from Office

Key Skills: Apache Spark, Core Java, React, ReactJS, Spring Boot, Docker, Kafka, Big Data, GCP. Roles & Responsibilities: Drive full stack end-to-end solutions based on daily conversations with the team. Collaborate with team members and liaise with business stakeholders to ensure comprehensive understanding of business requirements. Solve challenges posed by large-scale, high-tech applications involving large data sets. Design, develop, and implement solutions that meet business needs according to established standards and best practices. Maintain operational stability, integrity, and availability of products and services. Utilize monitoring tools to manage applications and respond to techn...

Posted Date not available

Apply

Page 22 of 22

Previous 19 20 21 22

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.