121 Avro Jobs - Page 2

As a Data Engineer specializing in AWS Managed Streaming for Apache Kafka (MSK), your role will involve designing, building, and maintaining high-performance data pipelines. Working in collaboration with data architects and software engineers, your focus will be on ensuring seamless data integration and streaming capabilities using AWS MSK. Your key responsibilities will include: - Designing, developing, and managing real-time data pipelines utilizing AWS MSK - Integrating AWS MSK with various data sources and consumers - Monitoring and optimizing AWS MSK cluster performance and costs - Collaborating with DevOps to ensure optimal performance and uptime - Implementing security best practices ...

As a senior Applications Development Technology Lead Analyst at the company, your primary role is to establish and implement new or revised application systems and programs in coordination with the Technology team. Your objective will be to lead applications systems analysis and programming activities. **Key Responsibilities:** - Translate application storyboards and use cases into functional applications. - Design, build, and maintain efficient, reusable, and reliable Java code. - Ensure the best possible performance, quality, and responsiveness of the applications. - Identify bottlenecks and bugs, and devise solutions to these problems. - Develop high performance & low latency components t...

Design and develop portfolio test automation of end to end customer scenarios Design and build automation framework and tools Hands-on automation > 90% of the time Test and automate micro-services and analytics SaaS solutions Drive testing and automation for Continuous Integration (CI) and Continuous Deployment (CD) of services Develop Test strategy for scalability, availability, and data security of services Develop and leverage AI agents for comprehensive testing and analysis At Guidewire, we foster a culture of curiosity, innovation, and responsible use of AI empowering our teams to continuously leverage emerging technologies and data-driven insights to enhance productivity and outcomes. ...

Design and develop portfolio test automation of end to end customer scenarios Design and build automation framework and tools Build dashboards to track product quality Hands-on automation > 90% of the time Test and automate micro-services and analytics SaaS solutions Drive testing and automation for Continuous Integration (CI) and Continuous Deployment (CD) of services Develop Test strategy for scalability, availability, and data security of services Develop and leverage AI agents for comprehensive testing and analysis At Guidewire, we foster a culture of curiosity, innovation, and responsible use of AI empowering our teams to continuously leverage emerging technologies and data-driven insig...

Very Urgent: Data Engineer / Sr.Data Engineer Company: AurumData Solutions Client: MNC Experience: 7+years Location: Jubilee Hills Hyderabad (Customer Location) Job Mode: C2H Duration: 1year + Ext Work Type: Hybrid Mode Note: The selected candidates will be required to work at the customer's location. Key skills: Data Engineer, Python, PySpark, SQL, Databricks, Airflow, Data lake, merging of data, data ingestion, ETL Process, API, FastAPI, AWS (S3, IAM, ECR, Lambda), Rockset, Clickhouse, CrateDB, Avro, Parquet, ORC etc.. Job Summary: A Data Engineer is responsible for overseeing the design, development, and management of data infrastructure and pipelines within an organization. This role inv...

You will be a Senior Data Engineer at Beige Bananas, a rapidly growing pure play AI consulting firm focusing on building hyper custom AI products for Fortune 500 Retail, CPG, and Media companies. With an outcome-driven mindset, you will accelerate value realization from clients" analytics investments. **Key Responsibilities:** - Design and implement scalable data architectures - Build and maintain real-time and batch processing pipelines - Optimize data pipeline performance and costs - Ensure data quality, governance, and security - Collaborate with ML teams on feature stores and model pipelines **Qualifications Required:** - Data Engineering and Data Modeling skills - Experience in Extract ...

Summary: We are seeking a highly skilled and experienced Snowflake Database Administrator (DBA) to join our team. The ideal candidate will be responsible for the administration, management, and optimization of our Snowflake data platform. The role requires strong expertise in database design, performance tuning, security, and data governance within the Snowflake environment. Key Responsibilities: Administer and manage Snowflake cloud data warehouse environments, including provisioning, configuration, monitoring, and maintenance. Implement security policies, compliance, and access controls. Manage Snowflake accounts and databases in a multi-tenant environment. Monitor the systems and provide ...

Role Description This role demands to demonstrate high degree of ownership, velocity, and aptitude for working on Industrial gateway, Switching and Wireless applications. Candidate shall develop strong development practices for world class products, understand the customer needs, identify the gap, and define practices to improve product quality and build strong and highly engaged team. Role and responsibilities Build Go-Lang based applications for Linux based embedded products. Develop new features based on the functional specifications Ensure code is properly structured, do the Unit Testing of the feature developed and get the peer review completed Able to solve problems independently, taki...

As a Senior Software Engineer at SingleStore, you will play a crucial role in revolutionizing real-time technology that impacts businesses daily. Working in a rapid production environment, you will collaborate across teams to maximize impact and celebrate wins together. **Key Responsibilities:** - Work on small, collaborative teams to drive the company forward - Build systems software in a rapid production environment with a small and collaborative team - Enhance the performance of SingleStore cluster and write new C++ code for the query optimizer - Develop brand new and existing projects deployed into production with each release - Write and test software, gaining a deep understanding of bo...

As a highly motivated and skilled Kafka Developer, your role will involve designing, developing, and maintaining robust and scalable applications that interact with the Apache Kafka streaming platform. You will be required to have a strong understanding of Kafka's core concepts, client APIs, and best practices for building reliable data pipelines and stream-processing solutions. **Key Responsibilities:** - Design, develop, and maintain high-performance and fault-tolerant Kafka producers and consumers using Java, Scala, Python, Go, or other relevant programming languages. - Implement data streaming solutions, including real-time data ingestion, processing, and distribution. - Develop and opti...

As a Data Steward Consultant at RDIO TECH, you will be a key member of our exceptional team working on a strategic large-scale project. If you are a highly qualified professional with experience in data stewardship and are seeking a challenging opportunity, we are looking forward to meeting you! **Role Overview:** You will be responsible for the following key tasks: - **Data Onboarding:** Collaborate with Data Architects to design and document data schemas, data lineage, and metadata dictionaries. Serve as the subject matter expert for data assets, provide training materials, and user guides on data structure and usage. - **Data Quality:** Utilize data platform and cloud capabilities to impl...

Job Details: Skill: Java Developer Experience: 4+ Years Notice Period: Immediate to 15 Days Employee type: Permanent JD: Java 8/11 Spring Boot Microservices Junit / Mockito Karate / Gherkin MySQL Database Kafka / Avro git Pivotal Cloud Foundry Jenkins.

Skills : Experienced in MS*Server, SSIS, and Talend Knowledge on Databricks, Snowflake, Teradata, Oracle, Google Big Query, Hadoop, and related stacks, diverse data sources and data formats (xml, json, yaml, parquet, avro, delta) and respective use cases. Notice Period: immediate-30 days Education BE BTech, ME MTech, BCA,

As an experienced professional with 3+ years of experience in building and operating production-grade applications and services across the stack, you will be responsible for the following key responsibilities: - Demonstrating strong programming skills in Python and/or Scala and SQL to write modular, testable, and well-documented code for batch and streaming workloads. - Hands-on experience with modern data engineering stacks including: - Distributed processing using Apache Spark (Databricks preferred), PySpark/Scala. - Orchestration with Azure Data Factory or Apache Airflow; implementing event-driven patterns with Azure Functions/Logic Apps. - Working with storage & formats such as Delta Lak...

About The Role : Job TitleStrategic Data Archive Onboarding Engineer, AS LocationPune, India Role Description Strategic Data Archive is an internal service which enables application to implement records management for regulatory requirements, application decommissioning, and application optimization. You will work closely with other teams providing hands on support onboarding by helping them define record content and metadata, configuring archiving, supporting testing and creating defensible documentation that archiving was complete. You will need to both support and manage the expectations of demanding internal clients. What well offer you As part of our flexible scheme, here are just some ...

You're ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you. As a Software Engineer III at JPMorgan Chase within the Consumer & Community Banking Team, you are part of an agile team that works to enhance, design, and deliver the software components of the firm's state-of-the-art technology products in a secure, stable, and scalable way. As an emerging member of a software engineering team, you execute software solutions through the design, development, and technical troubleshooting of multiple components within a technical product, application, or system, while gaining the skills and...

Role Overview: You will play a crucial role as a Data Platform Engineer Lead at Barclays, focusing on building and maintaining systems for data collection, storage, processing, and analysis. This includes managing data pipelines, data warehouses, and data lakes to ensure the accuracy, accessibility, and security of all data within the organization. Key Responsibilities: - Utilize hands-on coding experience in Java or Python and a strong understanding of AWS development to implement various services like Lambda, Glue, Step Functions, and IAM roles. - Proficiently build efficient data pipelines using Apache Spark and other AWS services to streamline data processing and analysis. - Demonstrate ...

Design, configure, and maintain AIS Execution Workflows using UDTs, rules, Java plugins, and transformation logic. Work closely with analysts and business teams to understand detection logic and model outputs. ActOne Case Management Configure case structures, workflows, and routing rules within ActOne. Map alerts and events to appropriate case types based on business rules. Design and optimize case lifecycle stages, alerts triage processes, and review flows. UI Widgets & UX Support Build and customize widgets in ActOne UI (e.g., dashboards, tab layouts, investigator tools). Integrate widgets with backend services, ensuring seamless data display and interactivity. Support user experience enha...

About The Role : Job Title BigData-Hadoop/Scala Engineer, AVP Location Pune, India Role Description A Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected, with maintainability and ease of testing built in from the outset, and that they can be integrated successfully into the end-to-end business process flow. They will have gained significant experience through multiple implementations and have begun to develop both depth and breadth in a number of engineering competencies. They have extensive knowledge of design and architectural patterns. ...

About The Role : Job Title :BigData-Hadoop/Scala Engineer Location Pune, India Role Description An Associate Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of the Bank. Root cause analysis skills are developed through addressing enhancements and fixes to products. They attempt to build reliability and resiliency into solutions through early testing, peer reviews and automating the delivery lifecycle. What well offer you As part of our flexible scheme, here are just some of the benefits that youll enjoy Best in class leave policy Gender neutral parental leaves 1...

Immediate Joiners are preferrable Position Overview: We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights. Key Responsibilities: Technical Leadership Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery. Drive the adoption of modern data engineering frameworks, tools, and method...

About the Role: We are looking for an experienced Java Developer to design, build, and maintain scalable data solutions. You will work on modern Java (21+) technologies, contribute to distributed cloud-native systems, and collaborate with cross-functional teams. Key Responsibilities: Develop and maintain scalable, efficient Java-based applications. Collaborate with product and data teams to translate requirements into solutions. Implement best practices: code reviews, unit testing, CI/CD. Troubleshoot performance issues and ensure system reliability. Participate in Agile ceremonies (sprints, stand-ups, retros). Mentor junior developers and support knowledge sharing. Required Skills: 6+ years...

About the Role: We are looking for an experienced Java Developer to design, build, and maintain scalable data solutions. You will work on modern Java (21+) technologies, contribute to distributed cloud-native systems, and collaborate with cross-functional teams. Key Responsibilities: Develop and maintain scalable, efficient Java-based applications. Collaborate with product and data teams to translate requirements into solutions. Implement best practices: code reviews, unit testing, CI/CD. Troubleshoot performance issues and ensure system reliability. Participate in Agile ceremonies (sprints, stand-ups, retros). Mentor junior developers and support knowledge sharing. Required Skills: 6+ years...

This is 100% WFO opportunity at our Whitefield, Bengaluru office. Please don't apply if you can't comply. Position Overview: We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights. Key Responsibilities: Technical Leadership Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery. Dri...

Role Overview: You will work in the Information management team of Services Technologies, focusing on projects related to Big Data and public cloud adoption. This intermediate level position involves participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your primary objective will be to contribute to applications systems analysis and programming activities. Key Responsibilities: - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs ...