120 Avro Jobs

As a Senior Software Architect at our organization, you will play a crucial role as a key leader in the architecture team. Your main responsibility will be to define and evolve the architectural blueprint for complex distributed systems built using Java, Spring Boot, Apache Kafka, and cloud-native technologies. Here are some key responsibilities you will be expected to fulfill: - Own and evolve the overall system architecture for Java-based microservices and data-intensive applications. - Define and enforce architecture best practices, including clean code principles, DDD, event-driven design, and cloud-native patterns. - Lead technical design sessions, architecture reviews, and design walkt...

Important : Java 7/8+ features, OOPS, Microservices, Kafka, SQL, RESTful APIs, Git, Maven Nice to have : Agile Methodology, Design patterns, RDBMS, Any DB Tool, Intellij/VisualStudio/any other IDE, Cloud concepts, S3 Storage, Drools/DMN, BDD / TDD Testing, Sonar, Swagger/OpenAPI, Postman, Vault, AVRO

This role involves spearheading the development of an intelligent video analytics and search system We're building a solution that takes vast amounts of video footage, whether streaming live or from existing archives, and meticulously processes it This means segmenting videos into individual frames and then applying advanced AI models: object detection and classification to identify distinct items within each frame, and cutting-edge Video Language Models (VLMs) to provide rich, natural language descriptions of these objects and their attributes (for example, instead of just "man" and "umbrella," a VLM might describe "a man holding a black umbrella") All this generated textual information is ...

Role & responsibilities Hands-on experience designing and implementing AWS cloud infrastructure at scale, leveraging services such as Glue, Lambda, S3, SNS, and EventBridge. Proficiency in scripting languages like Python or Bash for automating cloud operations, ETL workflows, and Snowflake tasks. Expertise in Snowflake Data Platform, including: Data modelling and Governance, schema design, and query optimization. Implementing Snowflake best practices for performance tuning, cost optimization, and security. Managing Snowflake features such as Virtual Warehouses, Streams, Tasks, Masking, and Time Travel. Strong understanding of ETL/ELT methodologies, with experience integrating diverse data so...

Job Details: Skill: Java Developer Experience: 4+ Years Notice Period: Immediate to 15 Days Employee type: Permanent JD: Java 8/11 Spring Boot Microservices Junit / Mockito Karate / Gherkin MySQL Database Kafka / Avro git Pivotal Cloud Foundry Jenkins.

This role involves spearheading the development of an intelligent video analytics and search system. Were building a solution that takes vast amounts of video footage, whether streaming live or from existing archives, and meticulously processes it. All this generated textual information is then meticulously organized and stored in a specialized vector database, optimized for incredibly fast and intelligent retrieval. When a user needs to find something specific, like "find the man with a black umbrella, they simply input their query in natural language. Our system then leverages this vector database to efficiently pinpoint and present the exact, relevant video frames, effectively transformin...

where youll be supported and inspired by a collaborative community of colleagues around the world, where youll be supported and inspired bya collaborative community of colleagues around the world, and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable, more inclusive world. Your Role As a senior software engineer with Capgemini, you will have 3 + years of experience in Scala with strong project track record. Hands-on expertise in Scala and Spark, strong SQL skills on DB2, and proficiency in handling diverse file formats including JSON, Parquet, AVRO, ORC, and XML. Proven experience in H...

As an AWS Glue Developer with 6 to 9 years of experience, you will be responsible for the following: - Hands-on experience in AWS Glue ETL development for at least 3 years - Strong programming skills in Python and PySpark for data transformation - Proficiency in AWS services such as S3, Redshift, Athena, Lambda, and EMR - Experience working with data formats like Parquet, Avro, JSON, CSV, and ORC - Advanced SQL skills for data querying and transformation - Deep understanding of ETL/ELT design patterns and best practices - Knowledge of dimensional modeling, star/snowflake schemas - Experience with Git/Bitbucket for code management Preferred skills for this role include: - Experience with Vang...

Role Overview: You are an experienced Azure Databricks + SQL Developer / Big Data Engineer responsible for designing, developing, and maintaining scalable data solutions on Azure. Your primary focus will be on building efficient ETL/ELT pipelines, optimizing SQL queries, and leveraging Databricks and other Azure services for advanced data processing, analytics, and data platform engineering. Your strong background in traditional SQL development and modern big data technologies on Azure will be crucial for this role. Key Responsibilities: - Develop, maintain, and optimize ETL/ELT pipelines using Azure Databricks (PySpark/Spark SQL). - Write and optimize complex SQL queries, stored procedures,...

As a Solutions Architect, your primary focus is to ensure the technical integrity of the Event Driven Architecture platform and to formulate the technical direction for the strategic cloud investments. You will drive the estimation, analysis, and design, as well as support implementation and operations of a slew of microservices owned by the team. Working closely with the senior tech and business leadership, engineering, and ops teams, you will drive the vision and the technical strategic objectives throughout the SDLC. It is essential for you to remain current in all Parcel and Logistics related technologies in support of enterprise applications and infrastructure. Your passion for technolo...

What youll do Model & map data design canonical schemas that unify three disparate NM apps; maintain versioning and backward compatibility. Design high-throughput pipelines choose/implement brokers and stream processors to land NM events in our SEAL 2.0 layer. Interface with SNMP ecosystems ingest, normalize, and enrich SNMP v2/v3 traps, polls, and MIB objects; advise on best practices for NOC tooling. Prototype network-edge agents outline requirements (Go/Python/C) for lightweight collectors should device-side deployment become feasible. Performance & reliability engineering load-test 24/7 flows, implement retries/back-pressure, and instrument everything with Prometheus. Collaborate cross-f...

Lead Architect Client Technology Managed Services Job Summary: As the Lead Architect in Client Technology Managed Services, you play a pivotal role in assisting EY and its clients by designing a highly efficient and optimized technology architecture. This architecture integrates a variety of technology solutions that are tailored to meet the specific business needs of each client. You will primarily have 3 responsibilities: Technology Architecture As a technology leader possessing a robust understanding of technology and its application in driving business outcomes, you will offer architectural thought leadership and determine the feasibility of technical deliveries. You will propose the int...

Description: Understanding of data modeling concepts data warehousing tools and databases Experience in Snowflake SQL Cloud (AWS) Unix Technologies experience Must have hands on experience on SQL Snowflake Experience in AWS S3 and other common aws services. Should have experience working with multiple file formats especially with Parquet and Avro Should have Knowledge on Jenkins Git Udeploy CICD tools. Should have Experience on SQL writting and Unix commands Good communication skill and good team player Good to have Agile knowledge Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :B Level :To Be Defined Named Job Posting? (if Yes - needs to be approv...

JD -7+ years of hands on experience in Python especially dealing with Pandas and Numpy Good hands-on experience in Spark PySpark and Spark SQL Hands on experience in Databricks Unity Catalog Delta Lake Lake house Platform Medallion Architecture Azure Data Factory ADLS Experience in dealing with Parquet and JSON file format Knowledge in Snowflake.

Strong experience on development on Java /J2EE technologies, Spring boot, REST API, Transactions management, ACID properties. Strong understanding of OOP concepts, design patterns Working Experience on Microservices using Spring boot Experience on Kafka Streams, Kafka Producer/Consumer API, Avro Good knowledge on Kafka Broker, Zookeeper, Schema registry, topics etc., Experience on Azure cloud, Kubernetes, Docker, Helm etc., Strong experience in databases such as (DB2, Postgres, SQL) or similar. Good experience in Test driven development Experience in working with Jira, GitHub, Azure DevOps Agile Good communications skills

As a skilled Data Engineer at BigThinkCode Technologies, your role involves designing, building, and maintaining robust data pipelines and infrastructure to optimize data flow and ensure scalability. Your technical expertise in Python, SQL, ETL/ELT frameworks, and cloud data warehouses, along with strong collaboration skills, will be crucial in partnering with cross-functional teams to enable seamless access to structured and unstructured data across the organization. **Key Responsibilities:** - Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data processing. - Optimize and manage SQL queries for performance and efficiency in handling large-scale data...

As an individual with experience in Azure Synapse Analytics, Azure Data Lake Storage, AI Tools, Avro, and Parquet, and healthcare data management, you will play a crucial role in designing, developing, and maintaining data pipelines for ingestion, transformation, and loading of data into Azure Synapse Analytics. Your expertise will be instrumental in ensuring compliance with data governance policies, implementing security measures, and optimizing performance of data pipelines within Azure Synapse Analytics. - Design, develop, and maintain data pipelines for ingestion, transformation, and loading of data into Azure Synapse Analytics - Work with Azure Synapse Analytics to build and optimize da...

Role Overview: You will be joining as a Senior Java Developer at the team to lead the development of custom connectors for integrating source systems with a Kafka cluster. Your expertise in Java programming, data integration, and Kafka architecture will be essential for this role. You will have the responsibility of managing a small team of developers and collaborating effectively with Kafka administrators. This position will involve hands-on development, leadership responsibilities, and direct engagement with client systems and data pipelines. Key Responsibilities: - Design, develop, and maintain Java-based connectors for integrating diverse source systems with Kafka clusters. - Incorporate...

You are applying for the position of Data Ingest Engineer at NTT DATA in Pune, Maharashtra, India. As a part of the Ingestion team of the DRIFT data ecosystem, your primary focus will be on ingesting data efficiently using the latest technology available at Citi. You will be responsible for ensuring that data is ingested in a timely, complete, and comprehensive manner while continuously seeking innovative solutions to improve data quality for downstream partners. **Responsibilities:** - Partner with multiple management teams for seamless integration of functions to meet objectives and identify system enhancements for deploying new products and process improvements. - Solve high impact proble...

As a highly skilled Java Developer with expertise in Spring Boot, Confluent Kafka, and distributed systems, your main responsibility will be designing, developing, and optimizing event-driven applications using Confluent Kafka while leveraging Spring Boot/Spring Cloud for microservices-based architectures. Your key responsibilities will include: - Developing, deploying, and maintaining scalable and high-performance applications using Java (Core Java, Collections, Multithreading, Executor Services, CompletableFuture, etc.). - Working extensively with Confluent Kafka, including producer-consumer frameworks, offset management, and optimization of consumer instances based on message volume. - En...

Role Overview: As an individual with experience in Azure Synapse Analytics, Azure Data Lake Storage, AI Tools, Avro, and Parquet, and healthcare data management, you will play a crucial role in designing, developing, and maintaining data pipelines for ingestion, transformation, and loading of data into Azure Synapse Analytics. Your expertise will be instrumental in ensuring compliance with data governance policies, implementing security measures, and optimizing the performance of data pipelines within Azure Synapse Analytics. Key Responsibilities: - Design, develop, and maintain data pipelines for ingestion, transformation, and loading of data into Azure Synapse Analytics. - Work with Azure ...

As a skilled and motivated .NET Core Developer with expertise in Apache Kafka, you will be an integral part of the development team. Your primary responsibility will be to design, implement, and optimize real-time data streaming applications using .NET Core and Kafka. By leveraging cutting-edge technologies, you will contribute to the creation of scalable and fault-tolerant systems capable of processing large volumes of data in real-time. Key Responsibilities: - Develop Real-Time Data Streaming Applications: - Design and implement real-time data streaming solutions using .NET Core and Apache Kafka. - Implement Kafka producers and consumers for data ingestion, processing, and consumption whil...

As a Java Developer with 6+ years of experience, you will be responsible for: - Leading Java development using Spring Boot, Java 8+, Spring, and Microservices - Developing and integrating APIs using REST/JSON, AVRO, and Kafka - Designing, building, and maintaining Rest APIs and microservices following best practices, including security and performance tuning - Demonstrating strong Core Java Skills, including knowledge of Design patterns, Collections, Garbage Collection, and Multithreading - Utilizing Java frameworks and technologies such as Spring Boot, Hibernate, and Maven - Writing and managing JUnits and Mock frameworks like Mockito, JMock or equivalent - Working with relational databases...

Role Overview: As a Data Architect at EdgeVerve Systems, you will play a crucial role in driving data architecture related client workshops, internal meetings, and proposals. Your strong understanding of NiFi architecture and components will be instrumental in designing high-level data pipelines for Apache NiFi and the AI-NEXT platform. You will be responsible for ensuring database performance, data quality, integrity, and security, while also optimizing and troubleshooting NiFi workflows for performance, scalability, and reliability. Key Responsibilities: - Work closely with the Client Architect to conduct data architecture workshops and drive internal meetings - Utilize your knowledge of d...

As a Data Engineer specializing in AWS Managed Streaming for Apache Kafka (MSK), your role will involve designing, building, and maintaining high-performance data pipelines. Working in collaboration with data architects and software engineers, your focus will be on ensuring seamless data integration and streaming capabilities using AWS MSK. Your key responsibilities will include: - Designing, developing, and managing real-time data pipelines utilizing AWS MSK - Integrating AWS MSK with various data sources and consumers - Monitoring and optimizing AWS MSK cluster performance and costs - Collaborating with DevOps to ensure optimal performance and uptime - Implementing security best practices ...