75 Data Streaming Jobs - Page 2

Key Responsibilities: 5 to 10 years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks Handson expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture), Confluent Cloud, RabbitMQ or Azure Event Hub. Experience creating producers, consumers and topics and integrating them into downstream processing. Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle, or other RDBMSs; experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption. Implement CDC and deduplication logic. Capture change events from s...

We are hiring for a Data Engineer R ole for an ( Investment banking and financial services company) Permanent Opportunity for the Hyderabad location. If you’re interested in this opportunity, please do share your updated profile along with the updated resume in subnayak@allegisglobalsolutions.com. Expertise in big data technologies. Proficiency in big data with expertise in Spark, Python, Hive, SQL, Airflow. Proficient in AWS Glue, DBT, Data Streaming. Hands-on experience building, implementing, and enhancing enterprise-scale data platforms. Proficiency in big data with expertise in Spark, Python, Hive, SQL, Presto, storage formats like Parquet, and orchestration tools such as Apache Airflow...

Roles and Responsibilities: Working with clients to understand their data. Based on the understanding you will be building the data structures and pipelines. You will be working on the application from end to end collaborating with UI and other development teams. You will be working with various cloud providers such as Azure & AWS. You will be engineering data using the Hadoop/Spark ecosystem. You will be responsible for designing, building, optimizing and supporting new and existing data pipelines. Orchestrating jobs using various tools such Oozie, Airflow, etc. Developing programs for cleaning and processing data. You will be responsible for building the data pipelines to migrate and load ...

We are searching for a highly skilled and seasoned Senior ETL & Data Streaming Engineer with over 10 years of experience to take on a crucial role in the design, development, and maintenance of our robust data pipelines. The ideal candidate will possess in-depth expertise in batch ETL processes as well as real-time data streaming technologies, along with extensive hands-on experience with AWS data services. A proven track record of working with Data Lake architectures and traditional Data Warehousing environments is a must. Your responsibilities will include designing, developing, and implementing highly scalable, fault-tolerant, and performant ETL processes using leading ETL tools to extrac...

Bluevine is revolutionizing small business banking by offering innovative solutions like checking, lending, and credit tailored to support entrepreneurs in their growth journey. With top-notch technology, advanced security measures, and a profound understanding of the small business community, Bluevine empowers entrepreneurs to expand their ventures confidently. Backed by prominent investors including Lightspeed Venture Partners, Menlo Ventures, 83North, and Citi Ventures, Bluevine has been dedicated to assisting small and medium-sized businesses since 2013. Having served over 500,000 customers nationwide, Bluevine has built a dynamic global team of 500 individuals. The ultimate mission is t...

• Strong hands-on experience with Salesforce Data Cloud and core Salesforce platform Solid understanding of data modelling and integration patterns • Solid understanding of Data Streams, Data Lake, Data Models, Data Transforms and Data Analysis

We are looking for an accomplished and innovative Hands-On Technology Lead - VP to drive the development and delivery of cloud-based applications, Kafka implementations, and Java full-stack solutions. As a seasoned technical leader, you will be responsible for defining the architecture and leading the implementation of robust, scalable, and secure cloud-based applications. Your role will involve overseeing Kafka integrations for data streaming and event-driven architectures, as well as driving best practices in Java full-stack development. In this position, you will actively engage in coding, debugging, and designing solutions to ensure high-quality deliverables. You will also perform code r...

You will play a crucial role in contributing to the development of a high-throughput, stable, and real-time gaming platform. Working closely with cross-functional teams comprising product managers, designers, and backend/frontend engineers, you will participate in defining project requirements and deliverables. Your primary responsibility will involve developing and maintaining efficient and reliable Java code that aligns with the project's performance and scalability objectives. Moreover, you will be tasked with implementing and optimizing data streaming mechanisms to facilitate real-time player interactions, ensuring minimal latency and high responsiveness. It will be essential for you to ...

Job Title: Data Engineer - Ingestion, Storage & Streaming (Confluent Kafka) Job Summary: As a Data Engineer specializing in Ingestion, Storage, and Streaming, you will design, implement, and maintain robust, scalable, and high-performance data pipelines for the efficient flow of data through our systems. You will work with Confluent Kafka to build real-time data streaming platforms, ensuring high availability and fault tolerance. You will also ensure that data is ingested, stored, and processed efficiently and in real-time to provide immediate insights. Key Responsibilities: Kafka-Based Streaming Solutions: Design, implement, and manage scalable and fault-tolerant data streaming platforms us...

As an accomplished and innovative Hands-On Technology Lead - VP, you will be responsible for driving the development and delivery of cloud-based applications, Kafka implementations, and Java full-stack solutions. This role requires a seasoned technical leader with extensive experience in architecting, developing, and deploying scalable enterprise solutions. You will combine hands-on technical expertise with leadership acumen to guide teams, implement best practices, and deliver world-class software products. Key Responsibilities Technical Leadership: - Define the architecture and lead the implementation of robust, scalable, and secure cloud-based applications. - Oversee Kafka integrations fo...

You will be joining Programming.com, a global enterprise specializing in next-gen digital solutions to drive agility, efficiency, and impact. With over 22 years of experience and a team of 2200+ tech experts across multiple delivery hubs worldwide, we have successfully completed more than 1000 projects in various industries. Our key competencies include AI & Machine Learning, Digital Transformation, Cloud Enablement, Custom Applications, and Blockchain solutions, leading to significant operational cost reductions and faster time-to-market for our Fortune 500 clients. As a Kafka Developer with over 10 years of experience, you will play a crucial role in designing, developing, and maintaining ...

At Ford, we take pride in being an industry icon with a well-deserved reputation for crafting iconic, world-class vehicles. The commitment and expertise of our exceptional teams play a pivotal role in making this possible. We highly value the talent, experience, and dedication of our people and teams, considering them as the cornerstones of our success. Embracing diversity of voices and perspectives, we believe that every individual's contribution is invaluable. We encourage you to bring your authentic self and join us in our pursuit of greatness to achieve remarkable things together. We are currently looking for a talented and experienced Engineering Product Manager to join our team. In thi...

Bluevine is transforming small business banking with innovative solutions like checking, lending, and credit tailored to help entrepreneurs thrive. With best-in-class technology, advanced security, and a deep understanding of the small business community, Bluevine is empowering entrepreneurs to grow with confidence. Backed by leading investors like Lightspeed Venture Partners, Menlo Ventures, 83North, and Citi Ventures, Bluevine has been supporting SMBs since 2013, serving over 500,000 customers nationwide and growing a dynamic global team of 500 people. The mission of Bluevine is to fuel small businesses with the financial tools they need to succeed. Joining Bluevine means being part of a c...

As a Systems Architect specializing in BizTech Integrations at Airbnb, you will be a crucial part of a team working towards the mission of creating a world where everyone can belong anywhere. The BizTech department plays a pivotal role in providing internal systems, enterprise technologies, and technical support to enable a seamless experience for both the business and its people. You will join the Integrations team within BizTech, responsible for managing integrations and APIs across various SaaS products and internal systems. Your primary focus will be on owning the end-to-end architecture of finance integrations, leading integration projects, and enhancing processes while ensuring securit...

As a Data Architect at Cigna International Markets, your primary responsibility is to define commercially aware and technically astute solutions that align with the architectural direction while considering project delivery constraints. You will be an integral part of the Architecture function, collaborating with senior stakeholders to establish strategic direction and ensure that business solutions reflect this intent. Your role will involve leading and defining effective business solutions within complex project environments, showcasing the ability to cultivate strong relationships across Business, IT, and 3rd Party stakeholders. Your main duties and responsibilities will include performin...

As a Senior Platform Engineer at Kenvue Data Platforms, you will have an exciting opportunity to be part of our growing Data & Analytics product line team. Your role involves collaborating closely with various teams such as Business partners, Product Owners, Data Strategy, Data Platform, Data Science, and Machine Learning (MLOps) to drive innovative data products for end users. You will play a key role in shaping the overall solution and data platforms, ensuring their stability, responsiveness, and alignment with business and cloud computing needs. Your expertise will be crucial in optimizing business outcomes and contributing to the growth and success of the organization. Your responsibilit...

At JP Morgan Chase, you will play a crucial role in delivering end-to-end data pipeline solutions on cloud infrastructure to enhance the digital banking experience for our customers. Your expertise will help us leverage the latest technologies and industry best practices to build innovative business products and ensure a seamless and secure banking environment. Your responsibilities will include using domain modeling techniques to create top-tier business products, structuring software for easy understanding and evolution, and implementing scalable architectural patterns to avoid single points of failure. You will develop secure code to safeguard our customers and systems from malicious acti...

The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters. You should have experience that demonstrates proficiency and ease with one or more programming languages, quality assurance, scripting languages, and operating systems. Solid hands-on development experience in backend technologies including JAVA, J2EE, SQL and related technology stack, preferably incorporating open-source libraries is required. Hands-on experience with Spring Framework, Spring Boot, MongoDB, and JPA / Hibernate is a strong plus. Exposure to frameworks like Karate and ...

You will be part of a dynamic team at JP Morgan Chase, dedicated to providing exceptional value and a seamless experience to customers as a trusted financial institution. Chase UK, our digital banking arm, is at the forefront of transforming the banking experience through intuitive and enjoyable customer journeys. Leveraging the strong foundation of trust built by millions of customers in the US, we are rapidly expanding our presence in the UK and soon across Europe, shaping the bank of the future. This is your opportunity to join us and create a significant impact. Your responsibilities will include delivering end-to-end data pipeline solutions on cloud infrastructure by harnessing the late...

At JP Morgan Chase, we prioritize providing exceptional value and a seamless experience to our customers as a trusted financial institution. Chase UK was established with the goal of revolutionizing digital banking through intuitive and enjoyable customer journeys. Backed by the trust of millions of customers in the US, our presence in the UK is rapidly expanding, with plans to extend across Europe. We are in the process of building the bank of the future from scratch, offering you the opportunity to join us and contribute significantly to our mission. As a part of our team, your responsibilities will include delivering end-to-end data pipeline solutions on cloud infrastructure by leveraging...

As a Senior Azure Cloud Data Engineer based in Bangalore, you will be instrumental in the processing and analysis of IoT data derived from our connected products. Your primary objective will be to provide valuable insights to both our internal teams and external clients. Your core responsibilities will include the development and maintenance of scalable and high-performance analytical data solutions leveraging Azure cloud technologies. With 3+ years of experience in Azure Analytics tools such as Data Factory, Synapse, and Event Hubs, you will possess strong proficiency in SQL, Python, and PySpark. Your expertise will extend to ETL/ELT processes, data streaming utilizing Kafka/Event Hubs, and...

As a passionate and experienced Software Engineer, you have the exciting opportunity to join the API & Exports team at Meltwater. This team plays a crucial role in enabling programmatic access to data, handling thousands of exports daily, enhancing API usability, and managing API integrations and performance at scale. Your work will involve expanding and optimizing export functionalities, developing scalable APIs, and implementing robust monitoring and management practices. Join this high-impact team located at the core of the data delivery platform. Your responsibilities will include owning the design, development, and optimization of API and export features, collaborating with product mana...

As a Senior ETL & Data Streaming Engineer at DataFlow Group, you will have the opportunity to utilize your extensive expertise in designing, developing, and maintaining robust data pipelines. With over 10 years of experience in the field, you will play a pivotal role in ensuring the scalability, fault-tolerance, and performance of our ETL processes. Your responsibilities will include architecting and building both batch and real-time data streaming solutions using technologies like Talend, Informatica, Apache Kafka, or AWS Kinesis. You will collaborate closely with data architects, data scientists, and business stakeholders to translate data requirements into efficient pipeline solutions and...

Job Description: As a Senior Azure Cloud Data Engineer based in Bangalore with a hybrid working model, you will have a pivotal role in processing and analyzing IoT data generated by our connected products. Your primary objective will be to derive meaningful insights from this data to cater to the needs of both our internal teams and external clients. Your core responsibilities will revolve around the creation and upkeep of scalable, high-performance analytical data solutions utilizing Azure cloud technologies. Key Skills: With a minimum of 3 years of hands-on experience in utilizing Azure Analytics tools such as Data Factory, Synapse, and Event Hubs, you will be well-versed in these technolo...

Hi, Wishes from GSN!!! Pleasure connecting with you!!! We been into Corporate Search Services for Identifying & Bringing in Stellar Talented Professionals for our reputed IT / Non-IT clients in India. We have been successfully providing results to various potential needs of our clients for the last 20 years. At present, GSN is hiring DATA ENGINEERING - Solution Architect for one of our leading MNC client. PFB the details for your better understanding : 1. WORK LOCATION : PUNE 2. Job Role: DATA ENGINEERING - Solution Architect 3. EXPERIENCE : 13+ yrs 4. CTC Range: Rs. 35 LPA to Rs. 50 LPA 5. Work Type : WFO Hybrid ****** Looking for SHORT JOINERS ****** Job Description : Who are we looking fo...