4 Realtime Streaming Jobs

As a KDB+ Developer with 3-5 years of experience, you will be an integral part of our Tick Data Analytics Platform Team, dedicated to crafting solutions for our strategic KDB+ Platform. In this role, you will collaborate closely with various trading platforms and compliance functions, handling and analyzing substantial datasets within a fast-paced, low-latency environment. Your key responsibilities will include managing data from diverse business areas, translating requirements into user analytics, and designing solutions that support regulatory initiatives, pricing/trading algorithms, back testing, and PnL attribution. You will also be tasked with rapidly prototyping solutions for Front Office teams in an agile manner and contributing to all aspects of product delivery, such as design documents, functional specifications, and architecture. Moreover, you will play a pivotal role in enhancing the evolving KDB architecture, including the newly developed Golden data store (Order Data store). To excel in this role, you must possess excellent proficiency in KDB/Q, along with hands-on experience in a tick data capture and analytics platform. A deep understanding of KDB engineering principles, including data partitioning, query performance optimization, Realtime streaming, and IPC, is essential. Strong knowledge of Data Structures and Algorithms is also crucial, enabling you to work autonomously with minimal supervision and engage directly with business stakeholders. Additionally, familiarity with development tools like JIRA, GIT, Jenkins, etc., will be advantageous. Your ability to independently design and construct components, swiftly prototype solutions, and manage multiple deliveries in an agile environment will be key to your success in this role.,

The Applications Development Sr Programmer Analyst is responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. Your role will involve leading applications systems analysis and programming activities. You will partner with multiple management teams to ensure appropriate integration of functions to meet goals, identify necessary system enhancements for deploying new products and process improvements, and resolve high-impact problems/projects through in-depth evaluation of complex business processes and system processes. Your expertise in applications programming will be crucial in ensuring that application design aligns with the overall architecture blueprint. As a key member of the team, you will be instrumental in developing and maintaining systems that power near real-time/Batch, information retrieval (IR), and grounding (RAG) services. Your responsibilities will include designing and building highly scalable web crawling and data extraction systems, optimizing data extraction architecture for peak performance, and developing robust systems to process vast volumes and extract meaningful insights through advanced data processing techniques. Additionally, you will design and implement high-throughput data pipelines and infrastructure to handle petabyte-scale datasets seamlessly. You must have expertise in Hadoop, Spark, Oracle, CICD, Light speed, OpenShift, Java, and Microservices. The qualifications for this role include 8+ years of relevant experience in Apps Development or systems analysis, 5+ years of programming with at least one software programming language experience, and 5+ years of leading design or architecture experience. Subject Matter Expertise in at least one area of Applications Development is required, along with clear and concise written and verbal communication skills. Experience with Python, analytic methods, frameworks, real-time streaming, and stream processing frameworks is a plus. Prior experience in the financial industry is a must. In this role, you will play a key part in driving the adoption of capabilities across regions by collaborating with regional business and technology teams, integrating data into the DataHub (EAP), and prototyping methods to develop insights with business analytics and digital product teams. Your proven ability to attract, develop, engage, and sustain engineering/technical talent will be essential in fostering a culture of innovation and excellence. A Bachelor's degree/University degree or equivalent experience is required, with a Master's degree preferred. Full-time employment is offered in the Technology job family group, specifically in Applications Development.,

As a Technical Lead with over 8 years of experience in Data Engineering, Analytics, and Python development, including at least 3 years in a Technical Lead / Project Management role, you will play a crucial role in driving data engineering and analytics projects for our clients. Your client-facing skills will be essential in ensuring successful project delivery and effective communication between technical and business stakeholders. Your responsibilities will include designing and implementing secure, scalable data architectures on cloud platforms such as AWS, Azure, or GCP. You will lead the development of cloud-based data engineering solutions covering data ingestion, transformation, and storage while defining best practices for integrating diverse data sources securely. Overseeing security aspects of integrations and ensuring compliance with organizational and regulatory requirements will be part of your role. In addition, you will develop and manage robust ETL/ELT pipelines using Python, SQL, and modern orchestration tools, as well as integrate real-time streaming data using technologies like Apache Kafka, Spark Structured Streaming, or cloud-native services. Collaborating with data scientists to integrate AI models into production pipelines and cloud infrastructure will also be a key aspect of your responsibilities. Furthermore, you will work on advanced data analysis to generate actionable insights for business use cases, design intuitive Tableau dashboards and data visualizations, and define data quality checks and validation frameworks to ensure high-integrity data pipelines. Your expertise in REST API development, backend services, and integrating APIs securely will be crucial in developing and deploying data products and integrations. To excel in this role, you must have deep hands-on experience with cloud platforms, expertise in Python, SQL, Spark, Kafka, and streaming integration, proven ability with data warehousing solutions like BigQuery, Snowflake, and Redshift, and a strong understanding of integration security principles. Proficiency in data visualization with Tableau, REST API development, and AI/ML integration will also be essential. Preferred qualifications include prior experience managing enterprise-scale data engineering projects, familiarity with DevOps practices, and understanding of regulatory compliance requirements for data handling. Your ability to lead technical teams, ensure project delivery, and drive innovation in data engineering and analytics will be key to your success in this role.,

As the Technical Lead of Data Engineering at Assent, you will collaborate with various stakeholders including Product Managers, Product Designers, and Engineering team members to identify opportunities and evaluate the feasibility of solutions. Your role will involve offering technical guidance, influencing decision-making, and aligning data engineering initiatives with business objectives as part of Assent's roadmap development. You will be responsible for driving the technical strategy, overseeing team execution, and implementing process improvements to construct resilient and scalable data systems. In addition, you will lead data engineering efforts, mentor a growing team, and establish robust and scalable data infrastructure. Key Requirements & Responsibilities: - Lead the technical execution of data engineering projects to ensure high-quality and timely delivery, covering discovery, delivery, and adoption stages. - Collaborate with Architecture team members to design and implement scalable, high-performance data pipelines and infrastructure. - Provide technical guidance to the team, ensuring adherence to best practices in data engineering, performance optimization, and system reliability. - Work cross-functionally with various teams such as Product Managers, Software Development, Analysts, and AI/ML teams to define and implement data initiatives. - Partner with the team manager to plan and prioritize work, striking a balance between short-term deliverables and long-term technical enhancements. - Keep abreast of emerging technologies and methodologies, advocating for their adoption to accelerate the team's objectives. - Ensure compliance with corporate security policies and follow the established guidelines and procedures of Assent. Qualifications: Your Knowledge, Skills and Abilities: - Possess 10+ years of experience in data engineering, software development, or related fields. - Proficient in cloud data platforms, particularly AWS. - Expertise in modern data technologies like Spark, Airflow, dbt, Snowflake, Redshift, or similar. - Deep understanding of distributed systems and data pipeline design, with specialization in ETL/ELT processes, data warehousing, and real-time streaming. - Strong programming skills in Python, SQL, Scala, or similar languages. - Experience with infrastructure as code tools like Terraform, CloudFormation, and knowledge of DevOps best practices. - Ability to influence technical direction and promote best practices across teams. - Excellent communication and leadership skills, with a focus on fostering collaboration and technical excellence. - A learning mindset, continuously exploring new technologies and best practices. - Experience in security, compliance, and governance related to data systems is a plus. This is not an exhaustive list of duties, and responsibilities may be modified or added as needed to meet business requirements. Life at Assent: At Assent, we are dedicated to cultivating an inclusive environment where team members feel valued, respected, and heard. Our diversity, equity, and inclusion practices are guided by our Diversity and Inclusion Working Group and Employee Resource Groups (ERGs), ensuring that team members from diverse backgrounds are recruited, retained, and provided opportunities to contribute to business success. If you need assistance or accommodation during any stage of the interview and selection process, please reach out to talent@assent.com, and we will be happy to assist you.,