3 Apache Arrow Jobs

As part of the Data Services organization, we are chartered to build a net new fully managed OCI Cloud service. Since many use cases that customers try to address need more than one data service to be used, today customers must bear the burden of (error prone) IAM policy setup among other things to have functioning applications. The new cloud service will bring together multiple data services (e.g., OCI Data Flow - serverless Spark service, OCI Data Integration - visual ETL service, and others) under a single pane of glass with a highly evolved user experience, where users can easily implement their use cases, and will eliminate potential error prone policy setup (among other things).We are looking for experienced Principal/Senior Principal Engineers/Architects to help us enhance and strengthen the story for the native SQL engine for this new converged product. They should be able to function well in a large geographically distributed team and have the hunger to drive for impactful results on established schedules while maintaining sanity for themselves and their team. We are looking for an individual with experience in: As an individual contributor, leading engineering teams that have delivered successful products and services. Setting the technical direction. Coaching and mentoring junior talent. Outstanding communication skills and the ability to make prudent decisions on solutions to deep and complex technical challenges. BigData systems like Apache Spark, Apache Hive, Apache Drill, Apache Arrow, and other related systems with a focus on the SQL capabilities of those and enabling high-performance executions. Basic Qualifications Master's degree (or Bachelor's degree and additional experience) in Computer Sciences or equivalent. 8+ years of experience in software development. 3+ years of experience in leading teams on solving complex distributed system problems. Experience in software design and coding in a modern programming language. Experience developing distributed systems and understanding of scale, security, reliability and performance. Deep understanding and experience with the inner workings of a modern SQL engine As a member of the software engineering division, you will take an active role in the definition and evolution of standard practices and procedures. You will be responsible for defining and developing software for tasks associated with the developing, designing and debugging of software applications or operating systems. Career Level - IC4

As a Founding Engineer at Colrows, you will play a crucial role in shaping and scaling our generative analytics platform. We are dedicated to revolutionizing how enterprises engage with data, aiming to make insights as accessible as conversing with a colleague. Our platform integrates robust data foundations, agentic workflows, and enterprise-grade governance to deliver a seamless, self-serve experience. Join us in driving the development of a powerful execution engine that lies at the core of our platform. In this role, you will serve as a hands-on Principal Software Engineer, leveraging your architectural expertise and practical experience in constructing resilient systems using Java and open-source technologies. Your primary responsibility will be to lead the design and implementation of the backend engine, which processes and transforms large-scale structured data with a focus on precision, performance, and clarity. Key Responsibilities: - Design and construct essential components of the Colrows platform, such as distributed query execution, type-safe data transformation pipelines, and high-performance connectors to various database backends. - Architect and deploy scalable, fault-tolerant services in Java utilizing open-source libraries and tools. - Ensure accuracy in data type mappings, memory representations, and serialization across diverse data systems. - Mentor and guide engineers through code reviews, design discussions, and the implementation of production-quality solutions. - Collaborate with AI, frontend, and infrastructure teams to deliver a cohesive and agentic product experience. - Take charge of technical decision-making by balancing performance, maintainability, and extensibility. You Bring: - Over 10 years of hands-on experience in backend engineering with a specialization in Java. - A solid foundation in computer science fundamentals, particularly in data structures, memory models, and type systems. - Previous experience handling large datasets spanning terabytes of structured data across distributed systems. - Practical knowledge of data type mappings in SQL engines, Java, JSON, Avro, Arrow, and binary formats. - Proficiency in in-memory data representations, caching strategies, and performance optimization. - Demonstrated success in designing and implementing clean, testable, and production-grade code. - Familiarity with tools such as Apache Arrow, Apache Calcite, Apache Ignite, Presto/Trino, Apache Beam, RocksDB, Protobuf, gRPC, and Netty. - Bonus: Experience in contributing to open-source projects or building data platforms, databases, or query engines. What You'll Get: - Opportunity to work on a cutting-edge analytics platform that is reshaping how enterprises engage with data. - Direct collaboration with the founder and a dedicated, technically proficient team. - A culture that promotes ownership, autonomy, and deep engineering involvement. - Competitive compensation, meaningful equity, and the flexibility of a modern remote/hybrid work environment.,

We are looking for a Software Developer with 4 -12 Years of robust experience in Python, C, C++. Candidates from R&D background will be preferable. Contact/Whatsapp +919154254764 / evelyn@livecjobs.com *JOB IN HYDERABAD/ BENGALURU/ GURUGRAM* Required Candidate profile Candidates from R&D background will be preferable Proven experience working with C/ C++ into low-level programming