Job
Description
As a Apache Calcite Senior Developer at CLOUDSUFI, you will be responsible for producing scalable software solutions as part of a cross-functional team. You should be comfortable with both front-end and back-end coding languages, development frameworks, and third-party libraries. **Key Responsibilities:** - Design & Build JDBC Connectors: - Develop JDBC connectors for various relational and cloud-based data sources using Apache Calcite for query parsing, optimization, and execution. - Implement custom adapters for different databases to ensure correct SQL translation across diverse database systems. - Query Optimization & Rewriting: - Utilize Apache Calcite's query optimization features to improve query performance, including cost-based optimization, logical rewrites, and custom optimization rules. - Modify Calcite's relational algebra or add new optimization rules to meet specific data sources or performance requirements. - Support Complex Data Operations: - Enable execution of complex data operations like joins, aggregations, window functions, and custom SQL transformations optimally across multiple data sources via JDBC connectors. - Implement and extend Calcite's relational algebra to handle specific business logic or database-specific SQL dialects. - Performance Tuning and Monitoring: - Optimize Query Execution: - Analyze query execution plans to improve query efficiency and minimize execution time. - Monitor performance bottlenecks in queries processed through JDBC connectors and apply optimization strategies. - Troubleshoot Performance Issues: - Use Calcite's explainability and profiling tools to identify and resolve performance issues related to query execution, translation, and database communication. - Development Best Practices: - Follow best practices for test-driven development (TDD), code reviews, and CI/CD pipelines to ensure high-quality, maintainable code. - Create unit and integration tests to validate correctness and performance of JDBC connectors. - Stay updated with new releases of Apache Calcite and related technologies to incorporate latest features and improvements into the connectors. - Advocate for new features and improvements to the connector architecture based on changing business needs or advancements in the Calcite ecosystem. **Required Qualifications:** - 2+ years of experience working with Ruby - 3+ years of experience working with Kotlin - 2+ years of experience in Java development, particularly in building JDBC connectors and working with relational databases - Strong experience developing JDBC connectors for relational and cloud-based databases such as PostgreSQL, MySQL, Redshift, BigQuery, Snowflake - Working experience on Looker Ruby and Kotlin SDKs is a must - Deep understanding of Apache Calcite's architecture, including query planning, optimization, relational algebra, and SQL parsing - Strong proficiency with SQL, query optimization, and database internals - Experience with cost-based optimization, logical and physical plan rewrites, and custom query optimization rules using Apache Calcite - Hands-on experience building SQL parsers or query translation layers for different databases using Calcite,
