11 Apache Parquet Jobs

Join our team as a Data Engineer and contribute to our mission of leveraging data to drive meaningful insights and deliver innovative solutions for our clients. Responsibilities Design, develop, and own robust data pipelines, ensuring optimal performance, scalability, and maintainability. Design and implement Data Lake, Dare Warehouse, and Lakehouse solutions with different architecture patterns. Ensure data quality, integrity, and governance across all stages of the data lifecycle. Monitor and optimize the performance of data engineering pipelines. Contribute to design principles, best practices, and documentation. Collaborate closely with cross-functional teams to deeply understand busines...

Role Overview: As a Senior Full Stack Software Engineer at S&P Global Market Intelligence, you will be responsible for developing high-performance, scalable, and AI-augmented enterprise applications. Your role will involve strong backend engineering in Java, while also focusing on cloud-native development, microservices, and GenAI integration. You will play a crucial part in shaping the future of the software platforms by owning platform evolution and incorporating LLM-based tools to enhance engineering velocity and quality. Key Responsibilities: - Deliver end-to-end features using modern Java stacks - Build and scale APIs (REST/GRPC, OData, GraphQL), microservices, and event-driven architec...

We are seeking an experienced and highly motivated Senior Data Engineer to join our dynamic team. The ideal candidate will play a critical role in designing, developing, and maintaining high-performance data infrastructure and pipelines. As a Senior Data Engineer, you will be responsible for ensuring the scalability, performance, and reliability of data systems that support business intelligence, analytics, and data science initiatives across the organization. You will work in a collaborative environment with cross-functional teams to translate business needs into technical solutions and help shape the organizations overall data strategy. This role offers an excellent opportunity to work wit...

Role Overview: The Distributed Data Systems Team at Dataflare is seeking talented engineers who are passionate about designing and deploying distributed data systems at PB cloud-scale. As a Team Lead, you will play a crucial role in understanding business requirements, mentoring a team of engineers, designing high-performance storage algorithms, and contributing to the foundational programming model of the data platform. Key Responsibilities: - Understand and craft solutions based on business requirements - Mentor and develop a team of engineers - Design and implement performant, parallelized, and multi-threaded storage algorithms - Contribute to the scheduling and programming model for all ...

The Distributed Data Systems Team designs and develops the back-end storage solutions that allow Dataflare to provide one of the most flexible cloud data management platforms. We are looking for talented engineers who are excited about building and deploying distributed data systems at PB cloud-scale. Your Responsibilities As a Team Lead Understand and be capable of taking on a set of business requirements to craft a solution Mentor and develop a team of engineers Design and develop highly performant, parallelized, and multi-threaded storage algorithms Contribute to the scheduling and programming model that lays the foundation for all features developed as a part of our data platform Skill S...

About the Company At Tide, we are dedicated to creating a business management platform that aims to streamline operations for small businesses, enabling them to save valuable time and resources. Our services include offering business accounts, banking solutions, as well as a range of integrated administrative tools spanning from invoicing to accounting. Established in 2017, Tide has garnered a user base of over 1 million small businesses globally, catering to SMEs in the UK, India, and Germany. Headquartered in central London, we also have offices in Sofia, Hyderabad, Delhi, Berlin, and Belgrade, with a team of more than 2,000 employees. Tide is on a trajectory of rapid growth, continuously ...

Job Summary Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs. Experience with Azure ADLS, Apache Parquet, Iceberg, Kubeflow and Airflo...

Big Data Engineer / Infrastructure Developer Liaising with coworkers and clients to elucidate the requirements for each task Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed Reformulating existing frameworks to optimize their functioning Testing such structures to ensure that they are fit for use Preparing raw data for manipulation by data scientists Detecting and correcting errors in your work Ensuring that your work remains backed up and readily accessible to relevant coworkers Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs Experience with: Azure ADLS Apache Parquet Iceb...

Role Objective: We are seeking a Software Data Engineer with 4-7 year of experience to join our Data Platform team. This role will report to the Manager of data engineering and be involved in the planning, design, and implementation of our centralized data warehouse solution for ETL, reporting and analytics across all applications within the company. Qualifications : Deep knowledge and experience working with Python/Scala and Apache Spark Experienced in Azure data factory, Azure Data bricks, Azure Blob Storage, Azure Data Lake, Delta lake. Experienced in orchestration tool Apache Airflow . Experience working with SQL and NoSQL database systems such as MongoDB, Apache Parquet Experience with ...

We are seeking a Lead Data Engineer with 9-12 year of experience to join our Data Platform team. This role will report to the Manager of data engineering and be involved in the planning, design, and implementation of our centralized data warehouse solution for ETL, reporting and analytics across all applications within the company. Qualifications: Deep knowledge and experience working with Python/Scala and Spark Experienced in Azure data factory, Azure Data bricks, Azure Data Lake, Blob Storage, Delta Lake, Airflow. Experience working with SQL and NoSQL database systems such as MongoDB, Apache Parquet Experience in distributed system architecture design Experience with AZURE cloud environmen...

We are seeking a Software Engineer with 4-7 year of experience to join our ETL Development team. This role will report to the Manager of data engineering and be involved in the planning, design, and implementation of our centralized data warehouse solution for ETL, reporting and analytics across all applications within the company. Qualifications: Deep knowledge and experience working with SSIS, T-SQL, Azure Databricks, Azure Data Lake, Azure Data Factory,. Experienced in writing SQL objects SP, UDF, Views Experienced in data modeling. Experience working with MS-SQL and NoSQL database systems such as Apache Parquet. Experience in Scala, SparkSQL, Airflow is preferred. Experience with acquiri...