265 Parquet Jobs - Page 7

As an Advisory Consultant at Dell Technologies, you will play a crucial role in delivering consultative business and technical services for complex customer-facing consulting engagements related to digital transformation. Your responsibilities will involve collaborating with Global Pre-Sales, Account Management, and Solutioning Teams to deploy, administer, and configure digital transformation software stacks. Being one of the senior technical members in the Digital Transformation Practice, you will earn customer trust through competence, technical acumen, consulting expertise, and partnership. You will guide and oversee other team members, providing technical grooming activities for their sk...

Your Team Responsibilities Our team is responsible for building and maintaining the Fund ESG Ratings platform, a business-critical component that powers MSCIs ESG offerings at the fund level. We manage the end-to-end lifecycle of fund-level ESG datafrom ingestion, transformation, and scoring, to final delivery to internal consumers and external clients. Key Responsibilities Of The Team Include Designing scalable data pipelines using Databricks, PySpark, and BigQuery. Supporting regulatory-compliant ESG scoring and reporting logic. Partnering with ESG Research and Index teams to translate methodology changes into platform features. Ensuring data quality, platform stability, and SLA adherence....

Role Summary We are seeking a Senior Full Stack Engineer to lead design and development of a cloud-native data platform (cfapp). The platform ingests large datasets, applies complex transformation rules, and integrates with marketplaces and SaaS systems. You will work across backend services, frontend applications, AWS infrastructure, and production deployment. Responsibilities • Architect and implement backend services using Python (FastAPI) and integrate with Rust/Polars for high-performance data processing. • Develop and maintain frontend dashboards and rule editors using SolidJS/React, TypeScript, TailwindCSS. • Orchestrate AWS infrastructure: S3 (transfer acceleration, presigned uploads...

About the Role We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms that empower data-driven decision-making. This role requires deep technical expertise in modern data engineering frameworks, architectural patterns, and cloud-native solutions on AWS. You will be a key contributor to our data strategy, ensuring data quality, governance, and reliability while mentoring other engineers in the team. Key Responsibilities Design, develop, and own robust, scalable, and maintainable data pipelines (batch & real-time). Architect and implement Data Lake, Data Warehouse, and Lakehouse solutions using modern frameworks and architectural patterns. E...

As a Data Engineering Senior Specialist (Databricks) at Nasdaq Bangalore, you will have the opportunity to be part of a team that is at the forefront of revolutionizing markets and developing innovative solutions. Your role will involve working closely with defined business requirements to provide analytical, modelling, dimensional modeling, and testing to design optimal solutions. You will play a key role in translating business information needs into adaptable and sustainable data structures. Your primary responsibilities will include designing, building, and maintaining data pipelines within the Databricks Lakehouse Platform. Your expertise in tasks such as utilizing the Databricks Lakeho...

Description: 1. Data engineer with 6+ years of hands on experience working on Big Data Platforms 2. Experience building and optimizing Big data data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization. 3. Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and steaming data processing 4. Good experience in any one programming language -Scala/Python , Python preferred. 5. Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins,Views etc 6. Experience in using Kafka or any other message brokers 7. Configuring, monitoring and scheduling of jobs usin...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Palantir Foundry Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Project Role :Lead Data Engineer Project Role Description :Design, build and enhance applications to meet business process and requirements in Palantir foundry.Work experience :Minimum 6 years Must have Skills :Palantir Foundry , PySparkGood to Have Skills :Experience in Pyspark, python and SQLKnowledge on Big Data tools & TechnologiesOrganizational and project ...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Palantir Foundry Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Project Role :Lead Data Engineer Project Role Description :Design, build and enhance applications to meet business process and requirements in Palantir foundry.Work experience :Minimum 6 years Must have Skills :Palantir Foundry , PySparkGood to Have Skills :Experience in Pyspark, python and SQLKnowledge on Big Data tools & TechnologiesOrganizational and project ...

BASIC FUNCTIONS: This position performs moderately difficult research, design, and software development assignments within a specific software functional area or product line. The position should have the ability to work on individual pieces of work and solve problems including the design of the program flow of individual pieces of code, effective coding, and unit testing. QUALIFICATIONS: . 3+ years of Software Engineering experience . BS Engineering/Computer Science or equivalent experience required TECHNICAL SKILLS: . Proficiency with data manipulation languages. . Understanding of data modeling principles. . Ability to work with complex data models. .Proficiency in development languages a...

Java + AI/ML role required with at least 6+ years of industry experience on Java, Spring Boot, Spring Data & at least 2 years of AI/ML project professional experience. Strong experience in building and consuming REST APIs and asynchronous messaging (Kafka/RabbitMQ). Working experience in integrating AI/ML models into Java services or calling external ML endpoints (REST/gRPC). Understanding of ML lifecycle: training, validation, inference, monitoring, and retraining. Familiarity with tools like TensorFlow, PyTorch, Scikit-Learn, or ONNX. Prior experience in domain-specific ML implementations (e.g., fraud detection, recommendation systems, NLP chatbots) Experience working with data formats lik...

As a Data Engineer at Tata Electronics Private Limited (TEPL), you will play a crucial role in architecting and implementing scalable offline data pipelines for manufacturing systems, ensuring the smooth functioning of various components such as AMHS, MES, SCADA, PLCs, vision systems, and sensor data. Your expertise in designing and optimizing ETL/ELT workflows using tools like Python, Spark, SQL, and Airflow will be instrumental in transforming raw data into actionable insights. You will lead database design and performance tuning activities across SQL and NoSQL systems, optimizing schema design, queries, and indexing strategies to enhance the efficiency of manufacturing data processing. Yo...

As one of the world's leading asset managers, Invesco is dedicated to helping investors worldwide achieve their financial objectives. By delivering the combined power of our distinctive investment management capabilities, we provide a wide range of investment strategies and vehicles to our clients around the world. If you're looking for challenging work, smart colleagues, and a global employer with a social conscience, come explore your potential at Invesco. Make a difference every day! You will be serving as a subject matter expert (SME), thought leader, and technical strategy driver for the business capability/product. Your responsibilities will include interfacing with the business to det...

Location: Remote Employment Type: Full-time Shift time: 4:30PM - 1:30AM IST Experience Required: 8+ years in Data Engineering, with strong expertise in DBT About the Role: We are seeking a Senior Data Engineer with deep experience in DBT (Data Build Tool) to join our data team. You will be responsible for building scalable and maintainable data pipelines, transforming raw data into actionable insights, and helping shape the future of our data architecture and governance practices. Key Responsibilities: ? Design, develop, and maintain data pipelines using DBT, SQL, and orchestration tools like Airflow or Prefect ? Collaborate with data analysts, scientists, and stakeholders to understand data...

Summary: We are seeking a highly skilled and experienced Snowflake Database Administrator (DBA) to join our team. The ideal candidate will be responsible for the administration, management, and optimization of our Snowflake data platform. The role requires strong expertise in database design, performance tuning, security, and data governance within the Snowflake environment. Key Responsibilities: Administer and manage Snowflake cloud data warehouse environments, including provisioning, configuration, monitoring, and maintenance. Implement security policies, compliance, and access controls. Manage Snowflake accounts and databases in a multi-tenant environment. Monitor the systems and provide ...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Palantir Foundry Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Project Role :Lead Data Engineer Project Role Description :Design, build and enhance applications to meet business process and requirements in Palantir foundry.Work experience :Minimum 6 years Must have Skills :Palantir Foundry , PySparkGood to Have Skills :Experience in Pyspark, python and SQLKnowledge on Big Data tools & TechnologiesOrganizational and project management expe...

We are looking for a highly skilled Scala Data Engineer to design, build, and optimize large-scale data platforms. The ideal candidate will have deep expertise in Scala, Spark, and SQL, with proven experience delivering scalable and high-performance data solutions in cloud-native environments. Key Responsibilities Design, build, and optimize scalable data pipelines using Apache Spark and Scala. Develop real-time streaming pipelines leveraging Kafka/Event Hubs. Own the design and architecture of data systems with a strong focus on performance, scalability, and reliability. Collaborate with cross-functional teams to deliver high-quality data products. Mentor junior engineers and enforce best p...

Work Level : Individual Core : Communication Skills, Result Driven Leadership : Team Alignment Industry Type : IoTEmerging Technologies Function : Full Stack Developer Key Skills : Node JS,Angular,React JS,AWS,Aws Glue,Python,Lambda Education : Graduate Note: This is a requirement for one of the Workassist Hiring Partner. About the Role: We are looking for a highly motivated and experienced Senior Software Engineer with strong backend expertise in Node.js, frontend development experience in Angular or React, and a solid understanding of Python and IoT systems. You will be responsible for designing, developing, and maintaining scalable applications and backend services that interface with IoT...

Work Level : Individual Core : Communication Skills, Result Driven Leadership : Team Alignment Industry Type : IoTEmerging Technologies Function : Full Stack Developer Key Skills : Node JS,Angular,React JS,AWS,Aws Glue,Python,Lambda Education : Graduate Note: This is a requirement for one of the Workassist Hiring Partner. About the Role: We are looking for a highly motivated and experienced Senior Software Engineer with strong backend expertise in Node.js, frontend development experience in Angular or React, and a solid understanding of Python and IoT systems. You will be responsible for designing, developing, and maintaining scalable applications and backend services that interface with IoT...

Who You&aposll Work With Driving lasting impact and building long-term capabilities with our clients is not easy work. You are the kind of person who thrives in a high performance/high reward culture - doing hard things, picking yourself up when you stumble, and having the resilience to try another way forward. In return for your drive, determination, and curiosity, we&aposll provide the resources, mentorship, and opportunities you need to become a stronger leader faster than you ever thought possible. Your colleaguesat all levelswill invest deeply in your development, just as much as they invest in delivering exceptional results for clients. Every day, you&aposll receive apprenticeship, coa...

Optimizing or even re-designing data pipelines to support the modernization of data platform Design and build scalable and reliable data pipelines with the latest tech stack. Facilitate real-life actionable use cases leveraging our data with a user- and product-oriented mindset. Support teams without data engineers with building decentralized data solutions and product integrations. Conceptualize, design and implement improvements to ETL processes and data through independent communication with data-savvy stakeholders. Designing, building, and operating a Data Lake or Data Warehouse. Knowledge to ingest, cleanse, transform and load data from varied data sources in the above Azure Services (D...

About us -Coders Brain is a global leader in its services, digital and business solutions that partners with its clients to simplify, strengthen and transform their businesses. We ensure the highest levels of certainty and satisfaction through a deep-set commitment to our clients, comprehensive industry expertise and a global network of innovation and delivery centers. We achieved our success because of how successfully we integrate with our clients. Quick Implementation - We offer quick implementation for the new onboarding client. Experienced Team - We've built an elite and diverse team that brings its unique blend of talent, expertise, and experience to make you more successful, ensuring ...

Role Description Role Description: Senior Scala Data Engineer Scala Data Engineer needs to be able to understand existing code and help refactor, and migrate into new environment. Role and responsibilities * Read existing scala spark code. * Create unit tests for scala spark code * Enhance and Write scala spark code. * Proficient in working with S3 file with csv and parquet format. * Proficient in working with mongodb. Building up environments independently to test assigned work, Execute manual and automated tests. Experience with enterprise tools, like Git, Azure, TFS. Experience with JIRA or similar defect tracking tool. Engage and participate on an Agile team of a world-class software dev...

You should have a Bachelors Degree in Computer Science, Computer Engineering or related technical field, while a Masters Degree or other advanced degree is preferred. With 4-6+ years of total experience, you should possess at least 2+ years of relevant experience in Big Data platforms. Your skill set should include strong analytical, problem solving, and communication/articulation skills. Furthermore, you are expected to have 3+ years of experience with big data and the Hadoop ecosystem, including Spark, HDFS, Hive, Sqoop, Hudi, Parquet, Apache Nifi, and Kafka. Proficiency in Scala/Spark is required, and knowledge of Python is considered a plus. Hands-on experience with Oracle and MS-SQL dat...

The Applications Development Sr Programmer Analyst will work in the Information Management team of Services Technologies, focusing on Big Data and public cloud adoption projects. This intermediate-level position involves participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The primary objective is to contribute to applications systems analysis and programming activities. Responsibilities: - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems an...

As a software developer, you will be working in a constantly evolving environment driven by technological advances and the strategic direction of the organization you are employed by. Your primary responsibilities will include creating, maintaining, auditing, and enhancing systems to meet specific needs, often based on recommendations from systems analysts or architects. You will be tasked with testing both hardware and software systems to identify and resolve system faults. Additionally, you will be involved in writing diagnostic programs and designing and developing code for operating systems and software to ensure optimal efficiency. In situations where necessary, you will also provide re...