146 Presto Jobs - Page 2

Skill:Data Engineer Notice Period:Immediate. Employment Type: Contract Job Description : Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline Experience in EMR/ EC2, Databricks etc. DWH tools incl. SQL database, Presto, and Snowflake Streaming, Serverless Architecture .

We are looking for a skilled Data Engineer with 4 to 10 years of experience to join our team in Bangalore. The ideal candidate will have expertise in SQL, ETL, data modeling, and programming languages such as Python, C++, C#, Scala, etc. Roles and Responsibility Design, implement, and maintain large-scale data pipelines using ETL tools like Presto, Spark, and MySQL. Develop and optimize data models to support business intelligence and data science applications. Create data visualizations using Power BI and Tableau to provide insights to stakeholders. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure data quality and integrity by implementing robu...

PF Detection is mandatory Job Description: Key Responsibilities: Work on AS400 with expertise in I5250 and Presto for inventory and order fulfillment. Utilize modern RPG techniques including RPG, RPGLE , and Embedded SQL . Design and develop applications using RPG, RPGLE, CL400, and CLLE . Perform database design and development on DB2/400 , ensuring efficient query execution and optimization. Develop and troubleshoot applications using AS400 tools like SDA, RLU, and PDM . Write and optimize complex SQL queries for embedded and interactive sessions. Perform end-to-end unit testing , debug interactive and batch jobs, and ensure seamless functionality of applications. Collaborate directly with...

As a Data Engineer, your role involves designing and implementing scalable data architectures to efficiently store, process, and manage structured and unstructured data. You will be responsible for developing robust data pipelines, integrating disparate data sources, and ensuring high data quality and security across multiple cloud platforms. Key Responsibilities: - Design and implement scalable, cloud-agnostic Data Lake, Data LakeHouse, Data Mesh, and Data Fabric architectures. - Develop and maintain robust data pipelines using services like AWS Glue, Azure Data Factory, GCP Dataflow, Apache Spark, or Apache Airflow. - Optimize Extract, Transform, Load (ETL) processes to integrate disparate...

General Summary: Data Analytics group is responsible for developing, maintaining, and operating automated on-premises and cloud-based solutions for big data pre-labelling, analysis, and visualization. These solutions are utilized by various teams leveraging a diverse technology stack. Team Enrichment, where this position is based, focuses on automated data labelling from our extensive global fleet and creates analytic solutions to address multiple use cases. To enhance our capabilities further, we are seeking a motivated Software Engineer with strong expertise in software engineering and cloud technologies for our Bangalore, India location. Key Responsibilities: Develop and maintain comprehe...

Role Overview: You will join a dynamic team of business and technology experts at Macquarie, collaborating across teams to ingest data and implement essential liquidity calculations on an innovative platform. Your focus will be on delivering a high-performing, robust, and stable solution that meets the needs of internal and external stakeholders. Key Responsibilities: - Use your data engineering and big data skills to build and maintain data services and pipelines with industry best practices - Develop, test, and support data assets, automate testing and delivery, infrastructure optimization, and help maintain code quality and security standards in a DevOps environment - Participate in code ...

Role Overview: As a Strong Data Architect, Lead Data Engineer, Engineering Manager / Director in our company, you will play a crucial role in designing and implementing data engineering systems from the early stages. Your expertise in large data technologies and hands-on tech development will be instrumental in creating scalable and maintainable data architectures. Key Responsibilities: - Possess 10+ years of experience in data engineering roles, with at least 2+ years in a leadership position - Demonstrate 7+ years of hands-on tech development experience with Java (highly preferred) or Python, Node.JS, GoLang - Showcase recent 4+ years of experience with high-growth product startups, specif...

Immediate Joiners are preferrable Position Overview: We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights. Key Responsibilities: Technical Leadership Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery. Drive the adoption of modern data engineering frameworks, tools, and method...

Role Overview: You will be part of the Data Analytics group at Qualcomm India Private Limited, responsible for developing automated solutions for big data pre-labelling, analysis, and visualization. Specifically, you will work within Team Enrichment to enhance data labelling from a global fleet and create analytic solutions to address various use cases. As a Software Engineer, you will contribute to developing end-to-end data autolabelling pipelines and designing tools for scenario identification in the context of Autonomous Driving (AD). Key Responsibilities: - Develop and maintain comprehensive data autolabelling pipelines to support data analysis and visualization. - Design and implement ...

Role Overview: You will be part of the Data Analytics group at Qualcomm India Private Limited, responsible for developing, maintaining, and operating automated on-premises and cloud-based solutions for big data pre-labelling, analysis, and visualization. Your role within Team Enrichment will involve automated data labelling from the global fleet and creating analytic solutions to address various use cases. Your expertise in software engineering and cloud technologies will be crucial for enhancing the team's capabilities. Key Responsibilities: - Develop and maintain end-to-end data autolabelling pipelines. - Design and implement toolchains for automatic identification of critical scenarios. -...

Role Overview: As a Software Engineer (A2) at [Company Name], you will be responsible for designing and developing AI-driven data ingestion frameworks and real-time processing solutions to enhance data analysis and machine learning capabilities. Your role will involve deploying, maintaining, and supporting application codes and machine learning models in production environments, as well as creating and enhancing AI solutions that facilitate seamless integration and flow of data across the data ecosystem. Additionally, you will be conducting business analysis, developing ETL processes, scripts, and machine learning pipelines, and ensuring compliance with data governance policies. Key Responsi...

This is 100% WFO opportunity at our Whitefield, Bengaluru office. Please don't apply if you can't comply. Position Overview: We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights. Key Responsibilities: Technical Leadership Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery. Dri...

As a Software Engineer (A2) at our company, you will be responsible for designing and developing AI-driven data ingestion frameworks and real-time processing solutions to enhance data analysis and machine learning capabilities across the full technology stack. Your key responsibilities will include: - Deploying, maintaining, and supporting application codes and machine learning models in production environments, ensuring seamless integration with front-end and back-end systems. - Creating and enhancing AI solutions that facilitate the seamless integration and flow of data across the data ecosystem, enabling advanced analytics and insights for end users. - Conducting business analysis to gath...

Job Summary: We are seeking a Big Data Administrator with strong expertise in Linux systems, AWS infrastructure, and Big Data technologies. This role is ideal for someone experienced in managing large-scale Hadoop ecosystems in production, with a deep understanding of observability, performance tuning, and automation using tools like Terraform or Ansible. Key Responsibilities: Manage and maintain large-scale Big Data clusters (Cloudera, Hortonworks, or AWS EMR) Develop and support infrastructure as code using Terraform or Ansible Administer Hadoop ecosystem components HDFS, YARN, Hive (Tez, LLAP), Presto, Spark Implement and monitor observability tools like Prometheus, InfluxDB, Dynatrace, G...

Job Summary: We are seeking a Big Data Administrator with strong expertise in Linux systems, AWS infrastructure, and Big Data technologies. This role is ideal for someone experienced in managing large-scale Hadoop ecosystems in production, with a deep understanding of observability, performance tuning, and automation using tools like Terraform or Ansible. Key Responsibilities: Manage and maintain large-scale Big Data clusters (Cloudera, Hortonworks, or AWS EMR) Develop and support infrastructure as code using Terraform or Ansible Administer Hadoop ecosystem components HDFS, YARN, Hive (Tez, LLAP), Presto, Spark Implement and monitor observability tools like Prometheus, InfluxDB, Dynatrace, G...

Job Summary: We are seeking a Big Data Administrator with strong expertise in Linux systems, AWS infrastructure, and Big Data technologies. This role is ideal for someone experienced in managing large-scale Hadoop ecosystems in production, with a deep understanding of observability, performance tuning, and automation using tools like Terraform or Ansible. Key Responsibilities: Manage and maintain large-scale Big Data clusters (Cloudera, Hortonworks, or AWS EMR) Develop and support infrastructure as code using Terraform or Ansible Administer Hadoop ecosystem components HDFS, YARN, Hive (Tez, LLAP), Presto, Spark Implement and monitor observability tools like Prometheus, InfluxDB, Dynatrace, G...

Position Overview: We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights. Key Responsibilities: Technical Leadership Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery. Drive the adoption of modern data engineering frameworks, tools, and methodologies to ensure high-quality and...

Sr Starburst Architect to get the WLT instance that is being procured up and running and providing hands-on optimization for the environments. Good understanding of Jira/Confluence and GitHub Strong troubleshooting and problem-solving skills Strong written, verbal communication/collaboration skills and ability to manage user/vendor/ customer and to work with cross functional teams Collaborate with multiple stakeholders for tech solutioning and bottlenecks removal Ability to assess the impact of production issues & escalate to relevant technology partners and get it resolved at the earliest during extremely time critical regulatory commitments Ability to operate with a limited level of direct...

As a Senior Architect - Data & Cloud at our company, you will be responsible for architecting, designing, and implementing end-to-end data pipelines and data integration solutions for varied structured and unstructured data sources and targets. You will need to have more than 15 years of experience in Technical, Solutioning, and Analytical roles, with 5+ years specifically in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration, and Business Intelligence/Artificial Intelligence solutions on Cloud platforms like GCP, AWS, or Azure. Key Responsibilities: - Translate business requirements into functional and non-functional areas, defining boundaries in terms of Ava...

Role Overview: As a Principal Architect - Data & Cloud at Quantiphi, you will be responsible for leveraging your extensive experience in technical, solutioning, and analytical roles to architect and design end-to-end data pipelines and data integration solutions for structured and unstructured data sources and targets. You will play a crucial role in building and managing data lakes, data warehouses, data integration, and business intelligence/artificial intelligence solutions on Cloud platforms like GCP, AWS, and Azure. Your expertise will be instrumental in designing scalable data warehouse solutions on Big Query or Redshift and working with various data integration, storage, and pipeline ...

We have developed API gateway aggregators using frameworks like Hystrix and spring-cloud-gateway for circuit breaking and parallel processing. Our serving microservices handle more than 15K RPS on normal days and during saledays this can go to 30K RPS. Being a consumer app, these systems have SLAs of ~10ms Our distributed scheduler tracks more than 50 million shipments periodically fromdifferent partners and does async processing involving RDBMS. We use an in-house video streaming platform to support a wide variety of devices and networks. What Youll Do Design and implement scalable and fault-tolerant data pipelines (batch and streaming) using frameworks like Apache Spark , Flink , and Kafka...

As a passionate Software Engineer with a proven track record of solving complex problems and driving innovation, you will have the opportunity to work at ReliaQuest and be part of a team that is reshaping the future of threat detection and response. Your role will involve developing cutting-edge security technology, creating REST APIs, and integrating various products to enhance our customers" threat detection capabilities. By working closely with talented individuals, you will contribute directly to the growth and success of our organization. Your responsibilities will include researching and developing solutions across a range of advanced technologies, managing deployment processes, conduc...

Experience in Big Data technologies, specifically Spark, Python, Hive, SQL, Presto (or other query engines), big data storage formats (e.g., Parquet), orchestration tools (e.g., Apache Airflow) and version control (e.g. Bitbucket) Proficiency in developing configuration-based ETL pipelines and user-interface driven tools to optimize data processes and calculations (e.g., Dataiku). Experience in analysing business requirements, solution design, including the design of data models, data pipelines, and calculations, as well as presenting solution options and recommendations. Experience working in a cloud-based environment (ideally AWS), with a solid understanding of cloud computing concepts (EC...

Strong technical acumen in AWS including expert working knowledge of AWS services such as Glue, ,EC2, ECS, Lamda, Step Functions, IAM, Athena, HUE, Presto, S3, Redshift etc. Strong technical acumen in Data Engineering enablement, and working knowledge of frameworks/languages such as Python, SPARK etc. Dremino knowledge is a plus.

You have a great opportunity to join Everest DX, a Digital Platform Services company headquartered in Stamford. Our vision is to enable Digital Transformation for enterprises by delivering seamless customer experience, business efficiency, and actionable insights through an integrated set of futuristic digital technologies. As a Data Engineer with a minimum of 6+ years of experience, you will be responsible for SQL optimization and performance tuning. You should have hands-on development experience in programming languages like Python, PySpark, Scala, etc. Additionally, you should possess at least 6+ years of cloud data engineering experience in Azure. Your role will involve working with Azu...