454 Impala Jobs - Page 2

Role & responsibilities Role : Pyspark Developer Location: Bangalore, Chennai, Pune, Hyderabad, Gurugram Date of Interview: 30th Oct, 2025 Time of Interview: 10:00 AM to 4:00 PM Job Description: Overall 5+ years of experience in Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQS Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good Spark, Pyspark, Big Data experience Spark UI/Optimization/debugging techniques Good python scripting skills Intermediate SQL exposure Subquery, Joins, CTEs Database technologies AWS EMR, S3, IAM, Lambda, SNS, SQS

Big data engineer/Developer Spark-Scala HQL, Hive Control-m Jinkins Git Technical analysis and up to some extent business analysis (knowledge about banking products, credit cards and its transactions) Notice Period: Immediate . Employment Type: Contract

Notice Period: Immediate Joiners Job Description: Must have skills Azure DataBricks, Python And Pyspark, Spark. Please find the JD In the mail chain Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on experience in Azure Databricks , Data Factory, Data Lake store/Blob storage, SQL DB Experience in creating Big data Pipelines with Azure components Hands on programing with Python Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming Experience with messaging systems, such as Kafka or RabbitMQ Good understanding of...

Strong programming skills in Python programming and advance SQL. strong experience in NumPy, Pandas, Data frames Strong analytical and problem-solving skills. Excellent communication and collaboration abilities.

About The Role Project Role Data Engineer Project Role Description Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills Google BigQuery Good to have skills Impala Minimum 5 year(s) of experience is required Educational Qualification 15 years full time education Summary As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementin...

As a Development Lead in the Risk Decisioning Systems (RDS) Team at Barclays, you play a crucial role in building and maintaining systems that collect, store, process, and analyze data to ensure accuracy, accessibility, and security. Your responsibilities include: - Build and maintenance of data architectures pipelines that facilitate the transfer and processing of durable, complete, and consistent data. - Design, develop, and test complex ETL components utilizing skills in Databricks, Cloud Data technologies, Python, Spark, Ab Initio, SQL, Big Data (Hadoop, Hive, Impala) and other relevant technical skills. - Design and implement data warehouses and data lakes that manage appropriate data v...

**Job Description:** As a C14 (People Manager) in the Financial Crimes & Fraud Prevention Analytics Model Development team at Citi Analytics & Information Management (AIM) based in Pune, India, you will play a crucial role in leading a team of 15+ data scientists. Your primary responsibility will be to oversee the successful development and implementation of Machine Learning (ML), Artificial Intelligence (AI), and Generative AI models on various platforms to mitigate fraud losses and minimize customer impact. You will work closely with the model implementation team, ensure model documentation, and address questions from model risk management (MRM) while adapting to business needs. Additional...

What you'll do Develop, maintain, and enhance new data sources and tables, contributing to data engineering efforts to ensure comprehensive and efficient data architecture. Serves as the liaison between Data Engineer team and the Airport operation teams, developing new data sources and overseeing enhancements to existing database; being one of the main contact points for data requests, metadata, and statistical analysis Migrates all existing Hive Metastore tables to Unity Catalog, addressing access issues and ensuring smooth transition of jobs and tables. Collaborate with IT teams to validate package (gold level data) table outputs during the production deployment of developed notebooks Deve...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

The opportunity Were looking for Manager Snowflake & Databrick with Big Data or Pyspark with expertise in Financial Services domain hand-on experience with Big data ecosystem. Primary skills and key responsibilities Design and implement scalable and high-performance data warehouse solutions using snowflake. Design and implement scalable data architecture using PySpark. Core technical stackSnowflake, Python/PySpark, SQL, identity/security (SAML/OAuth/OIDC, MFA, RBAC), and often Kubernetes/Docker for deployment patterns. Should have strong technical expertise in Neo4j. Data architecture depthData modelling, data integration/ETL, batch and streaming pipelines, data quality/profiling/cleansing, ...

Hands On with advanced SQL, Python etc. Hands On in data profiling Hands On in working on Cloud like Azure and Cloud DW like Databricks Hands On experience on Scheduling tools like Airflow, Control M etc. Knowledgeable on Big Data tools like Spark (python/scala), Hive, Impala, Hue and storage (e.g. HDFS, HBase) Knowledgeable in CICD processes Bitbucket/GitHub, Jenkins, Nexus etc. Knowledgeable managing structured and unstructured data types

Our Purpose Title and Summary Consultant, Advisors & Consulting Services, Performance Analytics Consultant Performance Analytics Advisors & Consulting Services Services within Mastercard is responsible for acquiring, engaging, and retaining customers by managing fraud and risk, enhancing cybersecurity, and improving the digital payments experience. We provide value-added services and leverage expertise, data-driven insights, and execution. Our Advisors & Consulting Services team combines traditional management consulting with Mastercards rich data assets, proprietary platforms, and technologies to provide clients with powerful strategic insights and recommendations. Our teams work with a div...

As a Big Data Architect, you will be responsible for designing and implementing scalable and reliable big data solutions. Your key responsibilities will include: - Demonstrating proficiency in Spark, Scala, Hadoop MapReduce/HDFS, PIG, HIVE, and AWS cloud computing. - Utilizing hands-on experience with tools such as EMR, EC2, Pentaho BI, Impala, ElasticSearch, Apache Kafka, Node.js, Redis, Logstash, statsD, Ganglia, Zeppelin, Hue, and KETTLE. - Sound expertise in Machine learning, Zookeeper, Bootstrap.js, Apache Flume, FluentD, Collectd, Sqoop, Presto, Tableau, R, GROK, MongoDB, Apache Storm, and HBASE. - Hands-on experience in Core Java & Advanced Java development. To qualify for this role, ...

Essential for this role: Education and Qualifications: • Bachelor’s degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent. • Minimum seven plus years of experience in data analytics field • Experience with Azure/AWS Databricks • Experience in building and optimizing data pipelines, architectures and data sets • Excellent experience in Scala or Python, PySpark and SQL • Ability to troubleshoot and optimize complex queries on the Spark platform • Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques • Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS • Hands on...

Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implement version control an...

Role & responsibilities Product Development /Project Management Conceptualisation, Development, Market Research Portfolio Management New Customer / Existing Customer Identify avenues for customer relationship deepening and prepare propositions / strategies Explore and implement alternate channel avenues for customer onboarding Preparing training materails for internal / external customers and conducting in house trainings Co-ordinating with internal / external stakeholders Ensuring compliance with regulatory guidelines and timely/accurate regulatory reportings Preparing MIS, portfolio analysis, profitability analysis, senior management review decks Develop business plans specific to product ...

Key Responsibilities: Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implem...

Location Chennai and Hyderbad preferred but customer is willing to take resources from Hyderabad Experience 5 to 8 yrs ( U3 ). Exp - 5- 10 Yrs Location - Hyderabad / Chennai Location Proven experience as a development data engineer or similar role, with ETL background. Experience with data integration / ETL best practices and data quality principles. Play a crucial role in ensuring the quality and reliability of the data by designing, implementing, and executing comprehensive testing. By going over the User Stories build the comprehensive code base and business rules for testing and validation of the data. Knowledge of continuous integration and continuous deployment (CI/CD) pipelines. Famil...

Description Detailed JD RTIM Pega CDH 8.8 Multi App Infinity 24.1 Java Restful API oAuth 1. Understanding the NBA requirements and the complete CDH architecture 2. Review of the Conceptual Design Detailed Design and estimations. 3. Reviewing and contributing to the deployment activities and practices 4. Contributing to overall technical solution and putting it to practise. 5. Contributing to the requirement discussion with the Subject matter expertise in relation to Pega CDH 6. Experience in Pega CDH v8.8 multi app or 24.1 and retail banking domain is preferred. 7. Conducting peer code reviews 8. Excellent communications skills Named Job Posting? (if Yes - needs to be approved by SCSC) Addit...

Overview: Associate Managing Consultant Performance Analytics Advisors & Consulting Services Services within Mastercard is responsible for acquiring, engaging, and retaining customers by managing fraud and risk, enhancing cybersecurity, and improving the digital payments experience. We provide value-added services and leverage expertise, data-driven insights, and execution. Our Advisors & Consulting Services team combines traditional management consulting with Mastercards rich data assets, proprietary platforms, and technologies to provide clients with powerful strategic insights and recommendations. Our teams work with a diverse global customer base across industries, from banking and payme...

What you'll do Develop, maintain, and enhance new data sources and tables, contributing to data engineering efforts to ensure comprehensive and efficient data architecture. Serves as the liaison between Data Engineer team and the Airport operation teams, developing new data sources and overseeing enhancements to existing database; being one of the main contact points for data requests, metadata, and statistical analysis Migrates all existing Hive Metastore tables to Unity Catalog, addressing access issues and ensuring smooth transition of jobs and tables. Collaborate with IT teams to validate package (gold level data) table outputs during the production deployment of developed notebooks Deve...

About The Role Project Role : Infra Tech Support Practitioner Project Role Description : Provide ongoing technical support and maintenance of production and development systems and software products (both remote and onsite) and for configured services running on various platforms (operating within a defined operating model and processes). Provide hardware/software support and implement technology at the operating system-level across all server and network areas, and for particular software solutions/vendors/brands. Work includes L1 and L2/ basic and intermediate level troubleshooting. Must have skills : Linux Good to have skills : Red Hat OS Administration Minimum 7.5 year(s) of experience i...

About The Role Project Role : Infra Tech Support Practitioner Project Role Description : Provide ongoing technical support and maintenance of production and development systems and software products (both remote and onsite) and for configured services running on various platforms (operating within a defined operating model and processes). Provide hardware/software support and implement technology at the operating system-level across all server and network areas, and for particular software solutions/vendors/brands. Work includes L1 and L2/ basic and intermediate level troubleshooting. Must have skills : Linux Operations Good to have skills : Red Hat OS Administration Minimum 5 year(s) of exp...

1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks 2 Ensure data pipelines run smoothly and efficiently 3 Developing scalable and re-usable frameworks for ingesting of data sets 4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times 5 Working with event based / streaming technologies to ingest and process data 6 Working with other members of the project team to support delivery of additional project components (API interfaces, Search) 7 Evaluating the performance and applicability of multiple tools against customer requirem...

As an Applications Development Technology Lead Analyst at our company, your role involves establishing and implementing new or revised application systems and programs in coordination with the Technology team. Your main objective will be to develop and lead applications systems analysis and programming activities. **Responsibilities:** - Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements - Resolve a variety of high-impact problems/projects through an in-depth evaluation of complex business processes, system processes, and industry stand...