14139 Data Engineering Jobs - Page 20

Qualifications Education and Experience Bachelors or Masters degree in Computer Science, Data Engineering, Information Systems, or a related field. 3+ years of experience as a Data Engineer, with a strong focus on PySpark and the Cloudera Data Platform. Technical Skills PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques. Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase. Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala). Big Data Technologies: Familiarity...

Role & responsibilities Title : Senior Data Engineer - Snowflake Description : Illumifin is transforming its technology by enabling cloud technologies and redefining our data strategy to include Snowflake for data warehousing, leading edge business intelligence solutions. We are looking for a data engineer who is excited by data, understands how to derive business intelligence from data, and has experience working on cloud technologies. If you are looking for an opportunity to transform a data landscape, build effective data governance and implement leading data technologies then you are the candidate we are looking for. Primary Responsibilities: Development (Approximately 70%) Implement, an...

Location: Mumbai Reports to: Tech Team Lead About the Role We are looking for a Software Developer/Data Scientist to join our Data Services team, specializing in delivering custom client-ready reports and managing data corrections. This role requires strong technical skills in Python, SQL, and Excel, combined with experience in AWS cloud services such as Athena and Aurora. You will play a key role in ensuring clients receive high-quality, tailored data outputs and that corrections are handled efficiently through automated tools and processes. Key Responsibilities • Work on Client Platforms with Data Services Core team to Prepare custom Level 3 client reports based on specific requirements an...

We are seeking an experienced Lead Engineer with strong expertise in Spark, Scala, GCP, Python/PySpark, Shell Scripting and SQL to build and optimize large-scale data solutions in a cloud environment. • 8+ years of experience in Big Data and Data Engineering. • Strong hands-on expertise in Apache Spark (batch & streaming). • Proficiency in Scala, Python/PySpark, and Shell scripting. • Solid experience with GCP services (BigQuery, Dataproc, Airflow, etc.). • Advanced knowledge of Spark-SQL and SQL. • Understanding of distributed systems and performance optimization. Roles and Responsibilities • Design and develop scalable data pipelines using Apache Spark and PySpark. • Implement data process...

We are seeking an experienced Lead Engineer with strong expertise in Spark, Scala, GCP, Python/PySpark, Shell Scripting and SQL to build and optimize large-scale data solutions in a cloud environment. • 8+ years of experience in Big Data and Data Engineering. • Strong hands-on expertise in Apache Spark (batch & streaming). • Proficiency in Scala, Python/PySpark, and Shell scripting. • Solid experience with GCP services (BigQuery, Dataproc, Airflow, etc.). • Advanced knowledge of Spark-SQL and SQL. • Understanding of distributed systems and performance optimization. Roles and Responsibilities • Design and develop scalable data pipelines using Apache Spark and PySpark. • Implement data process...

AWS Data Engineer 8+Yrs Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Immediate Joinee.

AWS Data Engineer 8+Yrs Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Immediate Joinee.

Position Description: We are seeking a high-caliber, initiative-driven Senior AI professional to lead and accelerate AI initiatives across our Business Unit This role demands a highly versatile individual who can ideate, architect, prototype, and deliver AI solutions and IPs while working hands-on with cross-functional teams The ideal candidate is a self-starter who thrives in dynamic environments, communicates exceptionally well, and can translate business vision into scalable AI outcomes Experience Requirements 7 years to 15 years overall experience in technology, with 5+ years in AI/ML, GenAI, or Data Science Proven experience in designing, building, and deploying AI solutions/POCs/produc...

AWS Data Engineer 8+Yrs Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Immediate Joinee.

AWS Data Engineer 8+Yrs Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Immediate Joinee.

AWS Data Engineer 8+Yrs Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Immediate Joinee.

AWS Data Engineer 8+Yrs Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Immediate Joinee.

Join our data engineering team to build scalable data pipelines and infrastructure We're looking for experienced professionals with expertise in distributed systems, cloud platforms, and big data technologies You'll work with cutting-edge tools to process and analyze massive datasets, collaborate with cross-functional teams, and help drive our data strategy forward Experience with Angular 6+ (preferred) as the product is being built with Angular If you know any other framework such as ReactJS, VueJS open to learn/switch to others when needed Benefits include performance-based bonus and stock options

We are looking for a skilled Data Engineer with expertise in Snowflake and ETL processes to build, maintain, and troubleshoot data pipelines that support research data services. This role ensures that data infrastructure is robust, scalable, and delivers accurate and timely data to end users. Essential skills 5+ years of experience in data engineering or ETL development. Strong experience in developing and debugging ETL pipelines using Python. Hands-on expertise in Databricks for data processing and workflow orchestration. Proficiency in SQL for complex queries, transformations, and performance tuning. Deep knowledge of Snowflake for data loading, modeling, and optimization. Ability to test,...

AWS Data Engineer 8+Yrs Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Immediate Joinee.

We are looking for AWS Data Engineer Main Skills: Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Required Skills: 6-9 years of experience in Data Engineering Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data Creation of necessary infrastructure for ETL jobs from a wide range of data sources using, S3, Snowflake and AWS data services Experience in Data storage technologies like Amazon S3, SQL, NoSQL Hands on experience in writing complex SQL. Hands on experience in developing pipelines using AWS data services like Glue, Lambda Develop, manage, and optimize data pipelines using AWS Glue and PySpark. Hands on experience in Opti...

We are looking for AWS Data Engineer Main Skills: Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Required Skills: 6-9 years of experience in Data Engineering Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data Creation of necessary infrastructure for ETL jobs from a wide range of data sources using, S3, Snowflake and AWS data services Experience in Data storage technologies like Amazon S3, SQL, NoSQL Hands on experience in writing complex SQL. Hands on experience in developing pipelines using AWS data services like Glue, Lambda Develop, manage, and optimize data pipelines using AWS Glue and PySpark. Hands on experience in Opti...

We are looking for AWS Data Engineer Main Skills: Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Required Skills: 6-9 years of experience in Data Engineering Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data Creation of necessary infrastructure for ETL jobs from a wide range of data sources using, S3, Snowflake and AWS data services Experience in Data storage technologies like Amazon S3, SQL, NoSQL Hands on experience in writing complex SQL. Hands on experience in developing pipelines using AWS data services like Glue, Lambda Develop, manage, and optimize data pipelines using AWS Glue and PySpark. Hands on experience in Opti...

We are looking for AWS Data Engineer Main Skills: Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Required Skills: 6-9 years of experience in Data Engineering Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data Creation of necessary infrastructure for ETL jobs from a wide range of data sources using, S3, Snowflake and AWS data services Experience in Data storage technologies like Amazon S3, SQL, NoSQL Hands on experience in writing complex SQL. Hands on experience in developing pipelines using AWS data services like Glue, Lambda Develop, manage, and optimize data pipelines using AWS Glue and PySpark. Hands on experience in Opti...

We are looking for AWS Data Engineer Main Skills: Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Required Skills: 6-9 years of experience in Data Engineering Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data Creation of necessary infrastructure for ETL jobs from a wide range of data sources using, S3, Snowflake and AWS data services Experience in Data storage technologies like Amazon S3, SQL, NoSQL Hands on experience in writing complex SQL. Hands on experience in developing pipelines using AWS data services like Glue, Lambda Develop, manage, and optimize data pipelines using AWS Glue and PySpark. Hands on experience in Opti...

We are looking for AWS Data Engineer Main Skills: Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Required Skills: 6-9 years of experience in Data Engineering Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data Creation of necessary infrastructure for ETL jobs from a wide range of data sources using, S3, Snowflake and AWS data services Experience in Data storage technologies like Amazon S3, SQL, NoSQL Hands on experience in writing complex SQL. Hands on experience in developing pipelines using AWS data services like Glue, Lambda Develop, manage, and optimize data pipelines using AWS Glue and PySpark. Hands on experience in Opti...

We are looking for AWS Data Engineer Main Skills: Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS Required Skills: 6-9 years of experience in Data Engineering Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data Creation of necessary infrastructure for ETL jobs from a wide range of data sources using, S3, Snowflake and AWS data services Experience in Data storage technologies like Amazon S3, SQL, NoSQL Hands on experience in writing complex SQL. Hands on experience in developing pipelines using AWS data services like Glue, Lambda Develop, manage, and optimize data pipelines using AWS Glue and PySpark. Hands on experience in Opti...

Job Title : Data Scientist / Data Engineering Experience Range: 6-8 Years Job Description : Data Scientist with GCP Knowledge Role & responsibilities AWS Data Scientist with exposure on developing AI/ML models using AWS Bedrock, implementation of any Telecom use cases will be a plus. Write a function using pandas to calculate: 1. The call drop rate. 2. Return a DataFrame with columns 'user_id' and 'drop_rate', sorted by highest drop rate Essential skills - Data Science~Digital : Google Cloud~Digital : Google Data Engineering

Job Title : Senior Databricks Developer Position : SSE / LA Experience : 5 to 10 years of experience Category : Software Development Work Type : Hybrid Employment Type : Full Time / Permanent Qualification : Bachelors or Masters degree in Computer Science, Engineering, or a related field. Role Summary Databricks with strong data engineering skills and deep AWS cloud expertise. To lead the design, build, and deployment of data products on the Databricks Lakehouse platform, ensuring scalability, governance, security, and business value delivery. The role requires mastery in Databricks features, Delta Lake, AWS ecosystem integration, and modern Data Engineering best practices. Primary Responsib...

Role Overview The Senior Software Engineer will be part of an agile development team working on cutting-edge internal actuarial solutions. The role involves full-stack development with a strong focus on Node.js, React, and AWS cloud technologies, supporting both cloud-native and legacy on-premise applications undergoing migration. Must-Have Skills Node.js (Backend development) AWS Cloud Services (Step Functions, AWS Batch, Lambda, ECS/Fargate) React.js (Frontend development) or Data Engineering exposure API-based application development Terraform and CI/CD tools (Jenkins / GitHub Actions) SQL & NoSQL databases Docker / Linux Containers and container orchestration Test-Driven Development (TDD...