2084 Data Engineer Jobs - Page 11

AWS Data Engineer + PySpark - Job Description AWS Data Engineer + PySpark Experience: 5-8 Years Location: Pune Job Function: Technology Role: Engineer Key Responsibilities & Skills Must Have: PySpark AWS (ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow) Qlik Replicate Data Testing Nice To Have: Hadoop Teradata Background IaC (CloudFormation / Terraform) Git Qualifications Bachelor of Computer Application Bachelor of Computer Science Bachelor of Engineering

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Google Cloud Platform Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the development of custom software solutions that involve designing, coding, and enhancing various components across systems or appli...

AWS Data Engineer + PySpark - Job Description AWS Data Engineer + PySpark Experience: 5-8 Years Location: Pune Job Function: Technology Role: Engineer Key Responsibilities & Skills Must Have: PySpark AWS (ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow) Qlik Replicate Data Testing Nice To Have: Hadoop Teradata Background IaC (CloudFormation / Terraform) Git Qualifications Bachelor of Computer Application Bachelor of Computer Science Bachelor of Engineering

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Google Cloud Platform Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the development of custom software solutions that involve designing, coding, and enhancing various components across systems or appli...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Fabric Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and imp...

US Shift Key Responsibility Area: ( Specifies Key Result Areas for the Incumbent ) o Engage with clients to precisely identify and fulfill their data engineering needs. o Lead and manage special projects to meet strategic goals. o Develop advanced models with Snowflake and SSIS to enhance data accuracy and utility. o Continuously refine data processing rules and procedures for optimal results. o Design and implement scalable data architectures using Snowflake. o Maintain and enhance data pipelines, integrating new data sources and APIs as needed. o Monitor and ensure high data quality across systems for reliable decision-making. o Utilize SSIS for efficient data extraction, transformation, a...

US Shift Key Responsibility Area: ( Specifies Key Result Areas for the Incumbent ) o Engage with clients to precisely identify and fulfill their data engineering needs. o Lead and manage special projects to meet strategic goals. o Develop advanced models with Snowflake and SSIS to enhance data accuracy and utility. o Continuously refine data processing rules and procedures for optimal results. o Design and implement scalable data architectures using Snowflake. o Maintain and enhance data pipelines, integrating new data sources and APIs as needed. o Monitor and ensure high data quality across systems for reliable decision-making. o Utilize SSIS for efficient data extraction, transformation, a...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark, Microsoft SQL Server, Python (Programming Language), Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and proc...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Python (Programming Language), Microsoft SQL Server, Databricks Unified Data Analytics Platform, PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processin...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google Cloud Platform Architecture Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years of fulltime education Role Summary :The Junior GCP Data Engineer (Ingestion) contributes to data pipeline development and ingestion processes within the Google Cloud Platform (GCP) ecosystem. This role involves in building, testing...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Power Business Intelligence (BI) Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Product Designer Project Role Description : Conceptualize, design and prototype innovative digital or physical products. Develop physical, 2D/3D, immersive prototypes and videos for products. Refine product design through iterative user testing documenting and applying feedback on functionality and usability. Must have skills : AWS Glue Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an AWS Data Engineer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements. You will play a crucial role in deve...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark, Adobe Suite Good to have skills : MySQL, Python (Programming Language), AWS BigData, Service design exposure Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are looking for a Data Engineer skilled in Python, PySpark, SQL, AWS Glue, Redshift, and Airflow to build and maintain scalable data pipeline...

We are seeking a big data engineer with advance Java experience to join our modernization initiative team. The candidate will be responsible for implementing and maintaining high volume online and offline batch and transactional client facing applications in cloud and On-prem. Candidate will also responsible for the creation and maintenance of our Code & database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and training data models Minimum 8 to 10 years of experience in Spring boot, Advanced Java and Spark. Bachelors degree or higher in computer science, data science, or a related field. Hands-on experience with data cleaning, visualisation, ...

We are seeking a big data engineer with advance Java experience to join our modernization initiative team. The candidate will be responsible for implementing and maintaining high volume online and offline batch and transactional client facing applications in cloud and On-prem. Candidate will also responsible for the creation and maintenance of our Code & database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and training data models Minimum 8 to 10 years of experience in Spring boot, Advanced Java and Spark. Bachelors degree or higher in computer science, data science, or a related field. Hands-on experience with data cleaning, visualisation, ...

Key Responsibility Area: ( Specifies Key Result Areas for the Incumbent ) o Engage with clients to precisely identify and fulfill their data engineering needs. o Lead and manage special projects to meet strategic goals. o Develop advanced models with Snowflake and SSIS to enhance data accuracy and utility. o Continuously refine data processing rules and procedures for optimal results. o Design and implement scalable data architectures using Snowflake. o Maintain and enhance data pipelines, integrating new data sources and APIs as needed. o Monitor and ensure high data quality across systems for reliable decision-making. o Utilize SSIS for efficient data extraction, transformation, and loadin...

This is a remote position. We are seeking a big data engineer with advance Java experience to join our modernization initiative team. The candidate will be responsible for implementing and maintaining high volume online and offline batch and transactional client facing applications in cloud and On-prem. Candidate will also responsible for the creation and maintenance of our Code & database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and training data models Minimum 8 to 10 years of experience in Spring boot, Advanced Java and Spark. Bachelors degree or higher in computer science, data science, or a related field. Hands-on experience with dat...

US Shift Key Responsibility Area: ( Specifies Key Result Areas for the Incumbent ) o Engage with clients to precisely identify and fulfill their data engineering needs. o Lead and manage special projects to meet strategic goals. o Develop advanced models with Snowflake and SSIS to enhance data accuracy and utility. o Continuously refine data processing rules and procedures for optimal results. o Design and implement scalable data architectures using Snowflake. o Maintain and enhance data pipelines, integrating new data sources and APIs as needed. o Monitor and ensure high data quality across systems for reliable decision-making. o Utilize SSIS for efficient data extraction, transformation, a...

Must have 4+ years of IT experience, with at least 2 years of relevant experience in Snowflake. In-depth understanding of Data Warehousing, ETL concepts, and modeling structure principles. Experience working with Snowflake functions, hands-on experience with Snowflake utilities, stage and file upload features, time travel, fail safe, procedure writing, tasks, Snowpipe, and SnowSQL. Knowledge of Snowflake Architecture. Good knowledge of Advanced SQL with joins, views/materialized views, various functions, dimensional data modeling, and ETL procedures using SQL. Experience in Python functional programming is a must, with Pandas, Apache Airflow, etc. Basics of ML & Gen AI. Expertise in engineer...

Build, monitor, and schedule Azure Data Factory (ADF) pipelines. Develop Power BI reports and metrics with strong experience in developing DAX queries. Proficient in SQL queries, including filters, joins, group by, sub-queries, indexing, and optimization. Design, develop, and maintain data pipelines and machine learning models using Azure services such as Azure Data Factory, Databricks, Synapse Analytics, and Azure Machine Learning. Build and optimize data models for analytics and reporting, ensuring high data quality and performance. Collaborate with business stakeholders to gather requirements, create dashboards, and deliver actionable insights using Power BI or similar tools. Ensure secur...

We are looking for a skilled AWS Data Engineer with 6 to 8 years of experience in the field. The ideal candidate will have expertise in designing and implementing data pipelines using AWS services. Roles and Responsibility Design, develop, and maintain large-scale data pipelines using AWS services such as S3, Lambda, and EMR. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and implement data quality checks and validation processes to ensure data integrity. Optimize data processing workflows for performance, scalability, and reliability. Troubleshoot and resolve complex technical issues related to data engineering projects. Participate in code ...

Key Technical Skills: AWS tools (Redshift, Glue, EMR, Athena, StepFunction, CloudFormation, CloudWatch) Programming languages: SQL, Python, Pyspark Data Pipelining skills Data blending Big data technologies: Hadoop, Hive Data Ingestion and Integration: Ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure. For example, use Azure Data Factory to orchestrate the extraction, transformation, and loading (ETL) of data from an on-premises SQL Server database to Azure Blob Storage. Data Transformation and Processing: Perform data transformation and processing tasks to prepare the data for analysis and reporting. Azure Databricks or Azure Synapse Analyti...

Key Technical Skillsets Expertise in GCP services: Airflow, Cloud Composer, Google Cloud Storage, BigQuery. Experience in developing, maintaining, and supporting Airflow/Composer DAGs. Hands-on experience in Python programming and working with GCP APIs. Experience with Data Engineering services in GCP such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Functions, Composer, and Storage. Experience writing complex queries and stored procedures in BigQuery. Experience in cost, process, and runtime optimization of Airflow/Composer DAGs and/or stored procedures/queries in BigQuery. Extensive experience supporting software development projects utilizing GCP technologies. Past roles may include sy...

Building and optimizing data infrastructure. Enabling scalable data pipelines. Ensuring efficient data processing using AWS and Databricks. Qualification Bachelor of Computer Application

Design, build, and maintain data transformation pipelines using PySpark and Databricks. Efficiently manage large datasets. Manage NoSQL databases such as CosmosDB. Implement and maintain complex data calculation formulas. Collaborate with Software Engineers. Participate in code reviews, design discussions, and software planning. Contribute to automation, testing, and deployment processes. Qualifications Bachelor of Technology