33 Data Engineer Jobs

Job Description With over 20 years of progressive experience in data engineering, including leadership roles, you will be responsible for designing, building, and managing large-scale data platforms in cloud environments such as AWS, Azure, or GCP. Your deep hands-on experience with Apache Spark for distributed data processing will be crucial in this role. Additionally, your strong proficiency in Java, Scala, and Python will be essential for this position. Key Responsibilities - Design, build, and manage large-scale data platforms in cloud environments - Utilize Apache Spark for distributed data processing - Lead and mentor high-performing data engineering teams - Implement data architecture...

We are seeking a skilled and detail-oriented Azure Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Synapse or Microsoft Fabric, and strong programming skills in Python or PySpark. Proficiency in SQL and experience in designing and maintaining modern data pipelines and data lakes are essential. Responsibilities: Design, build, and manage scalable data pipelines using Azure Data Factory (ADF) Develop and optimize data transformations using Azure Synapse Analytics or Microsoft Fabric Write efficient and reusable code in Python or PySpark for data wrangling and processing Create, maintain, and optimize complex SQL ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary : As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qual...

We are having an urgent opening for our organization (IRIS Software) for Data Engineer- Senior Engineer/ Lead role Interested candidates can share their resume on prerna.sharma@irissoftware.com with below details **Skills to be evaluated: •Python AND Pyspark AND Databricks AND AWS AND Azure** Required- Immediate joiner / 15-20 days joiner See detailed JD below. Job Duties & Responsibilities Design, develop, and optimize complex data pipelines and transformation processes using Snowflake, dbt, and AWS services. Databricks is Mandatory Implement and manage data integration workflows using Fivetran to ensure timely and accurate data ingestion from various sources. Develop and maintain scalable ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : Python (Programming Language), Generative AI Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary : As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. A typical day involves creating robust data pipelines, ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Purview Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary : As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL...

What you will do In this vital role, you will be responsible for the end-to-end development of an enterprise analytics and data mastering solution using Databricks and Power BI. This role requires expertise in both data architecture and analytics, with the ability to create scalable, reliable, and impactful enterprise solutions that research cohort-building and advanced research pipeline. The ideal candidate will have experience creating and surfacing large unified repositories of human data, based on integrations from multiple repositories and solutions, and be extraordinarily skilled with data analysis and profiling. You will collaborate closely with key customers, product team members, an...

As a Data Engineer: Business Intelligence, you will design, build, and manage solutions using web-based BI reporting technology to provide personalized features and intuitive designs. This role involves integrating Business Intelligence Platforms to enable seamless toggling between reporting and analysis tasks. Your primary responsibilities will include : Design and Build Solutions: Design and build web-based BI reporting solutions that offer personalized features, such as drill-down capabilities and intuitive design kits, to enhance user experience. Integrate BI Platforms: Integrate Business Intelligence Platforms to enable users to easily toggle between reporting and analysis tasks, promot...

We are hiring for Data Engineer for Hyderabad Location. Please find the below Job Description. Role & responsibilities 6+ years of experience in data engineering, specifically in cloud environments like AWS. Proficiency in Python and PySpark for data processing and transformation tasks. Solid experience with AWS Glue for ETL jobs and managing data workflows. Hands-on experience with AWS Data Pipeline (DPL) for workflow orchestration. Strong experience with AWS services such as S3, Lambda, Redshift, RDS, and EC2. Deep understanding of ETL concepts and best practices.. Strong knowledge of SQL for querying and manipulating relational and semi-structured data. Experience with Data Warehousing an...

Hi, We are hiring for the role of AWS Data Engineer with one of the leading organization for Bangalore & Pune. Experience - 10+ Years Location - Bangalore & Pune Ctc - Best in the industry Job Description Technical Skills PySpark coding skill Proficient in AWS Data Engineering Services Experience in Designing Data Pipeline & Data Lake If interested kindly share your resume at nupur.tyagi@mounttalent.com

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Ab Initio Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Skills must have : 5+ years of hands-on experience developing and designing strong Ab initio based Solutions Ability to demonstrate knowledge in advanced concepts such as parallelism,performance tunning, debugging Sound knowledge and experience in var...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Java Enterprise Edition Good to have skills : Python (Programming Language), Spring Boot, Google BigQueryMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will engage in the design, development, and maintenance of data solutions that facilitate data generation, collection, and processing. Your typical ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : Python (Programming Language), Apache Spark, Google BigQueryMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipeline...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes t...

As a Data Engineer / Manager / Executive at Sportrid Limited, a leading company in the None industry, you will play a crucial role in analyzing and organizing raw data to identify patterns, trends, and insights. Your responsibilities will include: - Building and maintaining data systems and pipelines to ensure the efficient flow and storage of data - Evaluating business needs and objectives to develop data solutions that meet strategic goals - Conducting complex data analysis and generating detailed reports on findings - Preparing data for prescriptive and predictive modeling using advanced statistical techniques and algorithms - Combining data from various sources to create comprehensive da...

As a Technical Consultant at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, inc...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Expertise in Data warehousing/ information Management/ Data Integra...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. Youll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, youll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, youll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

Minimum 3 years of experience in developing applications programs to implement the ETL workflow by creating the ETL jobs, data models in datamarts using Snowflake, DBT, Unix, SQL technologies. Redesign Control M Batch processing for the ETL job build to run efficiently in Production. Study existing system to evaluate effectiveness and developed new system to improve efficiency and workflow. Responsibilities: Perform requirements identification; conduct business program analysis, testing, and system enhancements while providing production support. Developer should have good understanding of working in Agile environment, Good understanding of JIRA, Sharepoint tools. Good written and verbal com...

As a Data Engineer with expertise in Machine Learning, you will apply Machine Learning concepts and techniques to address business challenges. You will leverage your skills to drive informed decision-making in the organization. Your primary responsibilities will include: Develop Machine Learning Solutions: Apply Machine Learning concepts and techniques to address business challenges, interpreting statistical data and identifying relevant features to inform solution development. Evaluate Algorithm Performance: Choose appropriate algorithms and evaluate their performance using relevant metrics, ensuring that solutions meet business needs and drive informed decision-making. Communicate Results:...

You are an experienced Data Engineer with a strong hands-on experience in Google Cloud Platform (GCP) and BigQuery. Your main role will be to build scalable data pipelines and cloud data solutions. **Key Responsibilities:** - Utilize Google Cloud Platform (GCP) and BigQuery to build and maintain scalable data pipelines - Develop and optimize data storage solutions in the cloud - Work closely with the data science and analytics teams to ensure smooth data flow and access **Qualifications Required:** - Proven experience as a Data Engineer - Proficiency in Google Cloud Platform (GCP) and BigQuery - Strong SQL skills You are an experienced Data Engineer with a strong hands-on experience in Googl...

* Establish and implement best practices for DBT workflows, ensuring efficiency, reliability, and maintainability. * Collaborate with data analysts, engineers, and business teams to align data transformations with business needs. * Monitor and troubleshoot data pipelines to ensure accuracy and performance. * Work with Azure-based cloud technologies to support data storage, transformation, and processing Required education Bachelor''s Degree Preferred education Master''s Degree Required technical and professional expertise * Strong MS SQL, Azure Databricks experience * Implement and manage data models in DBT, data transformation and alignment with business requirements. * Ingest raw, unstruct...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

As a BigData Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering...