2085 Data Engineer Jobs - Page 12

Design, build, and maintain data transformation pipelines using PySpark and Databricks. Efficiently manage large datasets. Manage NoSQL databases such as CosmosDB. Implement and maintain complex data calculation formulas. Collaborate with Software Engineers. Participate in code reviews, design discussions, and software planning. Contribute to automation, testing, and deployment processes. Qualifications Bachelor of Technology

Must Have: AWS Redshift, Glue, PySpark Key Responsibilities & Requirements Strong hands-on experience in Python programming and PySpark. Experience using AWS services such as RedShift, Glue, EMR, S3, and Lambda. Experience working with Apache Spark and Hadoop ecosystem. Proficiency in writing and optimizing SQL for data manipulations. Familiarity with scheduling tools; experience with Airflow is preferable. Data warehouse experience with AWS Redshift or Hive is a must. Experience in implementing security measures for data protection. Qualifications Bachelor of Engineering

Work closely with clients to understand business needs, design data solutions, and deliver insights through end-to-end data management. Lead project execution, handle communication, documentation, and guide team members throughout. Required Candidate profile Must have hands-on experience with Python, ETL tools (Fivetran, StitchData), databases, and cloud platforms (AWS, GCP, Azure, Snowflake, Databricks). Familiarity with REST/SOAP APIs is essential.

About The Role This role involves the development and application of engineering practice and knowledge in defining, configuring and deploying industrial digital technologies (including but not limited to PLM and MES) for managing continuity of information across the engineering enterprise, including design, industrialization, manufacturing and supply chain, and for managing the manufacturing data. About The Role - Grade Specific Focus on Digital Continuity and Manufacturing. Develops competency in own area of expertise. Shares expertise and provides guidance and support to others. Interprets clients needs. Completes own role independently or with minimum supervision. Identifies problems and...

As an Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You''ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you''ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you''ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, i...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You''ll contribute to data gathering, storage, and both batch and real-time processing Collaborating closely with diverse teams, you''ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you''ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorpo...

Experience is creating templates in Open Text Extreme CE 23.4 Version Responsible to design and develop different documents and business forms using OpenText Exstream. Understanding of different input, output file formats, and Print file formats(PDF etc). Perform unit testing of templates/documents. Apply styles and images to document design. Use output comparison tools to compare different outputs Should have experience working with Exstream Design Manager & Exstream Designer Tool. Should have prior knowledge on working with Exstream Web Service. Designing Templates, Objects, Rules, Variables and creation of Documents based on Templates. Understand current SmartCOMM Templates and create tem...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You''ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you''ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you''ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorp...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : React.js Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are seeking an experienced L2 Support Engineer to provide operational and production support for our React Native (mobile) and React.js (web) applications. The role involves incident resolution, deployment support, monitoring, and collabora...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark, SQL Server Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ET...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL p...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL p...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform, Microsoft Azure Data Services, Microsoft Azure Analytics Services, PySpark Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processi...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL p...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :At least 5 years of experience in data engineering or a related field. We are seeking a highly skilled and experienced Data Engineer to develop solutions using PySpark and data warehousing technologies. This role requires expertise in both...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL p...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :At least 4 years of experience in data engineering or a related field. We are seeking a highly skilled and experienced Data Engineer to develop solutions using PySpark and data warehousing technologies. This role requires expertise in both...

Your role and responsibilities As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. Youll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, youll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, youll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: * Implementing and validating predictive models as well as creating and maintain statistical models with a f...

Job Summary The Senior Data Engineer at BDO ADVANTAGE Digital is expected to use their strong business acumen skills to effectively work with business partners to understand their data needs and develop technical designs and requirements to meet those needs. This role takes the lead in helping extract, transform, and store the Firms valuable data assets to achieve better operational efficiencies and provide better services to its clients through modern data movement pipelines. This role, in collaboration with other data engineers, data architects, and other IT teams, will operationalize and document data extraction and ingestion platforms. This role provides leadership in developing strategi...

About the Job At Sanofi, were committed to providing the next-gen healthcare that patients and customers need. Its about harnessing data insights and leveraging AI responsibly to search deeper and solve sooner than ever before. Join our R&D Data & AI Products and Platforms Team as an R&D Data Engineer and you can help make it happen. What you will be doing: Sanofi has recently embarked into a vast and ambitious digital transformation program. A cornerstone of this roadmap is the acceleration of its data transformation and of the adoption of artificial intelligence (AI) and machine learning (ML) solutions, to accelerate R&D, manufacturing and commercial performance and bring better drugs and ...

We are seeking experienced Data Engineers with over 7 years of experience to join our team at Intuit, through Cognizant. The selected candidates will be responsible for developing and maintaining scalable data pipelines, managing data warehousing solutions, and working with advanced cloud environments. The role requires strong technical proficiency and the ability to work onsite in Bangalore. Key Responsibilities: Design, build, and maintain data pipelines to ingest, process, and analyze large datasets using PySpark . Work on Data Warehouse and Data Lake solutions to manage structured and unstructured data. Develop and optimize complex SQL queries for data extraction and reporting. Leverage ...

As a Data Engineer with more than 6 years of experience in building and managing data processing pipelines for analytics usage, your role will involve the following key responsibilities: - Ability to understand the business use case and translate it into technical data requirements. - Building data pipelines that can clean, transform, and aggregate data from disparate sources. - Maintaining and re-engineering existing ETL processes to enhance data accuracy, stability, and pipeline performance. - Keeping abreast of advances in data persistence and big data technologies, and conducting pilots to design data architecture that can scale with the growing data sets of consumer experience. - Automa...

1. The resource should have knowledge on Data Warehouse and Data Lake 2. Should aware of building data pipelines using Pyspark 3. Should be strong in SQL skills 4. Should have exposure to AWS environment and services like S3, EC2, EMR, Athena, Redshift etc 5. Good to have programming skills in Python

Roles and Responsibility Design and develop data pipelines using ETL tools like AWS Glue and Spark. Migrate data from various sources into MongoDB databases. Develop and maintain API-based integrations for seamless data flow. Collaborate with cross-functional teams to ensure data quality and governance. Implement data lineage and quality frameworks to ensure adherence to industry standards. Work with Kafka, Git, Jenkins/CICD, and JSON data modeling to optimize data processing. Job Requirements Proficiency in MongoDB, SQL (Oracle/MySQL/PostgreSQL), and programming languages such as Python, Java, or Scala. Experience with data migration, ETL tools, and API-based integration. Familiarity with K...