25 Data Engineer Jobs

We are hiring for Data Engineer for Hyderabad Location. Please find the below Job Description. Role & responsibilities 6+ years of experience in data engineering, specifically in cloud environments like AWS. Proficiency in Python and PySpark for data processing and transformation tasks. Solid experience with AWS Glue for ETL jobs and managing data workflows. Hands-on experience with AWS Data Pipeline (DPL) for workflow orchestration. Strong experience with AWS services such as S3, Lambda, Redshift, RDS, and EC2. Deep understanding of ETL concepts and best practices.. Strong knowledge of SQL for querying and manipulating relational and semi-structured data. Experience with Data Warehousing an...

Hi, We are hiring for the role of AWS Data Engineer with one of the leading organization for Bangalore & Pune. Experience - 10+ Years Location - Bangalore & Pune Ctc - Best in the industry Job Description Technical Skills PySpark coding skill Proficient in AWS Data Engineering Services Experience in Designing Data Pipeline & Data Lake If interested kindly share your resume at nupur.tyagi@mounttalent.com

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Ab Initio Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Skills must have : 5+ years of hands-on experience developing and designing strong Ab initio based Solutions Ability to demonstrate knowledge in advanced concepts such as parallelism,performance tunning, debugging Sound knowledge and experience in var...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Java Enterprise Edition Good to have skills : Python (Programming Language), Spring Boot, Google BigQueryMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will engage in the design, development, and maintenance of data solutions that facilitate data generation, collection, and processing. Your typical ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : Python (Programming Language), Apache Spark, Google BigQueryMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipeline...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes t...

As a Data Engineer / Manager / Executive at Sportrid Limited, a leading company in the None industry, you will play a crucial role in analyzing and organizing raw data to identify patterns, trends, and insights. Your responsibilities will include: - Building and maintaining data systems and pipelines to ensure the efficient flow and storage of data - Evaluating business needs and objectives to develop data solutions that meet strategic goals - Conducting complex data analysis and generating detailed reports on findings - Preparing data for prescriptive and predictive modeling using advanced statistical techniques and algorithms - Combining data from various sources to create comprehensive da...

As a Technical Consultant at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, inc...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Expertise in Data warehousing/ information Management/ Data Integra...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. Youll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, youll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, youll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

Minimum 3 years of experience in developing applications programs to implement the ETL workflow by creating the ETL jobs, data models in datamarts using Snowflake, DBT, Unix, SQL technologies. Redesign Control M Batch processing for the ETL job build to run efficiently in Production. Study existing system to evaluate effectiveness and developed new system to improve efficiency and workflow. Responsibilities: Perform requirements identification; conduct business program analysis, testing, and system enhancements while providing production support. Developer should have good understanding of working in Agile environment, Good understanding of JIRA, Sharepoint tools. Good written and verbal com...

As a Data Engineer with expertise in Machine Learning, you will apply Machine Learning concepts and techniques to address business challenges. You will leverage your skills to drive informed decision-making in the organization. Your primary responsibilities will include: Develop Machine Learning Solutions: Apply Machine Learning concepts and techniques to address business challenges, interpreting statistical data and identifying relevant features to inform solution development. Evaluate Algorithm Performance: Choose appropriate algorithms and evaluate their performance using relevant metrics, ensuring that solutions meet business needs and drive informed decision-making. Communicate Results:...

You are an experienced Data Engineer with a strong hands-on experience in Google Cloud Platform (GCP) and BigQuery. Your main role will be to build scalable data pipelines and cloud data solutions. **Key Responsibilities:** - Utilize Google Cloud Platform (GCP) and BigQuery to build and maintain scalable data pipelines - Develop and optimize data storage solutions in the cloud - Work closely with the data science and analytics teams to ensure smooth data flow and access **Qualifications Required:** - Proven experience as a Data Engineer - Proficiency in Google Cloud Platform (GCP) and BigQuery - Strong SQL skills You are an experienced Data Engineer with a strong hands-on experience in Googl...

* Establish and implement best practices for DBT workflows, ensuring efficiency, reliability, and maintainability. * Collaborate with data analysts, engineers, and business teams to align data transformations with business needs. * Monitor and troubleshoot data pipelines to ensure accuracy and performance. * Work with Azure-based cloud technologies to support data storage, transformation, and processing Required education Bachelor''s Degree Preferred education Master''s Degree Required technical and professional expertise * Strong MS SQL, Azure Databricks experience * Implement and manage data models in DBT, data transformation and alignment with business requirements. * Ingest raw, unstruct...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

As a BigData Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering...

* Establish and implement best practices for DBT workflows, ensuring efficiency, reliability, and maintainability. * Collaborate with data analysts, engineers, and business teams to align data transformations with business needs. * Monitor and troubleshoot data pipelines to ensure accuracy and performance. * Work with Azure-based cloud technologies to support data storage, transformation, and processing Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise * Strong MS SQL, Azure Databricks experience * Implement and manage data models in DBT, data transformation and alignment with business requirements. * Ingest raw, unstructur...

Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Required education Bachelor's Degree Required technical and professional expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer You love collaborative environments that use agile...

Role Overview: You will be responsible for leveraging your expertise in DataIku, Python coding, SQL, and GIT to deliver projects in DataIku platforms. Your role will involve configuring and optimizing Dataiku's architecture, developing custom workflows, collaborating with stakeholders to gather requirements, and applying data integration to fulfill regulatory and customer requirements. Key Responsibilities: - Utilize hands-on experience with Dataiku recipes, Designer nodes, API nodes, and Automation nodes for deployment - Collaborate with data analysts, business stakeholders, and clients to gather and understand requirements - Contribute to the development of DataIku environment for data int...

Project Role : Technology Architect Project Role Description : Design and deliver technology architecture for a platform, product, or engagement. Define solutions to meet performance, capability, and scalability needs. Must have skills : Google Cloud Platform Architecture Good to have skills : Python (Programming Language) Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an AI/ML Data Engineer, you will be responsible for developing applications and systems that utilize AI tools and Cloud AI services. Your typical day will involve applying CCAI and GenAI models as part of the solution, utilizing deep learning, neural networks an...

Project Role : Technology Architect Project Role Description : Design and deliver technology architecture for a platform, product, or engagement. Define solutions to meet performance, capability, and scalability needs. Must have skills : Google Cloud Platform Architecture Good to have skills : Google BigQuery Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer - AI/ML, you will be responsible for designing, building, and maintaining scalable data pipelines and systems that power AI/ML applications on Cloud platforms. Your typical day will involve leveraging Google Clouds data services, implementing GenAI and AI/ML...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementi...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL proce...

Job Description Summary The job position is for professional with experience in SOX compliance and data governance to join our Data & Analytics team. This role will be pivotal in ensuring that our data practices align with regulatory requirements, internal controls, and industry best practices. The ideal candidate will combine governance expertise with a foundational understanding of modern data platforms, cloud technologies, and analytics tools, while demonstrating strong communication, analytical skills, and the ability to leverage AI-driven solutions for compliance monitoring and audit automation Job Description Roles and Responsibilities In this role, you will: Design, implement, and mon...