Posted 8 months ago. This role may no longer be accepting applications.

Data Engineer-Data Integration

2 - 5 years

Hyderabad

Posted:8 months ago

Apply

Job Description

  • As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. Youll contribute to data gathering, storage, and both batch and real-time processing.
  • Collaborating closely with diverse teams, youll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, youll tackle obstacles related to database integration and untangle complex, unstructured data sets.
  • In this role, your responsibilities may include:
  • Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a variety of statistical and machine learning techniques
  • Designing and implementing various enterprise search applications such as Elasticsearch and Splunk for client requirements
Required education
Bachelor's Degree
Required technical and professional expertise
  • Expertise in designing and implementing scalable data warehouse solutions on Snowflake, including schema design, performance tuning, and query optimization.
  • Strong experience in building data ingestion and transformation pipelines using Talend to process structured and unstructured data from various sources.
  • Proficiency in integrating data from cloud platforms into Snowflake using Talend and native Snowflake capabilities.
  • Hands-on experience with dimensional and relational data modelling techniques to support analytics and reporting requirements
Preferred technical and professional experience
  • Understanding of optimizing Snowflake workloads, including clustering keys, caching strategies, and query profiling.
  • Ability to implement robust data validation, cleansing, and governance frameworks within ETL processes.
  • Proficiency in SQL and/or Shell scripting for custom transformations and automation tasks.

Skills Required

data engineer snowflake data warehouse data management talend cloud platforms machine learning caching sql analytics query optimization automation elasticsearch shell splunk shell scripting clustering big data etl data integration

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Data Engineer Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
IBM logo
IBM

Information Technology

Armonk

RecommendedJobs for You

Coimbatore, Tamil nadu, India