Data Engineer ( AWS, Confluent & SnapLogic )

Siemens

2 - 7 years

3 - 6 Lacs

bengaluru karnataka india

Posted:1 month ago| Platform: Foundit logo

Apply

Skills Required

workflow management

Work Mode

On-site

Job Type

Full Time

Job Description

We are looking for Data Engineer ( AWS, Confluent & Snaplogic )

Data Integration
Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching.
Data Processing
Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading.
Data Storage
Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval.
Data Transformation
Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency.
Data Products
Create and maintain data products that meet the needs of various stakeholders, providing actionable insights and supporting data-driven decision-making.
Workflow Management
Use Apache Airflow to orchestrate and automate data workflows, ensuring timely and accurate data processing.
Real-time Data Streaming
Utilize
Confluent Kafka
for real-time data streaming, ensuring low-latency data integration and processing.
ETL Processes
Design and implement ETL processes using
SnapLogic
, ensuring efficient data extraction, transformation, and loading.
Monitoring and Logging
Use Splunk for monitoring and logging data processes, ensuring system reliability and performance.
Youd describe yourself as:
Experience
3+ relevant years of experience in data engineering, with a focus on AWS Glue, Iceberg tables, Confluent Kafka, SnapLogic, and Airflow.

Technical Skills

Proficiency in AWS services, particularly AWS Glue.
Experience with Iceberg tables and Snowflake.
Knowledge of Confluent Kafka for real-time data streaming.
Familiarity with SnapLogic for ETL processes.
Experience with Apache Airflow for workflow management.
Understanding of Splunk for monitoring and logging.
Programming Skills
Proficiency in Python, SQL, and other relevant programming languages.
Data Modeling
Experience with data modeling and database design.
Problem-Solving
Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve data-related issues.

More Jobs at Siemens

Process Expert - Opportunity to Cash

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Process Expert - Site Installation

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Process Expert - Testing and Commissioning

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Business Administration - Proj Exc Commercial

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

EHS Country Head

Mumbai, Maharashtra, India

5 - 5 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.