Senior Data Cloud Architect

Careernet

5 - 7 years

15 - 30 Lacs

bengaluru

Posted:2 months ago| Platform:

Apply

Skills Required

data modelling bigdata data engineer aws cloud python design patterns

Work Mode

Hybrid

Job Type

Full Time

Job Description

Key Skills:

Roles and Responsibilities:

Utilize in-depth knowledge and hands-on experience using Python (PySpark) on real-time data streaming technologies such as Kafka, Spark, and Lambda.
Build data processing pipelines on AWS using AWS MSK, EMR (Spark Streaming), DynamoDB, Lambda, Glue, and Athena.
Manage device data ingestion and processing using AWS IoT Core, IoT rules, and EventBridge.
Design, implement, and optimize Kafka and Spark-based NRT data processing pipelines.
Develop reusable, cloud-native, scalable, and reliable frameworks and tools.
Create and implement cost-effective solutions to meet functional and non-functional requirements like availability, latency, and fault tolerance.
Design scalable data pipelines for IoT telemetry and establish real-time vs batch processing architecture.
Ensure data governance, security, and compliance while applying cost optimization strategies on AWS.

Skills Required:

Strong expertise in AWS Cloud services (e.g., MSK, EMR, Glue, Lambda, DynamoDB)
Proficiency in Python/PySpark for data engineering
Experience in Big Data technologies and real-time data streaming (Kafka, Spark)
Solid background in Data Modelling and IoT telemetry data processing
Familiarity with Design Patterns and cloud-native architecture principles
Knowledge of data governance, security, and cost optimization on AWS

Education:

More Jobs at Careernet

Devops Engineer

Pune

6 - 11 yrs

INR 10 - 20 Lacs

Servicenow Developer

Chennai, Bengaluru, Hyderabad

4 - 6 yrs

INR 10 - 18 Lacs

RDS Engineer

Bengaluru

6 - 9 yrs

INR 8 - 18 Lacs

Senior ML Software Engineer

Bengaluru

7 - 11 yrs

INR 30 - 40 Lacs

ICC System Architect

Bengaluru

12 - 17 yrs

INR 22 - 37 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Data Engineer Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.