Data Engineer Lead/Architect

Bloom Consulting Services

12 - 20 years

35 - 45 Lacs

Hyderabad Pune Bengaluru

Posted:4 months ago| Platform:

Apply

Skills Required

AWS Python SQL Pyspark Terraform Spark

Work Mode

Work from Office

Job Type

Full Time

Job Description

Hi,

Data Engineer Lead/Architect

Pref : Product Based companies or E-Commerce Companies

Must have: Python, Spark, and AWS. Good at problem solving, well-versed with overall project architecture and Hands-on Coding exp

Required Skills:

Proficiency in multiple programming languages - ideally Python
Proficiency in at least one cluster computing frameworks (preferably Spark, alternatively Flink or Storm)
Proficiency in at least one cloud data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), at least one relational data stores (Postgres, Oracle or similar) and at least one NOSQL data stores (Cassandra, Dynamo, MongoDB or similar)
Proficiency in at least one scheduling/orchestration tools (preferably Airflow, alternatively AWS Step Functions or similar)
Proficiency with data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data processing methodologies (batch, micro-batching, and stream), one or more data modelling techniques (Dimensional, Data Vault, Kimball, Inmon, etc.), Agile methodology (develop PI plans and roadmaps), TDD (or BDD) and CI/CD tools (Jenkins, Git,)
Strong organizational, problem-solving, and critical thinking skills; Strong documentation skills

Kindly share updated resumes to aruna.b@bloomsolutions.com

More Jobs at Bloom Consulting Services

Service NOW Engineer and ADMIN

Hyderabad, Bengaluru

4.0 - 8.0 yrs

INR 12 - 18 Lacs

Sales Executive / business development executive

Chennai

1.0 - 4.0 yrs

INR 0 - 0 Lacs

Servicenow Platform ADMIN

Hyderabad, Bengaluru

5.0 - 8.0 yrs

INR 4 - 9 Lacs

Tele Caller

Bengaluru

1.0 - 3.0 yrs

INR 1 - 3 Lacs

Data Engineer

Bengaluru

5.0 - 10.0 yrs

INR 10 - 13 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.