Posted:1 week ago|
Platform:
Work from Office
Full Time
Experience Range in Required Skills: 5 to 8 Years
Work Location: Thane, Mumbai
Job Description:
1. Minimum 4 years of experience in development of Spark Scala, Strong expertise in Apache Spark,2. Experience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as Hadoop Bigdata components like HDFS, Spark, Hive Parquet File format, YARN, MapReduce, Sqoop.3. Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and streaming data processing.4. Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins, Views etc.5. Experience in debugging the Spark code.6. Working knowledge of basic UNIX commands and shell script.7. Experience of Autosys, Gradle.8. Exposure to financial domain will be an added advantageGood-to-Have1. Good analytical and debugging skills2. Ability to coordinate with SMEs, stakeholders, manage timelines, escalation & provide on time status3. Write clear and precise documentation / specification4. Work in an agile environment5. Create documentation and document all developed mappingsResponsibility of / Expectations from the Role1 Create Scala/Spark jobs for data transformation and aggregation2 Produce unit tests for Spark transformations and helper methods3 Write Scaladoc-style documentation with all code4 Design data processing pipelines
Siro Clinpharm
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
hyderabad, chennai, bengaluru
0.6 - 1.0 Lacs P.A.
hyderabad
10.0 - 15.0 Lacs P.A.
chennai
10.0 - 15.0 Lacs P.A.
10.0 - 15.0 Lacs P.A.
bengaluru
10.0 - 15.0 Lacs P.A.
bengaluru
15.0 - 17.0 Lacs P.A.
hyderabad
15.0 - 17.0 Lacs P.A.
chennai
15.0 - 17.0 Lacs P.A.
15.0 - 17.0 Lacs P.A.
chennai
0.6 - 1.0 Lacs P.A.
