Software Engineer

Who are we looking for?

We are looking for a data bricks engineer (developer), having strong software development experience of 6 to 10 years on Apache Spark & Scala

Technical Skills:

• Strong knowledge & hands-on experience in Apache Spark & Scala
• Experience in AWS S3, Redshift, EC2 and Lambda services
• Extensive experience in developing and deploying Bigdata pipelines
• Experience in Azure data lake
• Strong hands on in SQL development / Azure SQL and in-depth understanding of optimization and tuning techniques in SQL with Redshift
• Development in Notebooks (like Jupyter, DataBricks, Zeppelin etc)
• Development experience in Spark
• Experience in scripting language like python and any other programming language

Roles and Responsibilities:

• Candidate must have hands on experience in AWS Data Databricks
• Good development experience using Python/Scala, Spark SQL and Data Frames
• Hands-on with Databricks, Data Lake and SQL knowledge is a must.
• Performance tuning, troubleshooting, and debugging SparkTM

Process Skills:

• Agile Scrum

Qualification:

• Bachelor of Engineering (Computer background preferred)