Junior Data Engineer

Location: Chennai (Onsite)
Experience: 2–4 years

Budget: 20 to 25 LPA

Job Description:

· To work in capacity of AWS Databricks, Python, Pyspark Hands ON developer

· Work with stakeholders for regular updates, requirement understanding and design discussions. Hands-on experience on designing and developing scripts for custom ETL processes and automation in AWS, data bricks, Python, Pyspark etc.

· Should be skilled in creating architecture and design documentation and knowledge of data engineering tools & technologies

· Expertise in Cloud related Big Data integration and infrastructure Tec stack using Databricks & Apache Spark framework

· Well-versed with scripting languages – Python

· Well versed with Data Orchestration/ETL .

· Good SQL/PL SQL programming Skills – writing complex procedures and queries for Dataframes and Notebooks

· Very good data engineering mindset to build, maintain pipelines, and ability to closely monitor critical pipeline batch jobs and resolve failures on urgent basis.

· Manage and Mentor junior developers in adopting and implementing the data bricks workflows.

· Excellent communication skills is a must

Minimum Qualifications:

· B.E./ master’s in computer science, Information systems, or Computer engineering, Systems Engineering with 6+ years of relevant experience

· Minimum of 2+ work experience using Databricks, spark and Databricks workflows, Autoloader.

· Knowledge of other scripting languages such as Scala, JavaScript, API development.

· Knowledge of other Data Orchestration/ETL tools - Alteryx, Snowflake, Azure Data Factory etc.

Knowledge of any of BI Tools - Tableau, Power BI, Quick Sight.

Job Types: Full-time, Permanent

Pay: ₹2,000,000.00 - ₹2,500,000.00 per year

Benefits:

• Health insurance
• Paid sick time
• Provident Fund

Work Location: In person