Data Engineer

We are looking for a Data Engineer with a passion for Coding.

• 2-3 years of relevant work experience
• To work in the capacity of AWS Databricks, Python, PySpark Hands-On developer
• Work with stakeholders for regular updates, requirement understanding, and design discussions. Hands-on experience in designing and developing scripts for custom ETL processes and automation in AWS, data bricks, Python, PySpark, etc.
• Should be skilled in creating architecture and design documentation, and have knowledge of data engineering tools & technologies
• Expertise in Cloud-related Big Data integration and infrastructure Tech stack using Databricks & Apache Spark framework
• Well-versed with scripting languages Python
• Well-versed with Data Orchestration/ETL.
• Good SQL/PL SQL programming Skills writing complex procedures and queries for Dataframes and Notebooks
• Very good data engineering mindset to build, maintain pipelines, and the ability to closely monitor critical pipeline batch jobs and resolve failures on an urgent basis.
• Manage and mentor junior developers in adopting and implementing the data bricks workflows.
• Excellent communication skills are a must

Minimum Qualifications:

• B.E./ masters in computer science, Information systems, or Computer engineering, Systems Engineering with 2+ years of relevant experience
• Minimum of 2+ work experience using Databricks, Spark, and Databricks workflows, Autoloader.
• Knowledge of other scripting languages, such as Scala, JavaScript, and API development.
• Knowledge of other Data Orchestration/ETL tools - Alteryx, Snowflake, Azure Data Factory, etc.
• Knowledge of any of the BI Tools - Tableau, Power BI, QuickSight.