Data Engineer

YO IT CONSULTING

2 years

15 - 20 Lacs

chennai

Posted:5 hours ago| Platform: GlassDoor logo

Apply

Skills Required

data engineering databricks spark scripting scala javascript api orchestration etl alteryx azure tableau power aws python pyspark design automation architecture documentation integration stack apache sql programming writing pipeline resolve communication

Work Mode

On-site

Job Type

Part Time

Job Description

Experience: 2 - 4 years

Location: Chennai

Minimum Qualifications:

B.E./ master’s in computer science, Information systems, or Computer engineering, Systems Engineering with 2+ years of relevant experience
Minimum of 2+ years of work experience using Databricks, Spark and Databricks workflows, Autoloader.
Knowledge of other scripting languages such as Scala, JavaScript, and API development.
Knowledge of other Data Orchestration/ETL tools - Alteryx, Snowflake, Azure Data Factory etc.
Knowledge of any of BI Tools - Tableau, Power BI, QuickSight.

Job Description:

2-3 years of relevant work experience
To work in the capacity of AWS Databricks, Python, PySpark Hands-On developer
Work with stakeholders for regular updates, requirement understanding and design discussions. Hands-on experience on designing and developing scripts for custom ETL processes and automation in AWS, data bricks, Python, PySpark etc.
Should be skilled in creating architecture and design documentation and have knowledge of data engineering tools & technologies
Expertise in Cloud-related Big Data integration and infrastructure Tec stack using Databricks & Apache Spark framework
Well-versed with scripting languages – Python
Well-versed with Data Orchestration/ETL.
Good SQL/PL SQL programming Skills – writing complex procedures and queries for Dataframes and Notebooks
Very good data engineering mindset to build and maintain pipelines, and ability to closely monitor critical pipeline batch jobs and resolve failures on an urgent basis.
Manage and mentor junior developers in adopting and implementing the data bricks workflows.
Excellent communication skills is a must

More Jobs at YO IT CONSULTING

HR Recruiter Internship

Indore, Madhya Pradesh, India

Experience: Not specified

Salary: Not disclosed

Product Owner - Cross-Border Payments

hyderabad, telangana

8.0 - 15.0 yrs

Salary: Not disclosed

Residential Real Estate Sales/broker

delhi

10.0 - 15.0 yrs

Salary: Not disclosed

Java Developer-Remote

pune, maharashtra

4.0 - 9.0 yrs

Salary: Not disclosed

Head PHP Full Stack Development

navi mumbai, maharashtra

7.0 - 11.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start JavaScript Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.