Big Data Engineer

5 - 9 years

0 Lacs

Posted:2 days ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As a Big Data Engineer at UST, you will be responsible for designing, developing, and optimizing big data solutions using Spark and pySpark. You will play a crucial role in building and maintaining data pipelines using Apache Airflow, as well as developing and maintaining complex SQL queries to ensure optimal performance. Your expertise will be essential in integrating various data sources into big data platforms, focusing on data quality, integrity, and consistency across systems. Collaboration with data scientists, analysts, and stakeholders to understand data requirements and deliver effective solutions will be a key part of your role. You will also monitor and troubleshoot data pipelines and workflows, ensuring seamless data operations. Implementing best practices for data governance and security will be a priority to maintain data integrity. Mandatory skills for this role include advanced proficiency in Apache Spark, strong experience with pySpark, hands-on experience with Apache Airflow, and very good SQL skills. Familiarity with NoSQL databases is also required. Preferred qualifications include a Bachelor's or Master's degree in Computer Science, Engineering, or a related field, experience with cloud platforms such as AWS, Azure, or Google Cloud, knowledge of data warehousing concepts and tools, familiarity with data visualization tools, and strong problem-solving abilities. Joining UST will offer you a competitive salary and benefits package, the opportunity to work with cutting-edge technologies and innovative projects, a collaborative and inclusive work environment, as well as professional growth and development opportunities. If you are passionate about big data and have the skills and qualifications we are looking for, we encourage you to apply by sharing your resume and the requested details with us at nitin.patil@ust.com.,

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You

hyderabad, chennai, bengaluru

pune, chennai, bengaluru

bengaluru, karnataka, india

mumbai, new delhi, bengaluru