Lead- Data Engineer

6 - 12 years

0 Lacs

Posted:3 days ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As a Lead II - Software Engineering at UST Global, you will have the opportunity to lead enterprise data projects around Business and IT operations, utilizing your expertise in developing and testing data pipelines, data analytics efforts, and issue resolution mechanisms using various technologies. Your role will include: Role Overview: You will be responsible for assembling large and complex sets of data to meet business requirements, designing and implementing internal process improvements, optimizing data delivery, and automating manual processes. Key Responsibilities: - Building infrastructure for data extraction, transformation, and loading from various sources using GCP/Azure and SQL technologies - Creating analytical tools to provide actionable insights into key business metrics - Collaborating with stakeholders to address data-related technical issues and support data infrastructure needs - Overseeing the integration of new technologies into data standards and structures - Utilizing your strong background in data warehouse design and knowledge of Spark, PySpark, SQL, and PL/SQL - Experience in Cloud platform data migration, ETL, and data validation processing - Communicating effectively with shareholders and sharing findings - Experience in Data Analytics, optimization, machine learning techniques, and web-based application development tech stacks Qualifications Required: - Bachelor's degree in Computer Science, Computer Engineering, or a related field - 6+ years of experience in Data Warehouse and Hadoop/Big Data - Experience in strategic data planning, standards, procedures, and governance - Hands-on experience in Python or Scala, writing and tuning SQLs, Spark queries - Agile team experience - Familiarity with Kubernetes, containers, Hadoop Log Files, and data processing engines - Proficiency in Data Analysis, Data Cleaning, Data Validation, Data Conversion, Data Migrations, and Data Mining - Experience in all phases of Data warehouse life cycle, architecting Hadoop Clusters, analyzing data in HDFS, and building data pipelines - Strong analytic skills with unstructured datasets - Experience with data pipeline tools like Airflow and scripting languages like Python, Scala - Cloud Administration experience In addition to the technical skills, at UST Global, we value: - Adaptability to a fast-paced environment - Excellent written and oral communication skills - Critical thinking and proactive sharing of accomplishments and knowledge - Functional and technical leadership qualities - Analytical and problem-solving skills You will be part of a culture that values humility, humanity, and integrity, where innovation, diversity, and inclusion are encouraged. UST Global reserves the right to redefine your roles and responsibilities based on organizational requirements and performance, while you are expected to support and promote the company's values and comply with all policies and procedures. Please note that the overall experience level required for this role is 8-12 years in IT with a minimum of 6+ years of Data Engineering and Analyst experience. In case you need any further information, feel free to reach out. As a Lead II - Software Engineering at UST Global, you will have the opportunity to lead enterprise data projects around Business and IT operations, utilizing your expertise in developing and testing data pipelines, data analytics efforts, and issue resolution mechanisms using various technologies. Your role will include: Role Overview: You will be responsible for assembling large and complex sets of data to meet business requirements, designing and implementing internal process improvements, optimizing data delivery, and automating manual processes. Key Responsibilities: - Building infrastructure for data extraction, transformation, and loading from various sources using GCP/Azure and SQL technologies - Creating analytical tools to provide actionable insights into key business metrics - Collaborating with stakeholders to address data-related technical issues and support data infrastructure needs - Overseeing the integration of new technologies into data standards and structures - Utilizing your strong background in data warehouse design and knowledge of Spark, PySpark, SQL, and PL/SQL - Experience in Cloud platform data migration, ETL, and data validation processing - Communicating effectively with shareholders and sharing findings - Experience in Data Analytics, optimization, machine learning techniques, and web-based application development tech stacks Qualifications Required: - Bachelor's degree in Computer Science, Computer Engineering, or a related field - 6+ years of experience in Data Warehouse and Hadoop/Big Data - Experience in strategic data planning, standards, procedures, and governance - Hands-on experience in Python or Scala, writing and tuning SQLs, Spark queries - Agile team experience - Familiarity with Kubernetes, containers, Hadoop Log Files, and data processing eng

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

thiruvananthapuram, all india

trivandrum, kerala, india

thiruvananthapuram, all india

trivandrum, kerala, india