Job
Description
As a Senior Data Engineer at our company, you will be responsible for designing, developing, and maintaining data pipelines for processing large-scale datasets. Your role will involve building efficient ETL workflows to transform and integrate data from multiple sources, as well as developing and optimizing Hadoop and PySpark applications for data processing. You will also play a key role in ensuring data quality, governance, and security standards are met across systems. Additionally, you will implement and manage Cloud-based data solutions using platforms such as AWS, Azure, or GCP. Collaboration with data scientists and analysts to support business intelligence initiatives will be an essential part of your responsibilities. Moreover, troubleshooting performance issues and optimizing query executions in big data environments will be part of your daily tasks. Staying updated with industry trends and advancements in big data and cloud technologies is crucial for this role. **Key Responsibilities:** - Design, develop, and maintain data pipelines for processing large-scale datasets. - Build efficient ETL workflows to transform and integrate data from multiple sources. - Develop and optimize Hadoop and PySpark applications for data processing. - Ensure data quality, governance, and security standards are met across systems. - Implement and manage Cloud-based data solutions (AWS, Azure, or GCP). - Collaborate with data scientists and analysts to support business intelligence initiatives. - Troubleshoot performance issues and optimize query executions in big data environments. - Stay updated with industry trends and advancements in big data and cloud technologies. **Qualifications Required:** - Strong programming skills in Python, Scala, or Java. - Hands-on experience with Hadoop ecosystem (HDFS, Hive, Spark, etc.). - Expertise in PySpark for distributed data processing. - Proficiency in ETL tools and workflows (SSIS, Apache Nifi, or custom pipelines). - Experience with Cloud platforms (AWS, Azure, GCP) and their data-related services. - Knowledge of SQL and NoSQL databases. - Familiarity with data warehousing concepts and data modeling techniques. - Strong analytical and problem-solving skills. If you are interested in this opportunity, please feel free to contact us at +91 7305206696 or email saranyadevib@talentien.com. As a Senior Data Engineer at our company, you will be responsible for designing, developing, and maintaining data pipelines for processing large-scale datasets. Your role will involve building efficient ETL workflows to transform and integrate data from multiple sources, as well as developing and optimizing Hadoop and PySpark applications for data processing. You will also play a key role in ensuring data quality, governance, and security standards are met across systems. Additionally, you will implement and manage Cloud-based data solutions using platforms such as AWS, Azure, or GCP. Collaboration with data scientists and analysts to support business intelligence initiatives will be an essential part of your responsibilities. Moreover, troubleshooting performance issues and optimizing query executions in big data environments will be part of your daily tasks. Staying updated with industry trends and advancements in big data and cloud technologies is crucial for this role. **Key Responsibilities:** - Design, develop, and maintain data pipelines for processing large-scale datasets. - Build efficient ETL workflows to transform and integrate data from multiple sources. - Develop and optimize Hadoop and PySpark applications for data processing. - Ensure data quality, governance, and security standards are met across systems. - Implement and manage Cloud-based data solutions (AWS, Azure, or GCP). - Collaborate with data scientists and analysts to support business intelligence initiatives. - Troubleshoot performance issues and optimize query executions in big data environments. - Stay updated with industry trends and advancements in big data and cloud technologies. **Qualifications Required:** - Strong programming skills in Python, Scala, or Java. - Hands-on experience with Hadoop ecosystem (HDFS, Hive, Spark, etc.). - Expertise in PySpark for distributed data processing. - Proficiency in ETL tools and workflows (SSIS, Apache Nifi, or custom pipelines). - Experience with Cloud platforms (AWS, Azure, GCP) and their data-related services. - Knowledge of SQL and NoSQL databases. - Familiarity with data warehousing concepts and data modeling techniques. - Strong analytical and problem-solving skills. If you are interested in this opportunity, please feel free to contact us at +91 7305206696 or email saranyadevib@talentien.com.
