Big data hadoop ETL Engineer

As an experienced Big Data Engineer, your role will involve the following responsibilities: - Designing, developing, and optimizing scalable Big Data pipelines. - Working closely with cross-functional teams on data acquisition, transformation, and processing. - Performing ETL workflows, data ingestion, and data processing using the Hadoop ecosystem. - Building and maintaining data solutions to ensure performance, scalability, and reliability. - Monitoring, troubleshooting, and tuning data pipelines to ensure optimal performance. Mandatory Skills: - Strong proficiency in Big Data / Hadoop Technologies such as Hive, HQL, and HDFS. - Proficient in programming languages like Python, PySpark, and SQL (with strong query writing skills). - Experience with schedulers like Control-M or equivalent. - Strong background in Database & ETL, with experience in SQL Server / Oracle or similar. - Expertise in ETL pipeline development and performance tuning. Preferred (Good to Have): - Familiarity with GCP Services such as BigQuery, Composer, DataProc, and GCP Cloud architecture. - Experience in Agile delivery methodology. - Knowledge of Terraform coding and Infrastructure as Code (IaC). This job requires someone with a strong hands-on experience in the Big Data ecosystem tools, database engineering, and ETL pipeline development. The ideal candidate should possess strong analytical and problem-solving skills along with expertise in performance tuning and scheduling tools.,