Big Data Hadoop Hive HDFS HQL

As an experienced Big Data Engineer, you will be responsible for the following: - Designing, developing, and optimizing scalable Big Data pipelines. - Working closely with cross-functional teams on data acquisition, transformation, and processing. - Performing ETL workflows, data ingestion, and data processing using the Hadoop ecosystem. - Building and maintaining data solutions ensuring performance, scalability, and reliability. - Monitoring, troubleshooting, and tuning data pipelines to ensure optimal performance. Mandatory Skills: - Big Data / Hadoop Technologies: Hive, HQL, HDFS - Programming: Python, PySpark, SQL (Strong query writing) - Schedulers: Control-M or equivalent scheduler - Database & ETL: Strong experience in SQL Server / Oracle or similar - ETL pipeline development & performance tuning Preferred (Good to Have): - GCP Services: BigQuery, Composer, DataProc, GCP Cloud architecture - Experience in Agile delivery methodology - Terraform coding and IaC knowledge,