Big Data Administrator

Job Summary:

Big Data Administrator

Key Responsibilities:

• Manage and maintain large-scale

  Big Data clusters

  (Cloudera, Hortonworks, or AWS EMR)
• Develop and support

  infrastructure as code

  using

  Terraform

  or

  Ansible

• Administer

  Hadoop ecosystem components

  HDFS, YARN, Hive (Tez, LLAP), Presto, Spark
• Implement and monitor

  observability tools

  like Prometheus, InfluxDB, Dynatrace, Grafana, Splunk
• Optimize

  SQL performance

  on Hive/Spark and understand query plans
• Automate cluster operations using

  Python

  (PySpark) or

  Shell scripting

• Support Data Analysts & Scientists with tools like

  JupyterHub, R-Studio, H2O, SAS

• Handle data in various formats ORC, Parquet, Avro
• Integrate with and support

  Kubernetes-based

  environments (if applicable)
• Collaborate across teams for deployments, monitoring, and troubleshooting

Must-Have Skills:

• 5+ years in

  Linux system administration

  and

  AWS cloud infrastructure

• Experience with

  Cloudera, Hortonworks, or EMR

  in production
• Strong in

  Terraform Ansible

  for automation
• Solid hands-on with

  HDFS, YARN, Hive, Spark, Presto

• Proficient in

  Python

  and

  Shell scripting

• Familiar with

  observability tools

  : Grafana, Prometheus, InfluxDB, Splunk, Dynatrace
• Familiarity with

  Active Directory

  , Windows VDI platforms (Citrix, AWS Workspaces)

Nice-to-Have Skills:

• Experience with

  Airflow

  ,

  Oozie

• Familiar with

  Pandas, Numpy, Scipy, PyTorch

• Prior use of

  Jenkins, Chef, Packer

• Comfortable reading code in

  Java, Scala, Python, R

Qualifications:

• Bachelors or Masters degree in Computer Science, Information Technology, or a related field
• Strong communication, collaboration, and troubleshooting skills
• Ability to thrive in remote or hybrid work environments