Big Data Administrator

Job Description

Job Title: Bigdata Administrator - SOL00048 Job Type: Full Time Location: Hyderabad, Telangana Experience Required: 5+ Years Job Description : Our client, headquartered in the USA with offices globally is looking for a highly skilled Big Data Administrator to manage and support our large-scale data infrastructure. The ideal candidate will have strong expertise in Linux systems, AWS cloud, and Active Directory, along with hands-on experience administering Big Data platforms such as Cloudera, Hortonworks, or EMR. This role involves maintaining high availability, optimizing performance, and ensuring secure and efficient operations of Big Data systems. What You'll Do: · Administer, monitor, and support Big Data clusters in production (e.g., Cloudera, Hortonworks, EMR) · Implement infrastructure-as-code solutions using Terraform or Ansible · Manage, configure, and troubleshoot Linux-based systems · Design and implement secure and scalable infrastructure on AWS · Integrate and maintain monitoring and observability tools such as Prometheus, Grafana, InfluxDB, Dynatrace, Splunk · Maintain and optimize HDFS and YARN-based systems · Work with various Hadoop-compatible file formats (ORC, Parquet, Avro) · Tune and troubleshoot query engines such as Hive (Tez, LLAP), Presto, and Spark · Optimize SQL query performance and understand execution plans · Support Spark workloads written in Python (PySpark) and R (SparkR, SparklyR) · Collaborate with Data Scientists and Analysts, supporting platforms like R-Studio, JupyterHub, H2O, SAS · Script automation and maintenance tasks using Shell or Python · Interact with and support Active Directory integration and AWS-based VDI platforms (e.g., Citrix, AWS Workspaces) Mandatory Skills: · Strong Linux administration expertise · Strong hands-on experience with AWS cloud services and infrastructure · Strong working knowledge of Active Directory Required Technical Skills: · 5+ years of experience in Big Data administration · Expertise in Hadoop ecosystem: HDFS, YARN, Hive, Spark · Knowledge of Hadoop file formats: ORC, Parquet, Avro · Experience with configuration and maintenance of observability tools · Hands-on experience with scripting (Shell, Python) · Working knowledge of networking and system security fundamentals Education: Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related technical field Show more Show less