Big Data Architect

seema@talentvelocity.co.in WhatsApp 9870343675.

Job Title: Big Data Architect

Experience:

Location:

Notice Period: 0 to 30 days max

About the Role

Big Data Architect

Key Responsibilities

• Deliver

  reference architecture

  for

  Hadoop + Cloud integration

  tailored to enterprise-scale environments.

• Deploy production-grade pipelines

  using HDFS, Spark, and Kafka for batch and real-time data processing.
• Set up

  best practices

  and implement

  CI/CD

  frameworks for data engineering workflows.
• Lead

  data performance optimization

  and

  cost-reduction strategies

  across the big data stack.
• Collaborate with cross-functional teams (data engineers, data scientists, DevOps) to ensure robust, scalable solutions.
• Provide

  technical leadership

  and mentor junior engineers in big data technologies.

Required Skills & Qualifications

• 8+ years

  of experience in

  Big Data architecture and engineering

  .
• Expertise in the

  Hadoop ecosystem

  : HDFS, Hive, Sqoop, Oozie, Pig, Impala.
• Strong knowledge of

  real-time processing frameworks

  : Kafka, Spark Streaming, Flink.
• Hands-on experience with

  cloud platforms

  (AWS, GCP, or Azure) – EMR, Dataproc, HDInsight.
• Proficiency in

  Python, Scala, or Java

  for big data solutions.
• Experience with

  orchestration tools

  like Airflow or Prefect.
• Familiarity with

  Lakehouse technologies

  : Delta Lake, Apache Iceberg.
• Strong understanding of

  data modeling

  ,

  data security

  , and

  governance best practices

  .
• Excellent problem-solving, communication, and collaboration skills.

Preferred Qualifications

• Experience in

  cost-optimization strategies

  for large-scale data platforms.
• Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).
• Familiarity with CI/CD tools like Jenkins, GitLab CI/CD.
• Prior experience mentoring and leading engineering teams.