Big Data Engineer

Job Description

Hi All, Our client in Noida is urgently hiring for an experienced Big Data Developer Experience – 7 Years+ Location – Noida 5 Days work from office Shift Time - Up to 8 PM IST NP – Immediate to 30 Days Big Data Engineer: Hadoop is a preferred skill but not mandatory. Must-have skills: Snowflake or Redshift, AWS (Glue, Lambda, EMR, etc.), and strong SQL. Education and Experience: Bachelors degree in computer science, or similar technical field Minimum 5 years of experience in Big Data Engineering/Data Analysis Preferred Skills and Qualifications: Proficiency in Python, SQL and Apache Spark Strong Experience on Snowflake AWS services such as EMR, Glue (serverless architecture), S3, Athena, IAM, Lambda and CloudWatch Core Spark, Spark Streaming, DataFrame API, Data Set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data Advanced SQL using Hive/Impala framework including SQL performance tuning Expertise in Hadoop, and other distributed computing frameworks ElasticSearch (OpenSearch) and Kibana Dashboards Resource management frameworks such as Yarn or Mesos. Physical table design in Big Data environment External job schedulers such as autosys, AWS data pipeline, airflow etc. Experience working in Key/Value data store such as Hbase Data Analyst: Skills, Experience and Requirements Minimum of 5 years of experience delivering data solutions on a variety of data warehousing platforms. Experience with SQL, Python and Excel in a business environment required 2+ years of experience with Tableau developing calculated fields Experience with data cleaning and blending multiple data sources using ETL tools Experience in cloud technologies (like AWS) and data analytics platforms (ex: Redshift and Snowflake) Experience in delivering of self-service analytics, insights, KPIs and metrics Experience building and maintaining data catalog with dictionary Experience with scheduling tools like Control-M or Airflow Strong understanding and experience with data warehousing concepts required Experience manipulating large datasets in a business environment required Experience translating data to actionable insights required Excellent facilitation skills; Strong desire to communicate in all settings Apply objective, analytical, and orderly thinking to the analysis of complex problems Embrace the Adventure; Willing to take risks, try innovative approaches, be adaptable to change, and learn from failures Demonstrate Curiosity; Strong desire to learn and add value to all aspects of the Dish business Education and Experience: Bachelors Degree with 5 years of experience in a relevant field such as Business operations, Analytics and Computer science; Master & Degree a plus