Job
Description
As a Bigdata Engineer with over 5 years of experience based in Hyderabad and currently working on a contract basis, you are equipped with the skills required to excel in this role. Your primary expertise lies in Spark, Scala, and Python, with a strong command over Apache Spark and Scala programming language. Your in-depth knowledge of Spark's core concepts, RDDs, DataFrames, and Spark SQL enables you to develop optimized and scalable Spark applications efficiently. Key Responsibilities: - Demonstrating proficiency in Apache Spark and Scala programming language - Utilizing your knowledge of Spark's core concepts, RDDs, DataFrames, and Spark SQL to develop optimized applications - Handling large-scale data processing with hands-on experience in Kafka messaging - Developing Kafka-based applications effectively - Designing and developing data pipelines for various data formats such as ORC, JSON, CSV, and Parquet - Leveraging SQL for data manipulation, querying, and performance optimization - Working with relational databases like MySQL and PostgreSQL for efficient data processing Qualifications Required: - Bachelor's degree in Computer Science, Information Technology, or related field - Minimum of 5 years of experience as a Bigdata Engineer - Proficiency in Spark, Scala, Python, and other big data technologies - Strong understanding of distributed computing concepts - Hands-on experience in data engineering principles, data modeling, and ETL processes - Familiarity with Kafka messaging and developing Kafka-based applications - Proficient in SQL for data manipulation and querying - Experience with relational databases like MySQL and PostgreSQL - Knowledge of database design principles Kindly note that no additional details about the company were provided in the job description. As a Bigdata Engineer with over 5 years of experience based in Hyderabad and currently working on a contract basis, you are equipped with the skills required to excel in this role. Your primary expertise lies in Spark, Scala, and Python, with a strong command over Apache Spark and Scala programming language. Your in-depth knowledge of Spark's core concepts, RDDs, DataFrames, and Spark SQL enables you to develop optimized and scalable Spark applications efficiently. Key Responsibilities: - Demonstrating proficiency in Apache Spark and Scala programming language - Utilizing your knowledge of Spark's core concepts, RDDs, DataFrames, and Spark SQL to develop optimized applications - Handling large-scale data processing with hands-on experience in Kafka messaging - Developing Kafka-based applications effectively - Designing and developing data pipelines for various data formats such as ORC, JSON, CSV, and Parquet - Leveraging SQL for data manipulation, querying, and performance optimization - Working with relational databases like MySQL and PostgreSQL for efficient data processing Qualifications Required: - Bachelor's degree in Computer Science, Information Technology, or related field - Minimum of 5 years of experience as a Bigdata Engineer - Proficiency in Spark, Scala, Python, and other big data technologies - Strong understanding of distributed computing concepts - Hands-on experience in data engineering principles, data modeling, and ETL processes - Familiarity with Kafka messaging and developing Kafka-based applications - Proficient in SQL for data manipulation and querying - Experience with relational databases like MySQL and PostgreSQL - Knowledge of database design principles Kindly note that no additional details about the company were provided in the job description.
