Data Engineer

You have a job opportunity where you will be required to have strong proficiency in Python for data processing and ETL tasks. Additionally, you need to possess advanced SQL skills, including query optimization, indexing, joins, and analytical functions. Hands-on experience with ClickHouse, MongoDB, Redis, and ElasticSearch will be beneficial for this role. Your key responsibilities will include: - Working with Apache Spark/PySpark and handling data lakes effectively - Utilizing ETL and data ingestion tools such as Apache NiFi efficiently - Familiarizing yourself with messaging and streaming platforms like Kafka, RabbitMQ, and ActiveMQ - Implementing workflow orchestration using frameworks like Apache Airflow - Leveraging your exposure to cloud platforms (AWS, GCP, or Azure) and their data services (S3, Redshift, BigQuery, Dataproc, etc.) - Applying your understanding of data warehousing, data modeling, and performance optimization techniques The qualification required for this role are: - Proficiency in Python for data processing - Advanced SQL skills including query optimization and indexing - Hands-on experience with ClickHouse, MongoDB, Redis, and ElasticSearch - Familiarity with Apache Spark/PySpark and data lakes - Experience with ETL and data ingestion tools such as Apache NiFi - Exposure to messaging and streaming platforms like Kafka, RabbitMQ, and ActiveMQ - Familiarity with workflow orchestration frameworks like Apache Airflow - Understanding of cloud platforms (AWS, GCP, or Azure) and their data services (S3, Redshift, BigQuery, Dataproc, etc.) - Knowledge of data warehousing, data modeling, and performance optimization techniques Please note that the job description does not include any additional details about the company. You have a job opportunity where you will be required to have strong proficiency in Python for data processing and ETL tasks. Additionally, you need to possess advanced SQL skills, including query optimization, indexing, joins, and analytical functions. Hands-on experience with ClickHouse, MongoDB, Redis, and ElasticSearch will be beneficial for this role. Your key responsibilities will include: - Working with Apache Spark/PySpark and handling data lakes effectively - Utilizing ETL and data ingestion tools such as Apache NiFi efficiently - Familiarizing yourself with messaging and streaming platforms like Kafka, RabbitMQ, and ActiveMQ - Implementing workflow orchestration using frameworks like Apache Airflow - Leveraging your exposure to cloud platforms (AWS, GCP, or Azure) and their data services (S3, Redshift, BigQuery, Dataproc, etc.) - Applying your understanding of data warehousing, data modeling, and performance optimization techniques The qualification required for this role are: - Proficiency in Python for data processing - Advanced SQL skills including query optimization and indexing - Hands-on experience with ClickHouse, MongoDB, Redis, and ElasticSearch - Familiarity with Apache Spark/PySpark and data lakes - Experience with ETL and data ingestion tools such as Apache NiFi - Exposure to messaging and streaming platforms like Kafka, RabbitMQ, and ActiveMQ - Familiarity with workflow orchestration frameworks like Apache Airflow - Understanding of cloud platforms (AWS, GCP, or Azure) and their data services (S3, Redshift, BigQuery, Dataproc, etc.) - Knowledge of data warehousing, data modeling, and performance optimization techniques Please note that the job description does not include any additional details about the company.