Azure Databricks

Job Description: You will be responsible for working with AWS/Azure, ETL, SQL, DATABRICKS, Python/Scala, PY-SPARK/Spark, APACHE NIFI or HIVE technologies to support data engineering tasks. Key Responsibilities: - Utilize AWS/Azure services for data processing and storage - Develop and maintain ETL pipelines - Write and optimize SQL queries for data retrieval and manipulation - Use DATABRICKS for data analysis and processing - Program in Python/Scala for data transformation tasks - Work with PY-SPARK/Spark for big data processing - Implement data ingestion and streaming using APACHE NIFI or HIVE Qualifications Required: - Minimum 5 years of experience in data engineering - Proficiency in AWS/Azure, ETL, SQL, DATABRICKS, Python/Scala, PY-SPARK/Spark, APACHE NIFI or HIVE - Strong analytical and problem-solving skills - Ability to work effectively in a hybrid work mode environment (Note: No additional details about the company were provided in the job description) Job Description: You will be responsible for working with AWS/Azure, ETL, SQL, DATABRICKS, Python/Scala, PY-SPARK/Spark, APACHE NIFI or HIVE technologies to support data engineering tasks. Key Responsibilities: - Utilize AWS/Azure services for data processing and storage - Develop and maintain ETL pipelines - Write and optimize SQL queries for data retrieval and manipulation - Use DATABRICKS for data analysis and processing - Program in Python/Scala for data transformation tasks - Work with PY-SPARK/Spark for big data processing - Implement data ingestion and streaming using APACHE NIFI or HIVE Qualifications Required: - Minimum 5 years of experience in data engineering - Proficiency in AWS/Azure, ETL, SQL, DATABRICKS, Python/Scala, PY-SPARK/Spark, APACHE NIFI or HIVE - Strong analytical and problem-solving skills - Ability to work effectively in a hybrid work mode environment (Note: No additional details about the company were provided in the job description)