PySpark Developers

As a Data Engineer in this role, you will be responsible for designing and implementing systems using PySpark. Your expertise in Apache Spark and Python programming will play a crucial role in developing data processing tasks such as database migration, transformation, and integration solutions for Data warehousing projects. Your tasks will include reading data from external sources, merging data, performing data enrichment, and loading into target data destinations. Additionally, you will need to build APIs to provision data to downstream systems leveraging different frameworks. Familiarity with Jupyter Notebook, Zeppelin, and PyCharm IDEs will be advantageous for this position. Key Responsibilities: - Designing and implementing systems using PySpark - Performing database migration, transformation, and integration tasks - Developing data processing tasks using PySpark - Building APIs for provisioning data to downstream systems - Utilizing Jupyter Notebook, Zeppelin, and PyCharm IDEs for development Qualifications Required: - Experience in Apache Spark and Python programming - Knowledge of Big Data concepts - Understanding of distributed computing - Familiarity with ETL processes - Proficiency in SQL - Background in Data Engineering If you possess the qualifications mentioned above and have a passion for data engineering and Apache Spark, this role could be an excellent fit for you.,