Sunware Technologies - Python Developer - PySpark

Role:

Location :

Experience :

Key Responsibilities

• 3+ years experience as Python Developer / Designer
• Performance Improvement understanding and able to write effective, scalable code
• Experience in building ETL/ Data Warehouse transformation process.
• Implementing data ingestion pipelines from different types of data sources i.e Databases, S3, Files etc..
• Developing scalable and re-usable, self-service frameworks for data ingestion and processing.
• Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data,
• Processing performance analysis and optimization,
• Experience working with structured and unstructured data security and data protection solutions
• Expertise in at least one popular Python framework (like Django, Flask or Pyramid)
• Knowledge of object-relational mapping (ORM)
• Developing Big Data and non-Big Data cloud-based enterprise solutions in PySpark and SparkSQL and related frameworks/libraries,
• Bringing best practices in following areas :
• Design & Analysis
• Automation (Pipelining, IaC)
• Testing
• Monitoring
• Documentation.
  

Good To Have (Knowledge)

• Experience in cloud-based solutions
• Knowledge of data management principles.
• Familiarity with front-end technologies (like JavaScript and HTML5)