Python Developer

Big Data & AI Specialist

Responsibilities:

• Design, develop, and maintain scalable and efficient data pipelines using Python and PySpark for batch and real-time processing of large datasets.
• Implement and optimize data ingestion, transformation, and loading processes within a big data ecosystem.
• Collaborate with data scientists and other stakeholders to understand data requirements and translate them into technical solutions.
• Develop and deploy machine learning models and AI-driven solutions, leveraging your familiarity with AI concepts.
• Ensure data quality, integrity, and security across all data solutions.
• Troubleshoot and resolve performance issues and data-related problems.
• Stay up-to-date with the latest trends and technologies in big data, AI, and cloud platforms.
• Participate in code reviews and contribute to the overall technical excellence of the team.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.

• 5+ years of professional experience

  in big data technologies.

• Expert-level proficiency in Python

  for data manipulation, scripting, and application development.

• Strong hands-on experience with PySpark

  for big data processing and analysis.
• Experience with big data frameworks and tools such as Hadoop, Spark, Hive, Kafka, etc.
• Familiarity with

  Artificial Intelligence (AI) concepts

  , including machine learning algorithms, deep learning, natural language processing (NLP), or computer vision.
• Experience with cloud platforms (AWS, Azure, GCP) and their big data/AI services is a plus.
• Solid understanding of data warehousing concepts and ETL/ELT processes.
• Excellent problem-solving, analytical, and communication skills.
• Ability to work independently and as part of a collaborative team.