Freelancer - Data Engineer

In Norconsulting we are currently looking for a Data Engineer to join us in a freelancer opportunity for a major Banking organization.

• Duration

  : long term

• Location

  : Remote from India

• Rate

  : 105 USD per day (Around 2100 per month)

The main scope of work is Data integration, Data cleanup for Knowledge 360 and other related products for knowledge system.

• Related task includes, but not limited to:
• Design and implement cloud-based solutions using Azure and Google Cloud platforms. Automate data pipelines to facilitate efficient data flow and processing.
• Develop and manage data pipelines using technologies like PySpark and Databricks.
• Ensure the scalability and reliability of data processing workflows.
• Work with Large Language Models (LLMs) such as GPT and OpenAI models to enhance applications with natural language processing (NLP) capabilities.
• Design and implement prompt engineering strategies to optimize model performance in business applications.
• Train, fine-tune, and deploy AI models, analyzing their performance based on real-world results.
• Optimize models using feedback mechanisms to improve efficiency
• Utilize strong communication skills to convey complex technical concepts to non-technical stakeholders

SKILLS / EXPERIENCE REQUIRED

• 3+ years of hands-on experience in Python, Pyspark, Databricks, and cloud platforms like Azure and Google Cloud.
• Experience in designing and implementing cloud-based solutions and automating data pipelines.
• Experience in Working with Large Language Models (LLMs) such as GPT, OpenAI models, or enhance solutions with natural language processing (NLP) capabilities.
• Proven ability in metadata management and schema mapping.
• Experience working directly with clients, understanding their requirements, and delivering tailored solutions.
• Strong communication skills to effectively convey technical concepts to non-technical stakeholders.
• Excellent analytical and problem-solving skills with a keen attention to detail with respect to Data.
• Ability to work independently and in collaboration with cross-functional teams.
• Track record of successfully managing multiple tasks and projects in a fast-paced environment.
• Experience in end-to-end project delivery and managing deliverables.
• Cloud certifications (Azure, Google Cloud, or similar) are a plus.