Data Engineer (Contract role For min 1 year- Extendable)

Role- Data Manager

Location- Kharadi, Pune

Employment Type:

Experience:

About the Role

Data Manager

LLMs and BI tools

Key Responsibilities

• Data Pipeline Development:

  Design, build, and maintain robust data pipelines for processing large volumes of structured and unstructured data.

• Data Preparation & Quality:

  Lead data cleaning, transformation, normalization, and validation processes to ensure high-quality datasets for analytics and reporting.

• Automation & Scripting:

  Develop and automate repetitive data operations using Python, SQL, Microsoft Power Automate, and other automation tools.

• Data Extraction:

  Create Python scripts for automated extraction from PDFs, Excel, CSV, TXT, XML, APIs, and various other data sources.

• Data Visualization:

  Build and maintain dashboards and reports using Microsoft Power BI to support strategic decision-making.

• Cross-functional Collaboration:

  Work closely with analysts, data scientists, engineers, and business teams to deliver tailored data solutions.

• AI & Intelligent Automation:

  Implement AI-driven data processing, including the use of Large Language Models (LLMs) for automation and insight generation.

• Project Management:

  Manage multiple data and BI projects simultaneously, ensuring timely delivery and alignment with business goals.

Essential Skills & Qualifications

• Education:

  Bachelors/Masters degree in Computer Science, Data Science, Information Technology, Analytics, or related fields.

• Experience:

  6+ years in data engineering, data management, or business analytics.

• Technical Expertise:

• Advanced

  Python programming

  (Pandas, NumPy, BeautifulSoup, Requests, PyPDF, OpenPyXL, etc.)
• Data cleaning, ETL processes, and handling large datasets.
  
• Strong knowledge of SQL/NoSQL databases, data modeling, and API integrations.
  

• Automation Tools:

  Hands-on experience with Microsoft Power Automate, Zapier, or similar platforms.

• AI & LLM Knowledge:

  Practical understanding of GPT-4, Claude, or local LLMs for automation and data processing.

• Cloud Platforms:

  Familiarity with Azure, AWS, or GCP for data storage and processing.

• Visualization Tools:

  Experience with Power BI (Tableau or Plotly is a plus).

• Soft Skills:

  Strong analytical thinking, problem-solving ability, and excellent communication skills.

• Preferred:

  Certifications in Python, SQL, Data Engineering, or Automation Tools; prior exposure to AI/ML and RPA tools.