Sr. Data Engineer - Contract position

Relevant and Total years of experience

Relevant 8+ years

Job Summary:

Apache NiFi

Key Responsibilities:

• Design, develop, and maintain robust ETL pipelines using Apache NiFi, KNIME, and other tools.
• Integrate data from various sources including APIs, databases, flat files, and cloud storage.
• Optimize data workflows for performance, scalability, and reliability.
• Collaborate with data analysts, data scientists, and business stakeholders to understand data needs.
• Monitor and troubleshoot data pipeline issues and ensure data quality and consistency.
• Implement data governance, lineage, and documentation practices.
• Work with cloud platforms (AWS, Azure, or GCP) for data storage and processing.

Required Skills & Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field.
• 5 years of experience in data engineering or a similar role.
• Strong hands-on experience with

  Apache NiFi

  and

  KNIME

  for data integration and transformation.
• Proficiency in SQL and scripting languages like Python or Shell.
• Experience with relational and NoSQL databases (e.g., PostgreSQL, MongoDB).
• Familiarity with data warehousing concepts and tools (e.g., Snowflake, Redshift, BigQuery).
• Understanding of data modeling, data quality, and data governance principles.

Preferred:

• Experience with workflow orchestration tools like Apache Airflow or Luigi.
• Exposure to CI/CD practices and version control (e.g., Git).
• Knowledge of real-time data processing frameworks (e.g., Kafka, Spark Streaming).|

Mandatory Skills

ETL pipelines using Apache NiFi, KNIME , ETL , DWH , Python , SQL

Work with cloud platforms (AWS/ Azure/ GCP/Snowflake ) for data storage and processing.

Work Location

Bangalore/Hyderabad (Mandatory to go to client location/office 5 days/week)

Notice period

20-30 days, not more than that.

WFO/WFH/Hybrid WFO

WFO