Data Engineer

Greetings from TCS!

Python/Data Engineer

8 + Years

PAN India

Below are the responsibilities a Data Engineer is expected to assume:

• Data engineers should be comfortable with Python/Pyspark for scripting, data manipulation and automation
• Understand the data needs of the company or client
• Collaborate with the development team to design and build the database model
• Engage the development team to implement the database
• A deep understanding of relational databases (e.g., MySQL, PostgreSQL) and NoSQL
• Knowledge of NoSQL databases is essential, as they are often used to handle unstructured or semi-structured data.
• Proficiency in cloud platforms like AWS, Azure is necessary for data engineers.
• Determine the business needs for data reporting requirements
• Adjust access to the data and the reports as needed
• Work closely with the development team to implement data warehouse and reporting
• Understand the company's data migration needs
• Work with the development team to implement the migration
• Work with data scientists to determine metadata querying requirements
• Help to implement the querying
• Help determine and manage data cleaning requirements
• Help determine data security needs and implement security solutions

Thanks,

Anshika