AWS Data engineer

Role: AWS Data Engineer

Experience: 4+ years

Work Location: TCS Kolkata

Responsibilities

• AWS Data engineer having experience in building data pipeline with Glue, Lambda, EMR, S3. Having experience in PySpark and Python programming.
• Should have PySpark, SQL, Azure Services (ADF, DataBricks, Synapse) Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks.
• Developing scalable and re-usable frameworks for ingesting data sets Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained.
• Working with event based / streaming technologies to ingest and process data.
• Working with other members of the project team to support delivery of additional project components (API interfaces, Search)
• Evaluating the performance and applicability of multiple tools against customer requirements
• Have knowledge on deployment framework such as CI/CD, GitHub check in process
• Able to perform data analytics, data analysis and data profiling Good communication

Qualifications

10+2+3 years of regular education is must

Minimum 4+ years of relevant experience is a must

Note:

Candidate should be willing to join in Third party payroll

Immediate to 30 days joiners are preferred