AWS/Azure Data Engineer with Databricks

Tata Consultancy Services

5 - 10 years

5 - 9 Lacs

pune

Posted:4 days ago| Platform:

Apply

Skills Required

data engineer hive python big data technologies databricks sql server sql analytics azure blob storage redshift spark apache spark hadoop data transformation aws big data etl cloudformation synapse analytics programming azure

Work Mode

Work from Office

Job Type

Full Time

Job Description

Key Technical Skills:

AWS tools (Redshift, Glue, EMR, Athena, StepFunction, CloudFormation, CloudWatch)
Programming languages: SQL, Python, Pyspark
Data Pipelining skills Data blending
Big data technologies: Hadoop, Hive
Data Ingestion and Integration:
Ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure. For example, use Azure Data Factory to orchestrate the extraction, transformation, and loading (ETL) of data from an on-premises SQL Server database to Azure Blob Storage.
Data Transformation and Processing:
Perform data transformation and processing tasks to prepare the data for analysis and reporting. Azure Databricks or Azure Synapse Analytics can be used for large-scale data transformations using tools like Apache Spark.

Desired Skills

AWS | Azure | Python | Spark | Data architectQualifications

Bachelor of Engineering

More Jobs at Tata Consultancy Services

Tcs Hiring For GRC , Pan India

Pune, Bengaluru, Mumbai (All Areas)

7 - 12 yrs

INR 9 - 19 Lacs

Java / Spring boot with API Developer

Pune

5 - 10 yrs

INR 9 - 19 Lacs

SAP PP and QM Consultant

Pune

4 - 9 yrs

INR 8 - 18 Lacs

SAP BTP Consultant

Pune

4 - 9 yrs

INR 9 - 19 Lacs

Customer Service Associate

Pune

1 - 6 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Data Engineer Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.