Home
>
Jobs in Delhi
>
Tata Consultancy Services
>
AWS Databricks Developer

AWS Databricks Developer

Tata Consultancy Services

3 years

0 Lacs

Delhi India

Posted:1 week ago| Platform:

Apply

Skills Required

aws databricks developer data integration pipeline development management optimization engineering apache spark kafka redshift tuning python pyspark terraform oracle sql server postgresql mysql database querying git bitbucket jenkins deployment airflow etl informatica

Work Mode

On-site

Job Type

Full Time

Job Description

Experience: More than 3 years in data integration, pipeline development, and data warehousing, with a strong focus on AWS Databricks. Technical Skills: Proficiency in Databricks platform, management, and optimization. Strong experience in AWS Cloud, particularly in data engineering and administration, with expertise in Apache Spark, S3, Athena, Glue, Kafka, Lambda, Redshift, and RDS. Proven experience in data engineering performance tuning and analytical understanding in business and program contexts. Solid experience in Python development, specifically in pySpark within the AWS Cloud environment, including experience with Terraform. Knowledge of databases (Oracle, SQL Server, PostgreSQL, Redshift, MySQL, or similar) and advanced database querying. Experience with source control systems (Git, Bitbucket) and Jenkins for build and continuous integration. Understanding of continuous deployment (CI/CD) processes. Experience with Airflow and additional Apache Spark knowledge is advantageous. Exposure to ETL tools, including Informatica. Show more Show less