Posted:4 days ago|
Platform:
On-site
Full Time
Dear Candidate,
Thanks for Applying with TCS for Data Engineer
Job Description:
Experience in data engineering or big data development.
hands-on experience with Apache Spark.
• Strong programming skills in PySpark, Python, and Scala.
•experience in Scala backend development.
• Proficient in Scala, both object oriented and functional programming concepts.
• Deep understanding and application of advanced functional programming concepts like category theory, monads, applicatives, and type classes.
• Hands-On knowledge with Scala Typelevel libraries like Cats, Shapeless, and others used for building applications with strong typing and efficient concurrency.
• Solid understanding of data lakes, lakehouses, and Delta Lake concepts.
• Experience in SQL development and performance tuning. Proficient in cloud services (e.g. S3, Glue, Lambda, EMR, Redshift, CloudWatch, IAM).
• Familiarity with Airflow, dbt, or similar orchestration tools is a plus.
• Experience in CI/CD tools like Jenkins, GitHub Actions, or Code Pipeline.
• Knowledge of data security, governance, and compliance frameworks.
• Develop and maintain scalable data pipelines using Apache Spark on Databricks.
• Build end-to-end ETL/ELT pipelines on AWS/GCP/Azure using services like S3, Glue, Lambda, EMR, and Step Functions.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
• Design and implement data models, schemas, and Lakehouse architecture in Databrick/Snowflake.
• Optimize and tune Spark jobs for performance and cost-efficiency.
• Integrate data from multiple structured and unstructured data sources
. • Monitor and manage data workflows, ensuring data quality, consistency, and security.
• Follow best practices in CI/CD, code versioning (Git), and DevOps practices for data applications. • Write clean, reusable, well-documented code using Python / PySpark / Scala.
if you are interested in this position kindly share your cv or resume to this mail id guggilapubindusha.p@tcs.com
Tata Consultancy Services
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
hyderabad
5.0 - 6.0 Lacs P.A.
bengaluru
14.0 - 25.0 Lacs P.A.
bengaluru
27.5 - 42.5 Lacs P.A.
hyderabad, bengaluru, mumbai (all areas)
10.0 - 16.0 Lacs P.A.
bengaluru
50.0 - 65.0 Lacs P.A.
noida
0.5 - 3.0 Lacs P.A.
ahmedabad
15.0 - 30.0 Lacs P.A.
pune, chennai
0.5 - 2.25 Lacs P.A.
mohali district, india
Salary: Not disclosed
hyderabad
10.0 - 20.0 Lacs P.A.