Posted:3 weeks ago|
Platform:
On-site
Full Time
Spark-SQL, Pyspark, Pandas,DevOps, CI/CD ,as SQL server, Oracle
3+ years experienced data engineer with sound ADF, Databricks and Pyspark knowledge and able to interact independently with customer technical team/leads
Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements
Develop and maintain innovative Azure solutions, Perform transformation using Databricks notebooks with Pyspark.
Solution design using Microsoft Azure services and other tools
The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)
Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications
Build data pipelines to collectively bring together data and setting up their orchestration and schedules ( DAGs)
Tata Consultancy Services
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
hyderabad, telangana, india
Salary: Not disclosed
hyderabad, telangana, india
Salary: Not disclosed
