Posted:2 months ago|
Platform:
Work from Office
Full Time
Description Key Responsibilities Analyse raw data from various source files (e.g. EXCEL CSV JSON XML Parquet etc.) to identify formatting issues inconsistencies missing values and discrepancies. Use PySpark to transform clean and restructure source data to match the expected format for further processing and analysis. Apply data validation rules and data quality checks to correct issues related to data integrity including handling null values duplicate records and data type mismatches. Develop PySpark jobs to transform raw data into standardized formats (e.g. converting date formats normalizing text fields correcting encoding issues). Ensure that data transformations meet the required schema and business logic by utilizing PySpark Data Frame and SQL functionalities. Automate data transformation workflows and schedule data correction jobs to handle repetitive tasks efficiently. Build interactive notebooks and workflows to perform data transformations and analytics within the Azure Data Bricks platform. Develop and maintain data workflows in Azure Data Factory to orchestrate data movement and transformation across cloud-based storage and compute services. Implement scheduled and event-driven data pipeline orchestration using ADF with focus on data quality performance and scalability. Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade C Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility Yes Global Role Family 60236 (P) Software Engineering Local Role Name 6504 Developer / Software Engineer Local Skills 35611 Azure Databricks Languages RequiredEnglish Role Rarity To Be Defined
Growel Softech Pvt. Ltd.
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
My Connections Growel Softech Pvt. Ltd.
Information Technology Services
Approximately 200 Employees
1989 Jobs
Key People
Andhra Pradesh
3.0 - 7.0 Lacs P.A.
Chennai, Tamil Nadu, India
6.0 - 10.0 Lacs P.A.
Chennai, Tamil Nadu, India
7.0 - 10.0 Lacs P.A.
Bengaluru / Bangalore, Karnataka, India
3.0 - 7.0 Lacs P.A.
Hyderabad / Secunderabad, Telangana, Telangana, India
3.0 - 7.0 Lacs P.A.
Delhi, Delhi, India
3.0 - 7.0 Lacs P.A.
Noida, Uttar Pradesh, India
3.0 - 9.5 Lacs P.A.
Gurgaon / Gurugram, Haryana, India
7.0 - 14.0 Lacs P.A.
Noida, Uttar Pradesh, India
7.0 - 14.0 Lacs P.A.
Patan - Gujarat, Gujrat, India
4.0 - 11.0 Lacs P.A.