Home
Jobs

Technical Architect - Data Engineering

10 years

0 Lacs

Gurugram Haryana India

Posted:2 weeks ago| Platform: Linkedin logo

Apply

Skills Required

data engineering design saas aws python etl integration security compliance governance processing github code development support pyspark monitoring agile sql architecture masking terraform powerbi tableau jira

Work Mode

On-site

Job Type

Full Time

Job Description

Job Description Design, build, and maintain scalable and efficient data pipelines to move data between cloud-native databases (e.g., Snowflake) and SaaS providers using AWS Glue and Python Implement and manage ETL/ELT processes to ensure seamless data integration and transformation Ensure information security and compliance with data governance standards Maintain and enhance data environments, including data lakes, warehouses, and distributed processing systems Utilize version control systems (e.g., GitHub) to manage code and collaborate effectively with the team Primary Skills Enhancements, new development, defect resolution, and production support of ETL development using AWS native services Integration of data sets using AWS services such as Glue and Lambda functions. Utilization of AWS SNS to send emails and alerts Authoring ETL processes using Python and PySpark ETL process monitoring using CloudWatch events Connecting with different data sources like S3 and validating data using Athena. Experience in CI/CD using GitHub Actions Proficiency in Agile methodology Extensive working experience with Advanced SQL and a complex understanding of SQL. Secondary Skills Experience working with Snowflake and understanding of Snowflake architecture, including concepts like internal and external tables, stages, and masking policies. Competencies / Experience Deep technical skills in AWS Glue (Crawler, Data Catalog): 10+ years. Hands-on experience with Python and PySpark: 5+ years. PL/SQL experience: 5+ years CloudFormation and Terraform: 5+ years CI/CD GitHub actions: 5+ year Experience with BI systems (PowerBI, Tableau): 5+ year Good understanding of AWS services like S3, SNS, Secret Manager, Athena, and Lambda: 5+ years Additionally, familiarity with any of the following is highly desirable: Jira, Gi (ref:hirist.tech) Show more Show less

More Jobs at Srijan: Now Material

Senior Manager - Business Consulting

Gurgaon, Haryana, India

Experience: Not specified

|

Salary: Not disclosed

Senior Associate - Global Data Collection

Gurgaon, Haryana, India

Experience: Not specified

|

Salary: Not disclosed

Senior Associate - Global Data Collection -n

Gurgaon, Haryana, India

Experience: Not specified

|

Salary: Not disclosed

Lead Data Engineer - Microsoft Azure , Synapse Data Engineering (Fabric)

Gurgaon, Haryana, India

5.0 - 5.0 yrs
|

Salary: Not disclosed

Technical Architect - Data Engineering

Gurugram, Haryana, India

10.0 - 10.0 yrs
|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Data Interview Now

My Connections Srijan: Now Material

Download Chrome Extension (See your connection in the Srijan: Now Material )

chrome image
Download Now
Srijan: Now Material

7 Jobs

RecommendedJobs for You

Srijan: Now Material logo

Technical Architect - Data Engineering

Srijan: Now Material

Gurugram, Haryana, India

Srijan: Now Material logo

Technical Architect - Data Engineering

Srijan: Now Material

Gurugram, Haryana, India