Data Engineer / Sr.Data Engineer

Aurum Data Solutions

7 - 12 years

15 - 30 Lacs

hyderabad

Posted:1 day ago| Platform:

Apply

Skills Required

airflow data engineering pyspark databricks python parquet data lake avro sql rockset merging of data etl process cratedb data ingestion clickhouse microsoft azure api fastapi aws

Work Mode

Hybrid

Job Type

Full Time

Job Description

Very Urgent: Data Engineer / Sr.Data Engineer

Company: AurumData Solutions

Client: MNC

Experience: 7+years

Location: Jubilee Hills Hyderabad (Customer Location)

Job Mode: C2H

Duration: 1year + Ext

Work Type: Hybrid Mode

Note: The selected candidates will be required to work at the customer's location.

Key skills: Data Engineer, Python, PySpark, SQL, Databricks, Airflow, Data lake, merging of data, data ingestion, ETL Process, API, FastAPI, AWS (S3, IAM, ECR, Lambda), Rockset, Clickhouse, CrateDB, Avro, Parquet, ORC etc..

Job Summary:

Required skills & Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or related field
5+ years of experience in data engineering, with at least 2-3 years in a lead role
Strong proficiency in Python, PySpark, and SQL
Extensive experience with Databricks and AWS cloud services
Hands-on experience with Airflow for workflow orchestration
Familiarity with FastAPI for building high-performance APIs
Experience with columnar databases like Rockset, Clickhouse, and CrateDB
Solid understanding of data modeling, data warehousing, and ETL processes
Experience with version control systems (e.g., Git) and CI/CD pipelines
Excellent problem-solving skills and ability to work in a fast-paced environment
Strong communication skills and ability to work effectively in cross-functional teams
Knowledge of data governance, security, and compliance best practices
Proficiency in designing and implementing data lake architectures using AWS S3
Experience with Databricks Unity Catalog or similar data governance and metadata management tools
Experience with real-time data processing and streaming technologies
Familiarity with machine learning workflows and MLOps
Certifications in Databricks, AWS
Experience implementing data mesh or data fabric architectures
Knowledge of data lineage and metadata management best practices

Balaram@aurumdatasolutions.com

Regards

Balaram K
Mobile: +91-9000749410 Email: Balaram@aurumdatasolutions.com

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.