Data Engineer

Signiminds Technologies

5 - 8 years

15 - 27 Lacs

bengaluru

Posted:2 weeks ago| Platform:

Apply

Skills Required

pyspark gcp data bricks python sql unit testing terraform ci/cd rest api services unity catalog

Work Mode

Remote

Job Type

Full Time

Job Description

5+ Years of over all experience as Data engineer with required skills in
Pyspark, Spark SQL, Databricks, Data Governance Unity Catalog,, Python Pandera Framework, Rest API Frameworks
Design and build data infrastructure: Create and maintain scalable data pipelines, databases, and data warehouses to handle large volumes of data from various sources.
Ensure data quality and reliability: Implement data cleansing, validation, and quality checks to ensure the data is accurate and trustworthy.
Optimize data systems: Monitor and tune performance of databases and data processing tasks to ensure efficiency and speed.
Collaborate with stakeholders: Work with data scientists, analysts, and other teams to understand their data requirements and make data accessible for their use.

Preferred Experience:

Experience with cloud services (e.g. GCP Services - Cloud build, BigQuery, Firestore etc, Airbyte/Fivetran
Experience in writing unit test in Nutter Framework
Terraform Mandatory, CI/CD Concepts, OAuth 2 Protocol
Role & responsibilities

More Jobs at Signiminds Technologies

DFT Engineer / ASIC Verification Engineer (with Radar IC Focus)

Bengaluru

6 - 11 yrs

INR 30 - 40 Lacs

Java / Scala Consultant with Big Data ecosystems expertise

Hyderabad

10 - 20 yrs

INR 37 - 50 Lacs

Tibco BW/BWCE Developer

Gurugram

5.0 - 8.0 yrs

INR 15 - 25 Lacs

Director of Engineering - Data Platform

Hyderabad

10.0 - 20.0 yrs

INR 60 - 75 Lacs

Security Engineer (Security Automations)

Hyderabad

5.0 - 10.0 yrs

INR 30 - 45 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.