Data Engineer

2 - 4 years

0 Lacs

Pune/Pimpri-Chinchwad Area

Posted:5 days ago| Platform: Linkedin logo

Apply

Skills Required

data cybersecurity maintenance support software database analytics integration developer sql query development tuning server python mysql elasticsearch api optimization indexes orchestration gitlab docker kubernetes design scalability communication

Work Mode

On-site

Job Type

Full Time

Job Description

Why it’s worth it: Qualified candidates will work closely with cross-functional teams that turn data into critical information and knowledge that can be used to make sound business decisions and business processes. They will gain an in-depth understanding of the cybersecurity business environment and will be responsible for the maintenance and health of tools that ingest data generated by a diverse set of platforms. This position will support our software developers, database architects, analytics engineers, business analysts and data scientists on data initiatives and will ensure optimal data delivery is consistent throughout ongoing projects. This position will also be responsible for data integration between in-house and commercial applications within the environment. The everyday hustle: Ability to work with multiple developer teams Complex SQL Query development including performance tuning in Snowflake, Postgres, and SQL Server Environments Develop in Python using object-oriented approach to efficiently create jobs to ingest raw data, transform, and create application integrations Ingest raw data using Python with Snowflake, Postgres, MySQL, Elasticsearch, SQL Server, API, and various other sources and destinations Create models in dbt (Data Build Tools) Creation and optimization of tables, indexes, stored procedures, views, and functions in Snowflake, Postgres, and SQL Server Creation of Argo CRON Workflows for job orchestration Contribute to multiple GitLab Repositories Basic GitLab CI/CD changes and modifications Work with docker containers for development and modify existing Dockerfiles Work with internal tools that are deployed on Kubernetes (EKS) Pods Responsible for the design, development, implementation and maintenance of Snowflake and Postgres databases Develop and interpret database models Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. May work after hours to complete business objectives if required Do you have what it takes? 2-4 years of Snowflake, Postgres, MSSQL or related Database Development and/or DBA experience Bachelor's degree in Computer Science or related discipline preferred Experience using Snowflake and/or other cloud-based databases / data stores preferred Excellent written and oral communication skills including an ability to communicate with internal and external cross functional teams (technical and business) Great Attitude, Energy, and Effort Show more Show less

Mock Interview

Practice Video Interview with JobPe AI

Start Data Interview Now

RecommendedJobs for You

Hyderabad, Ahmedabad, Bengaluru

Bengaluru, Karnataka, India

Hyderabad, Pune, Bengaluru

Chennai, Tamil Nadu, India