Sr. Data Engineer (Data Science)

4 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

What you will do:

● Partner with ML Architects and data scientists to drive POCs to build a scalable, next generation model development, model management and governance infrastructure in Cloud

● Be a thought leader and champion for adoption of new cloud-based database technologies and enable migration to new cloud-based modeling stack

● Collaborate with other data scientists and team leads to define project requirements & build the next generation data source ingestion, ETL, data pipelining, data warehousing solutions in Cloud

● Build data-engineering solutions by developing strong understanding of business and product data needs

● Manage environment security permissions and enforce role based compliance

● Build expert knowledge of the various data sources brought together for audience propensities solutions – survey/panel data, 3rd-party data (demographics, psychographics, lifestyle segments), media content activity (TV, Digital, Mobile), and product purchase or transaction data and develop solutions for seamless ingestion and process of the data

● Resolve defects/bugs during QA testing, pre-production, production, and post-release patches

● Contribute to the design and architecture of services across the data landscape

● Participation in development of the integration team, contributing to reviews of methodologies, standards, and processes

● Contribute to comprehensive internal documentation of designs and service components.





Required Skills:

● Background in data pipelining, warehousing, ETL development solutions for data science and other Big Data applications

● Experience with distributed, columnar and/or analytic oriented databases or distributed data processing frameworks

● Minimum of 4 years of experience with Cloud databases –Snowflake, Azure SQL database, AWS Redshift, Google Cloud SQL or similar. Experience with NoSQL databases such as mongoDB, Cassandra or similar is nice to have

● Snowflake and/or Databricks certification preferred

● Minimum of 3 years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, data lake and data warehouse solutions

● Minimum of 3 years of hands-on experience in Big Data technologies such as Hadoop, Spark, PySpark, Spark/SparkSQL, Hive, Pig, Oozie and streaming technologies such as Kafka, Spark Streaming Ingestion API, Unix shell/Perl scripting etc.



Skill set Must Have:


Snowflake, Azure SQL database, AWS

Redshift, Google Cloud SQL, ETL, data warehouse, big data, git hub, ML Algorithm, databricks



Year Of Experience- 5-10 years

Work Mode: Hybrid

Shift Time: EMEA Shift(1:00 PM-10:00 PM)

Location: PUNE

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You