3 - 5 years
5 - 11 Lacs
Posted:6 days ago|
Platform:
Hybrid
Full Time
We are looking for a savvy Data Engineer to manage in-progress and upcoming data infrastructure projects. The candidate will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder using Python and data wrangler who enjoys optimizing data systems and building them from the ground up. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.
• Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements using Python and SQL / AWS / Snowflakes.• Identify, design, and implement internal process improvements through: automating manual processes using Python, optimizing data delivery, re-designing infrastructure for greater scalability, etc.• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL / AWS / Snowflakes technologies.• Build analytics tools that utilize the data pipeline to provide actionable insights intocustomer acquisition, operational efficiency and other key business performancemetrics.• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.• Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.• Work with data and analytics experts to strive for greater functionality in our data systems.
• Advanced working SQL knowledge and experience working with relationaldatabases, query authoring (SQL) as well as working familiarity with a variety ofdatabases.• Experience performing root cause analysis on internal and external data andprocesses to answer specific business questions and identify opportunities forimprovement.• Strong analytic skills related to working with unstructured datasets.• Build processes supporting data transformation, data structures, metadata, dependency and workload management.• A successful history of manipulating, processing and extracting value from largedisconnected datasets.
• 3+ years of experience in a Python Scripting and Data specific role, with Bachelor degree.• Experience with data processing and cleaning libraries e.g. Pandas, numpy, etc., web scraping/web crawling for automation of processes, APIs and how they work.• Debugging code if it fails and find the solution. Should have basic knowledge of SQL server job activity monitoring and of Snowflake.• Experience with relational SQL and NoSQL databases, including PostgreSQL andCassandra.• Experience with most or all the following cloud services: AWS, Azure, Snowflake,Google Strong project management and organizational skills.• Experience supporting and working with cross-functional teams in a dynamic environment
In this role, you will be a part of the centralised global office based in India and work closely with each of our markets globally to understand the clients communication objectives, access multiple data sources and visualise it using Tableau / Datorama, support on of ETL process using MSSQL / Alteryx Flow and has sound knowledge of Excel VBA.
o Building reports from data warehouse
o Review of completed reports for anomalies & discrepancies
o Troubleshooting data issues/discrepancies
o Ensure formatting & delivery parameters are met.
o Taxonomy classification
o Conversion re-naming, grouping
o Removal of test/ghost impressions.
Vipany Global Solutions
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Practice Python coding challenges to boost your skills
Start Practicing Python Now5.0 - 11.0 Lacs P.A.
chennai
5.0 - 10.0 Lacs P.A.
chennai
Experience: Not specified
Salary: Not disclosed
bengaluru
Experience: Not specified
2.0 - 4.0 Lacs P.A.
hyderabad
30.0 - 35.0 Lacs P.A.
hyderabad
30.0 - 35.0 Lacs P.A.
bengaluru
8.0 - 12.0 Lacs P.A.
bengaluru
8.0 - 11.0 Lacs P.A.
bengaluru
11.0 - 15.0 Lacs P.A.
hyderabad
5.0 - 14.0 Lacs P.A.