Staff Enterprise Data Engineer

8 - 13 years

9.0 - 13.0 Lacs P.A.

Hyderabad

Posted:3 months ago| Platform: Naukri logo

Apply Now

Skills Required

UnixPerformance tuningAutomationConsultingPeopleSoftPLSQLOracleSDLCAnalyticsPython

Work Mode

Work from Office

Job Type

Full Time

Job Description

The Data Engineer will build, manage and optimize data pipelines and move these data pipelines effectively into production for key data and analytics consumers like business/data analysts, data scientists or any business partner that needs curated data for data and analytics use cases across the enterprise. This role will be the key interface in operationalizing data and analytics on behalf of the business unit(s) and organizational outcomes and will require both creative and collaborative working with IT and the wider business. It will involve evangelizing effective data management practices and promoting better understanding of data and analytics. The data engineer will also be responsible for planning and implementing the best analytics and data science solutions utilizing a variety of technologies, including on-premises and cloud provider services (AWS or Azure), in collaboration with important business partners and IT specialists. Essential Duties/Responsibilities Create, maintain, and optimize data pipelines from development to production for specific use cases. Use innovative and modern tools, data services, techniques, and well architected frameworks to automate the most-common, repeatable and tedious data preparation and integration tasks partially or completely to minimize manual and error-prone processes and improve productivity. Assist with renovating the data management infrastructure to drive automation in data integration and management. This will include (but not be limited to): Learning and using modern data preparation, integration and AI-enabled metadata management tools and techniques. Tracking data consumption patterns Performing intelligent sampling and caching Optimizing data pipelines and managing day to day operations Recommending or sometimes even automating existing and future integration flows. Collaborate in close relationship with value stream teams on the initiatives in refining their data requirements for various data and analytics initiatives and their data consumption requirements. Build, model and curate data lake/warehouse and other data consumption methods. Required for All Jobs Performs other duties as assigned Complies with all policies and standards Education Bachelors Degree in Computer Science/Engineering or equivalent experience preferred Work Experience Typically 8+ years experience in implementation of Data & BI projects in a large-scale enterprise data lake/ warehouse environment required Typically 8+ years experience in ETL/ELT Architecture and hands-on experience in developing the ETL/ELT jobs using cloud native tools preferably AWS required Working experience in SFDC and PeopleSoft in areas of Sales, Marketing, Finance, or Support domains will be a plus Knowledge or experience in working with Cloud data warehouses like Snowflake, AWS Redshift Working experience with Python, PySpark and comparable technologies with focus on building scalable solutions. Good dimensional modelling, data warehousing and data analysis skills with expertise in at least one reporting tool like Tableau/PowerBI Hands on experience with database performance tuning like Oracle, Postgres and strong database languages like SQL, PL/SQL, ANSI SQL, Python, Unix Shell and Perl Scripting Knowledge, Skills and Abilities Knowledge of end-to-end SDLC process in EDW, Data Lake, BI & MLOps projects - Advanced Dimensional Modeling and Data warehouse, ODS concepts, such as star schemas, snowflakes and normalized data models - Advanced Ability to coordinate effectively with on-site and offshore resources through Managed Service Providers & IT Teams - Intermediate Knowledge of Reporting tools like Tableau is desired - Intermediate Excellent verbal and written communication skills -Advanced Travel Requirements Minimal travel Work Environment Work in a clean, pleasant, and comfortable office work setting. The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable persons with disabilities to perform the essential functions. This position is 100% in office.

Human Resources
San Leandro

RecommendedJobs for You