Job
Description
Banking Full-Time Job ID: DGC00763 Mumbai, Maharashtra 1-4 Yrs ₹1.5 - ₹05 Yearly Job description We are seeking bright and resourceful individuals for our Data Engineering team. This team is responsible for the day-to-day operational support and stability of our infrastructure. Roles & Responsibilities Create and maintain optimal and robust data pipeline architecture Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources. Work with stakeholders including the Executive, Research and Development teams to assist with data-related technical issues and support their data infrastructure needs. Work with data and analytics experts to strive for greater functionality in our data systems. Build processes supporting data transformation, data structures, metadata, dependency, and workload management. A successful history of manipulating, processing and extracting value from large disconnected datasets Coordinate with global teams to understand data processing requirements. Analyze the processed data to identify anomalies. Build & maintain tools to automate the pipelines and infrastructure management. Establishing programming patterns, documenting components and provide infrastructure for analysis and execution Set up practices on data reporting and continuous monitoring Write a highly efficient and optimized code that is easily scalable. Adherence to coding and quality standards. Required Skills Candidate with 2 years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field. Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience building and optimizing big data pipelines, architectures, and data sets. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Strong analytic skills related to working with unstructured datasets. Working knowledge of message queuing, stream processing, and highly scalable big data' data stores. Strong project management and organizational skills. Experience supporting and working with cross-functional teams in a dynamic environment. Hands-on experience in database administration, backup recovery, and troubleshooting in co-location environments. Good to have Experience with web crawling and scraping, text parsing Experience with Google Cloud Experience with ClickHouse Experience with Stock Market Data
