Data Engineering

Responsibilities :

• As an integral part of the Data Platform team, take ownership of multiple modules from design to deployment.
• Extensively build scalable, high-performance distributed systems that deal with large data volumes.
• Provide resolutions and/ or workaround to data pipeline related queries/ issues as appropriate
• Ensure that Ingestion pipelines that empower the Data Lake and Data Warehouses are up and running.
• Collaborate with different teams in order to understand / resolve data availability and consistency issues.
• Exhibit continuous improvement on problem resolution skills and strive for excellence What are we looking for ?
• Overall 1-3 years of experience in the software industry with minimum 2.5 years on Big Data and related tech stacks. Preferably from ecommerce companies.
• Strong Java core programming skills.
• Good to have programming skills in Java/Scala.
• Good design and documentation skills.
• Would have worked on Data at scale.
• Ability to read and write SQL - and understanding of one of Relational Databases such as MySQL, Oracle, Postgres, SQL Server.
• Development experience using Hadoop, Spark, Kafka, Map-Reduce, Hive, and any NoSQL databases like HBase.
• Exposure to tech stacks like Flink, Druid, etc.
• Prior exposure to building real time data pipelines would be an added advantage.
• Comfortable with Linux with ability to write small scripts in Bash/Python. Ability to grapple with log files and unix processes.
• Prior experience in working on cloud services, preferably AWS.
• Ability to learn complex new things quickly