Software Engineer

Data Engineering at Ola:

We need to ensure every area of the business has trustworthy data to fuel insight and innovation. Understanding the business need, securing the right data sources, designing usable data models, and building robust & dependable data pipelines are essential skills to meet this goal.

At the same time, the technology used to create great data is continually evolving. We are moving to a reality where both batch & stream processing are leveraged to meet the latency requirements for the business. The Data Engineering paved path is still taking shape, and we want to collaboratively develop this to support the entire company. We need senior engineers who are passionate not only about the data, but also about improving the technology we leverage for Data Engineering.

We are looking for Data Engineers to help us build and enhance big data platforms to achieve availability, scalability and operational effectiveness. The right individual will embrace the opportunity to tackle challenging problems and use their influence to drive continual improvement. You will also work on the cutting edge of technology, leveraging Hadoop, Hbase, Hive, Kafka, Spark, Flink, Mesos/Kubernetes, Hudi/Deltalake , Prometheus, Grafana etc.

Roles and Responsibilities:

• Develop and automate large scale, high-performance data processing systems (batch and/or streaming) to drive Ola group business growth and improve the product experience.
• Evangelize high quality software engineering practices towards building data infrastructure and pipelines at scale.
• Lead data engineering modules to ensure pipelines are reliable, efficient, testable, & maintainable
• Design our data models for optimal storage and retrieval and to meet critical product and business requirements.
• Understand and influence logging to support our data flow, architecting logging best practices where needed

• Developing projects using agile methodologies.

Education Qualifications:

Bachelors and/or Master’s degree in CS, or equivalent experience.

Experience & Skills:

• 4+ years of relevant industry experience.
• 2+ years experience in custom ETL design, implementation and maintenance.
• Working knowledge of relational databases and query authoring (SQL).
• Good Experience with Java / Scala / Spark.
• Working experience with data at the petabyte scale.
• Experience designing, building and operating robust distributed systems.
• Experience designing and deploying high performance systems with reliable monitoring and logging practices.
• Experience of Amazon Web Services (AWS) and/or other relevant Cloud Infrastructure solutions like Microsoft Azure or Google Cloud.
• Experience in managing and deploying containerized environments using Docker, Mesos/Kubernetes is a plus.
• Experience with multiple datastores is a plus (MySQL, PostgreSQL, Aerospike, Couchbase, Scylla, Cassandra, Elasticsearch). Excellent communication skills, both written and verbal.