Curate large-scale data from a multitude of sources into appropriate sets for research and development for the data scientists, threat analysts, and developers across the company
Design, test, and implement storage solutions for various consumers of the data. Especially data warehouses like ClickHouse and OpenSearch.
Design and implement mechanisms to monitor data sources over time for changes using summarization, monitoring, and statistical methods
Design, develop, and maintain APIs that enable seamless data integration and retrieval processes for internal and external applications, and ensure these APIs are scalable, secure, and efficient to support high-volume data interactions
Leverage computer science algorithms and constructs, including probabilistic data structures, to distill large data into sources of insight and enable future analytics
Convert prototypes into production data engineering solutions through disciplined software engineering practices, Spark optimizations, and modern deployment pipelines
Collaborate on design, implementation, and deployment of applications with the rest of software engineering
Support data scientists and Product teams in building, debugging, and deploying Spark applications that best leverage data
Build and maintain tools for automation, deployment, monitoring, and operations
Create test plans, test cases, and run tests with automated tools

Be Prepared What You Bring

8+ years of experience in software development with programming languages such as Golang, Python, C, C++, C#, or Java,
Expertise in Big Data MapReduce, Spark Streaming, Kafka, Pub-Sub, In-memory Database
Experience with technologies such as OpenSearch/ElasticSearch
Experience in Data lake technologies like Clickhouse
Good exposure in application performance tuning, memory management, scalability
Ability to design highly scalable distributed systems using different open-source technologies
Experience in microservices development and container-based software using Docker/Kubernetes and other container technologies is a plus
Experience with AWS, GCP or Azure is a plus.
Experience building high-performance algorithms
Bachelor s degree in Computer Science, Computer Engineering, or Electrical Engineering is required, master s degree preferred

More Jobs at Snaproute

DevOps Engineer II

bengaluru

1.0 - 7.0 yrs

INR 7 - 11 Lacs

Apprentice - Campaign Operations Specialist

bengaluru

1.0 - 2.0 yrs

INR 1 - 4 Lacs

Cloud Engineer II

bengaluru

1.0 - 6.0 yrs

INR 6 - 10 Lacs

Golang Developer

bengaluru

6.0 - 11.0 yrs

INR 3 - 7 Lacs

Business Analyst II

thiruvananthapuram

5.0 - 10.0 yrs

INR 5 - 9 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.