Big Data Engineer

Job Description

Job Information Number of Positions 3 Date Opened 05/20/2025 Job Type Full time Industry Technology City Bangalore South State/Province Karnataka Country India Zip/Postal Code 560066 Job Description Job Roles and Responsibilities: What You’ll Do: You are an experienced Software Engineer, Data/Data Engineer who’s passionate about developing products that are simple, intuitive, and beautiful. You will be making an impact on HG’s core data platform/processing engine using modern Big Data techniques particularly working with enterprise applications for B2B. We are a small engineering focused team who are delivering innovative features in a fast-growing market. We build Big Data systems utilizing cutting edge technologies and solutions that allow our developers to learn and develop while shipping amazing products. You will be involved in building data pipelines at a large scale to enable business teams to work with data and analyze metrics that support and drive the business. You will partner with cross functional teams to identify opportunities and continuously develop and improve processes for efficiency. What You'll Be Responsible For: Collaborating with Product Development Teams to build the most effective solutions Developing and enhancing features in our databases, backend apps, front end UI, and Data as a Service (DAAS) product Building data pipelines to support our data ingesting, cleansing, enriching, and presentation efforts in support of our flagship SaaS applications Authoring and scheduling workflows monitored by Airflow Responsible for the design and architecture of data collection Collaborating with cross-functional teams to design and implement impactful solutions to department and business problems Support end users and teammates on code-related questions and issues Attend daily stand-up meetings, planning sessions, encourage others, and collaborate at a rapid pace What You’ll Need: BS, MS, or Ph.D. in Computer Science or related technical discipline 2+ years of experience in data engineering, or an equivalent combination of education and experience Experience using Scala/Java, Spark, Airflow and Hadoop are essential for success in this position 2 or more years of designing and programming in a work setting Advanced experience in SQL of any flavor (MySQL,Postgres, Snowflake, Sql server etc) Proficient in Java or Scala (understand and have real-world experience with design patterns) Experience with Amazon Web Services (EC2, S3, RDS, EMR, ELB etc.) or similar cloud platforms Experience with web services using REST Comfortable working with CI/CD and automation environments such as Docker, Kubernetes, Terraform or similar Understand pragmatic agile development practices Proven track record of successful project delivery