Data Engineer

BayOne Solutions

0 years

0 Lacs

india

Posted:1 month ago| Platform:

Apply

Skills Required

data microservices architecture engineering development optimization maintenance integration power design deployment processing storage code test service software testing verification troubleshooting analysis stack coding governance api support collaboration git jenkins scala java sql apache spark databricks maven gradle kafka library redis swagger json etl containerization docker aws azure gcp rust

Work Mode

On-site

Job Type

Contractual

Job Description

The Opportunity:

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions.

Responsibilities:

Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment.
Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability.
Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing/verification applications and other tools, while adhering to specific development best practices and quality standards.
Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components.
Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment.
Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements.
Implement and maintain data governance and API governance policies and standards across the microservices landscape.
Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services.
Available to support/unblock planned deployments during off hours.
Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies.
Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development.

We are excited about you if you have experience with the following technologies:

Git, CI/CD, Jenkins, ArgoCD
Scala/Java, SQL/SparkSQL, Python
Apache Spark, Databricks, Apache Storm
Cosmos DB, Redis,
Maven, Gradle Build Tools
Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas
Cosmos DB, Redis Cache and Redis Insight Tool
Grafana, Grafana Loki Logging
Restful API Design Patterns, Swagger Documentation
Experience with markup languages such as JSON and YAML
Proven experience designing and implementing microservices architectures.
Strong understanding of data modeling, data warehousing, and ETL processes.
Experience with containerization technologies such as Docker and Kubernetes.
Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services.
Experience with Node.js.

Familiarity with Rust is a plus.

Mock Interview

Practice Video Interview with JobPe AI

Start Java Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Java Skills

Practice Java coding challenges to boost your skills

Start Practicing Java Now

BayOne Solutions

IT Services and IT Consulting

Pleasanton CA

Login to

Please Verify Your Phone or Email

Confirm Action

Data Engineer