Senior Data Engineer

Candidate Specification :

Notice Period =

We are seeking a highly skilled Senior Data Engineer with strong expertise in cloud-based data solutions (primarily AWS). The ideal candidate will design and build scalable data pipelines, manage large datasets, and ensure reliable data availability for analytics and business intelligence. You will work closely with data scientists, analysts, and other engineering teams to enable advanced analytics and AI/ML initiatives.

Key Responsibilities

Design, develop, and optimize scalable ETL/ELT pipelines for structured and unstructured data. Architect and manage data lakes, data warehouses, and streaming platforms on AWS. Implement data ingestion from multiple sources (APIs, DBs, IoT, flat files, streaming). Ensure data quality, governance, and security across all pipelines. Collaborate with data scientists and analysts to deliver reliable datasets for analytics and ML models. Optimize data storage, retrieval, and processing for performance and cost efficiency. Mentor junior engineers and contribute to best practices in data engineering. Support CI/CD automation and monitoring for data workflows.

Required Qualifications

Bachelors or Masters degree in Computer Science, Data Engineering, or related field.

5+ years of experience in data engineering or related roles. Strong hands-on experience with AWS services: S3, Glue, Lambda, Step Functions, Kinesis, EMR, Athena, Redshift, RDS Expertise in SQL and working with relational and NoSQL databases. Proficiency in Python, Java, or Scala for data pipeline development. Strong knowledge of ETL/ELT frameworks, data modeling, and data warehousing concepts. Experience with CI/CD pipelines, Git, and containerization (Docker, Kubernetes/EKS). Good understanding of data governance, compliance, and security best practices.

Preferred Skills

Familiarity with other cloud platforms (Azure, GCP). Experience with real-time/streaming data processing (Kafka, Flink, Spark Streaming). Exposure to machine learning pipelines (SageMaker, MLflow). Knowledge of infrastructure as code (Terraform, CloudFormation). Experience with BI/analytics tools (QuickSight, Tableau, Power BI).

Contact Person: Christopher

Email ID: christopher@gojobs.biz