Cloud Peritus logo

Senior Data Engineer

Cloud Peritus

5 - 10 years

25 - 40 Lacs

Hyderabad

Posted:2 days ago

Job Description

Job Summary

We are seeking an experienced Senior AWS & Salesforce Data Migration Developer with

strong expertise in AWS data migration, Salesforce data migration, ETL development, data

integration, data transformation, and cloud data engineering. The ideal candidate should

possess extensive hands-on experience migrating enterprise data between legacy/on-

premises systems, AWS cloud platforms, and Salesforce.

The candidate will be responsible for designing, developing, and implementing scalable

data migration solutions using AWS DMS, AWS Glue, S3, Python, SQL, Salesforce APIs,

Salesforce Data Loader, and ETL tools. The role requires strong experience in Salesforce

data modeling, bulk data migration, data cleansing, transformation, validation,

reconciliation, and integration with AWS services.

The candidate will work closely with Solution Architects, Salesforce Architects, Data

Architects, Business Analysts, Application Teams, and cross-functional teams to deliver

secure, reliable, and high-performance migration solutions with minimal business

disruption.

Salesforce Data Migration

Salesforce Data Model

Understand and work with Salesforce standard and custom objects, relationships,

external IDs, lookup relationships, master-detail relationships, record types, and

dependent data structures.

Design migration approaches that maintain Salesforce data integrity and correctly

handle parent-child relationships and object dependencies.

Salesforce Data Migration

Perform high-volume data migration into and out of Salesforce using Salesforce

Data Loader, Salesforce APIs, Bulk API, Bulk API 2.0, REST API, and ETL tools.

Develop migration strategies for Accounts, Contacts, Leads, Opportunities, Cases,

Products, Assets, Users, and custom objects.

Salesforce Data Loader

Use Salesforce Data Loader for bulk insert, update, upsert, delete, export, and hard-

delete operations.

Configure appropriate batch sizes, external IDs, CSV mappings, and migration

sequences for large-volume data loads.

Salesforce Bulk API

Use Salesforce Bulk API and Bulk API 2.0 for high-volume data migration and

integration scenarios.

Design asynchronous migration processes capable of processing large datasets

while minimizing Salesforce API consumption and processing time.

Salesforce API Integration

Develop integrations between Salesforce and AWS/enterprise systems using REST

API, SOAP API, Bulk API, and other Salesforce integration mechanisms.

Implement authentication, error handling, retry mechanisms, logging, and

monitoring for Salesforce integrations.

Salesforce Data Transformation & Cleansing

Data Mapping

Create detailed source-to-Salesforce mapping documents covering source fields,

Salesforce target fields, data types, transformation rules, default values, external

IDs, and lookup relationships.

Data Transformation

Transform legacy and AWS data into Salesforce-compatible formats and

structures.

Implement business rules for data standardization, normalization, enrichment,

deduplication, and relationship mapping.

Data Cleansing

Identify and resolve duplicate, incomplete, invalid, and inconsistent customer

records before loading data into Salesforce.

Implement data-quality checks to ensure migrated records meet Salesforce

validation and business requirements.

Data Standardization

Standardize addresses, phone numbers, email addresses, customer identifiers,

account names, product information, and other master-data attributes before

migration.

Salesforce & AWS Integration

AWS to Salesforce

Design and implement data pipelines to extract data from Amazon S3, RDS,

Redshift, AWS Glue, or other AWS services and load transformed data into

Salesforce.

Salesforce to AWS

Extract Salesforce data using APIs, Bulk API, or ETL tools and load it into AWS S3,

Redshift, RDS, or other AWS data platforms for analytics, reporting, archival, or

downstream processing.

AWS Glue & Salesforce

Develop AWS Glue jobs to extract, transform, validate, and load Salesforce data.

Implement reusable Glue-based frameworks for Salesforce-to-AWS and AWS-to-

Salesforce data integration.

Python & Salesforce

Develop Python-based utilities using libraries such as Boto3 and Salesforce API

clients to automate data extraction, transformation, migration, validation, and

reconciliation.

Middleware Integration

Work with integration platforms such as MuleSoft, Informatica, Boomi, Talend, or

similar technologies to integrate Salesforce with AWS and enterprise applications.

Salesforce Data Validation & Reconciliation

Record-Level Validation

Validate migrated Salesforce records against source data to ensure accuracy and

completeness.

Record Count Reconciliation

Compare source and target record counts across objects, migration batches, and

migration waves.

Field-Level Validation

Validate critical fields, data types, transformations, relationships, and business

rules after migration.

Relationship Validation

Verify Salesforce parent-child relationships, lookup relationships, master-detail

relationships, and external ID mappings.

Migration Audit

Maintain migration logs, error records, rejected records, retry information, and

reconciliation reports to provide end-to-end migration traceability.

Salesforce Data Migration Strategy

Migration Sequencing

Define migration sequences based on Salesforce object dependencies.

For example, migrate Users and reference/master data before Accounts and

Contacts, followed by transactional and dependent objects where applicable.

Incremental Migration

Implement incremental and delta migration strategies to migrate only newly

created or modified records between migration cycles.

Full Load & Delta Load

Support initial full migration followed by incremental/delta loads leading up to

production cutover.

Cutover

Develop and execute Salesforce migration cutover plans including data freeze,

final extraction, transformation, loading, validation, reconciliation, and application

enablement.

Rollback

Define rollback and recovery procedures for migration failures, data discrepancies,

or unexpected production issues.

Salesforce Performance & Limits

Governor Limits

Design migration and integration solutions that account for Salesforce governor

limits, API limits, heap size, CPU time, and transaction limits.

API Optimization

Optimize Salesforce API usage through Bulk API, batching, asynchronous

processing, incremental extraction, and appropriate batch sizes.

Large Data Volumes

Develop migration strategies for Salesforce Large Data Volume (LDV)

environments.

Optimize queries, data loads, indexing, external IDs, and migration sequencing for

large Salesforce datasets.

Salesforce Security

Authentication

Implement secure Salesforce authentication using OAuth 2.0, Connected Apps,

Named Credentials, External Credentials, JWT, or other approved mechanisms.

Data Security

Ensure sensitive Salesforce data is securely transferred between Salesforce, AWS,

and enterprise systems.

Encryption

Implement appropriate encryption mechanisms for data at rest and in transit

using Salesforce and AWS security capabilities.

Access Control

Work with Salesforce security teams to ensure appropriate permissions, profiles,

permission sets, sharing rules, and integration-user access are configured for

migration activities.

Salesforce Development

Apex

Develop Apex classes, batch jobs, schedulable classes, and utility components

when custom Salesforce logic is required to support migration or integration

activities.

Batch Apex

Use Batch Apex for processing large datasets where appropriate, while considering

Salesforce governor limits and performance requirements.

SOQL

Develop optimized SOQL queries for data extraction, validation, and migration

support.

Triggers & Automation

Understand Salesforce triggers, Flows, validation rules, and other automation that

may affect data migration.

Identify and manage automation that could impact bulk data loads and migration

performance.

Migration Tools & Technologies

The candidate should have hands-on experience with several of the following:

  • AWS DMS

  • AWS Schema Conversion Tool

  • AWS Glue

  • Amazon S3

  • Amazon RDS

  • Amazon Redshift

  • AWS Lambda

  • Amazon CloudWatch

  • Salesforce Data Loader

  • Salesforce Bulk API / Bulk API 2.0

  • Salesforce REST API / SOAP API

  • Salesforce Workbench

  • Salesforce Inspector or equivalent data tools

  • Informatica

  • MuleSoft


  • Boomi

  • Talend

  • Python

  • SQL

  • PySpark

  • Git

  • Jenkins / GitHub Actions / Azure DevOps

  • Terraform / CloudFormation

Salesforce & AWS DevOps

Version Control

Maintain Salesforce Apex, configuration, Python scripts, ETL code, AWS Glue jobs,

and migration utilities in Git-based repositories.

CI/CD

Support automated deployment pipelines for Salesforce and AWS components

using tools such as GitHub Actions, Jenkins, Azure DevOps, Salesforce CLI, or

equivalent technologies.

Salesforce DX

Use Salesforce CLI and Salesforce DX practices for managing Salesforce metadata,

Apex code, deployment packages, and environment management.

Environment Management

Support migration across Salesforce environments such as Development, QA, UAT,

Full/Partial Sandbox, and Production.

Development Best Practices

Migration Framework

Develop reusable and configuration-driven migration frameworks that support

multiple migration projects, objects, environments, and data sources.

Error Handling

Implement robust error handling, retry mechanisms, rejected-record processing,

and exception management across AWS and Salesforce migration processes.

Logging & Monitoring

Implement comprehensive logging and monitoring across AWS pipelines, ETL jobs,

Salesforce API integrations, and migration processes.

Documentation

Create technical design documents, source-to-target mappings, migration

runbooks, data dictionaries, validation reports, deployment guides, and

operational documentation.

Testing

Develop unit, integration, system, performance, data-quality, and migration-

validation test cases.

Soft Skills

  • Excellent analytical and problem-solving skills with strong attention to data

accuracy and migration quality.

  • Strong understanding of both AWS cloud data services and Salesforce data

architecture.

  • Strong verbal and written communication skills with the ability to collaborate with

Salesforce, AWS, data, and business teams.

  • Proven ability to manage complex data migration projects involving multiple

source and target systems.

  • Strong troubleshooting and debugging skills across AWS, Salesforce, ETL, API, and

database environments.

  • Ability to translate business requirements into scalable data migration and

integration solutions.

  • Strong ownership of migration deliverables, testing, documentation, and

production support.

Preferred Certifications

  • AWS Certified Data Engineer Associate


  • AWS Certified Solutions Architect – Associate

  • AWS Certified Developer – Associate

  • Salesforce Certified Platform Developer I

  • Salesforce Certified Platform Developer II

  • Salesforce Certified Administrator

  • Salesforce Certified Data Cloud Consultant

  • Salesforce Certified Integration Architect

  • MuleSoft Certified Developer – Level 1


Skills Required

Senior Salesforce Amazon Redshift AWS Pyspark Glue Data Athena

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Cloud Peritus logo
Cloud Peritus

RecommendedJobs for You

Recruito logo

India

Jobaaj Com logo

Noida

YouGov logo
HP logo
Ecolab logo

Bengaluru

Hiringhood logo

Hyderabad

IntraEdge logo

Pune

NationsBenefits logo

Senior Data Engineer

NationsBenefits

Hyderabad

P

Hyderabad