Sr. Data Engineer

About the job

Join MSBC as a Senior Python Developer – Driving Excellence in Data Engineering & Financial Reporting

Senior Python Developer

Key Tools

• Programming:

  Python, Pandas

• Data Engineering:

  AWS Glue, Apache Spark, Databricks

• Database:

  SQL, Stored Procedures, Query Profiling Tools

• Cloud:

  AWS S3, IAM, Glue ETL

• Version Control & Collaboration:

  Git, Jira, Confluence

• DevOps & CI/CD:

  Jenkins, Terraform (preferred)

Key Responsibilities

Data Pipeline Development

• Design, develop, and maintain scalable

  ETL pipelines

  using

  AWS Glue

  ,

  Apache Spark

  , or

  Databricks

  for large-scale financial reporting workflows.
• Write advanced Python code, leveraging

  Pandas

  for high-performance data manipulation and transformation.

Database & Query Optimization

• Implement and optimize complex

  SQL logic

  including partitioning strategies, CTEs, cursors, triggers, joins, and stored procedures.
• Perform query profiling, performance tuning, and bottleneck resolution.

Cloud Engineering

• Work extensively with AWS services including S3 for data storage, Glue for ETL orchestration, and IAM for secure access control.
• Ensure fault-tolerant, high-performance solutions in collaboration with engineering and data teams.

Documentation & Collaboration

• Create and maintain technical design documents and data flow diagrams.
• Partner with cross-functional teams to align technical solutions with business requirements.

Continuous Improvement

• Adopt best practices in coding, version control, and deployment.
• Stay updated on emerging cloud and data technologies to enhance system performance and maintainability.

Required Skills & Qualifications

• 5+ years in Data Engineering, Backend Development, or Software Development roles.
• Expert-level Python skills, especially for

  data-centric applications

  .
• Strong proficiency in

  Pandas

  for dataframe-based transformations.
• Advanced SQL skills, including stored procedures, optimization, and data warehousing techniques.
• Experience with AWS Glue ETL or equivalent Spark frameworks (Databricks, Apache Spark).
• Understanding of query profiling, performance tuning, and cloud-based processing optimization.
• Solid grasp of data structures, modeling, and lifecycle management.
• Experience in

  financial data processing

  , brokerage platforms, or reporting systems.
• Knowledge of

  DevOps practices

  , CI/CD pipelines, or Infrastructure-as-Code (Terraform).
• Familiarity with Git, Jira, and Confluence.
• Strong problem-solving, analytical, and communication skills.
• Ability to work independently and collaboratively in

  Agile/Scrum

  environments.
• Commitment to continuous improvement and technical excellence.

Note

This role follows UK shift timings and is based in Ahmedabad. Candidates from other locations can apply, as remote and hybrid work options are available.

About us

With over 20 years of experience, MSBC Group delivers cutting-edge technology solutions across industries like financial services, manufacturing, logistics, and startups. Our expertise spans AI, custom software, staff augmentation, and managed services. Operating globally, we drive innovation in trading platforms, application migrations, and real-time analytics, making us a trusted AI and automation partner.