We are looking for a
Senior Data Engineer
with deep hands-on expertise in PySpark, Databricks, and distributed data architecture. This individual will play a lead role in designing, developing, and optimizing data pipelines critical to our Ratings Modernization, Corrections, and Regulatory implementation programs under PDB 2.0. The ideal candidate will thrive in fast-paced, ambiguous environments and collaborate closely with engineering, product, and governance teams.
Your Key Responsibilities
-
Design, develop, and maintain robust ETL/ELT pipelines using
PySpark and Databricks
. -
Own pipeline architecture and drive performance improvements through
partitioning, indexing, and Spark optimization
. -
Collaborate with product owners, analysts, and other engineers to gather requirements and resolve complex data issues.
-
Perform deep
analysis and optimization of SQL queries
, functions, and procedures for performance and scalability. -
Ensure high standards of
data quality and reliability
via robust validation and cleansing processes. -
Lead efforts in
Delta Lake and cloud data warehouse architecture
, including best practices for data lineage and schema management. -
Troubleshoot and resolve production incidents and pipeline failures quickly and thoroughly.
-
Mentor junior team members and guide best practices across the team.
Your skills and experience that will help you excel
-
-
Bachelors degree in Computer Science, Engineering, or a related technical field.
-
6+ years of experience in data engineering or related roles.
-
Advanced proficiency in
Python, PySpark, and SQL
. -
Strong experience with
Databricks
, BigQuery
, and modern data lakehouse design. -
Hands-on knowledge of
Azure
or GCP
data services. -
Proven experience in
performance tuning
and large-scale data processing
. -
Strong communication skills and the ability to work independently in uncertain or evolving contexts
About MSCI
What we offer you
- Transparent compensation schemes and comprehensive employee benefits, tailored to your location, ensuring your financial security, health, and overall wellbeing.
- Flexible working arrangements, advanced technology, and collaborative workspaces.
- A culture of high performance and innovation where we experiment with new ideas and take responsibility for achieving results.
- A global network of talented colleagues, who inspire, support, and share their expertise to innovate and deliver for our clients.
- Global Orientation program to kickstart your journey, followed by access to our Learning@MSCI platform, LinkedIn Learning Pro and tailored learning opportunities for ongoing skills development.
- Multi-directional career paths that offer professional growth and development through new challenges, internal mobility and expanded roles.
- We actively nurture an environment that builds a sense of inclusion belonging and connection, including eight Employee Resource Groups. All Abilities, Asian Support Network, Black Leadership Network, Climate Action Network, Hola! MSCI, Pride & Allies, Women in Tech, and Women s Leadership Forum.
At MSCI we are passionate about what we do, and we are inspired by our purpose to power better investment decisions. You ll be part of an industry-leading network of creative, curious, and entrepreneurial pioneers. This is a space where you can challenge yourself, set new standards and perform beyond expectations for yourself, our clients, and our industry.