We are looking for a
Senior Data Engineer
with deep hands-on expertise in PySpark, Databricks, and distributed data architecture. This individual will play a lead role in designing, developing, and optimizing data pipelines critical to our Ratings Modernization, Corrections, and Regulatory implementation programs under PDB 2.0. The ideal candidate will thrive in fast-paced, ambiguous environments and collaborate closely with engineering, product, and governance teams.
Your Key Responsibilities
-
Design, develop, and maintain robust ETL/ELT pipelines using
PySpark and Databricks
. -
Own pipeline architecture and drive performance improvements through
partitioning, indexing, and Spark optimization
. -
Collaborate with product owners, analysts, and other engineers to gather requirements and resolve complex data issues.
-
Perform deep
analysis and optimization of SQL queries
, functions, and procedures for performance and scalability. -
Ensure high standards of
data quality and reliability
via robust validation and cleansing processes. -
Lead efforts in
Delta Lake and cloud data warehouse architecture
, including best practices for data lineage and schema management. -
Troubleshoot and resolve production incidents and pipeline failures quickly and thoroughly.
-
Mentor junior team members and guide best practices across the team.
Your skills and experience that will help you excel
-
-
Bachelors degree in Computer Science, Engineering, or a related technical field.
-
6+ years of experience in data engineering or related roles.
-
Advanced proficiency in
Python, PySpark, and SQL
. -
Strong experience with
Databricks
, BigQuery
, and modern data lakehouse design. -
Hands-on knowledge of
Azure
or GCP
data services. -
Proven experience in
performance tuning
and large-scale data processing
. -
Strong communication skills and the ability to work independently in uncertain or evolving contexts
About MSCI
What we offer you
- Transparent compensation schemes and comprehensive employee benefits, tailored to your location, ensuring your financial security, health, and overall wellbeing.
- Flexible working arrangements, advanced technology, and collaborative workspaces.
- A culture of high performance and innovation where we experiment with new ideas and take responsibility for achieving results.
- A global network of talented colleagues, who inspire, support, and share their expertise to innovate and deliver for for ongoing skills development.
- Multi-directional career paths that offer professional growth and development through new challenges, internal mobility and expanded roles.
- We actively nurture an environment that builds a sense of inclusion belonging and connection, including eight Employee Resource Groups. All Abilities, Asian Support Network, Black Leadership Network, Climate Action Network, Hola! MSCI, Pride & Allies, Women in Tech, and Women s Leadership Forum.
.
MSCI Inc. is an equal opportunity employer. It is the policy of the firm to ensure equal employment opportunity without discrimination or harassment on the basis of race, color, religion, creed, age, sex, gender, gender identity, sexual orientation, national origin, citizenship, disability, marital and civil partnership/union status, pregnancy (including unlawful discrimination on the basis of a legally protected parental leave), veteran status, or any other characteristic protected by law. MSCI is also committed to working with and providing reasonable accommodations to individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation for . Please note, this e-mail is intended only for individuals who are requesting a reasonable workplace accommodation; it is not intended for other inquiries.
To all recruitment agencies
.
Note on recruitment scams