Data Engineer

This position is on the Connectivity Enabled Solutions Team in Connectivity Department within the CAT Digital organization. This team has accountability for

• Building common datasets to support Connectivity initiatives.
• Streamline reporting of data through various sources, enhancing business logic to improve data reporting, and delivering visualize data in a consistent way for internal and external business users.
• Building solutions for CAT and dealers to better support the customers

We are seeking a skilled and motivated Data engineer with 3-7 years of experience to join our team. The resource should have hands-on experience in SQL development, Snowflake data warehousing, and data visualization tools such as Power BI and Tableau. The resource will be responsible for designing, building, and maintaining views, scalable data pipelines and reporting solutions that support business intelligence and analytics initiatives.

Key Responsibilities

• Design, develop, and optimize robust data pipelines using SQL and Snowflake.
• Build and maintain data models and ETL processes to support analytics and reporting.
• Collaborate with business stakeholders to understand reporting needs and translate them into actionable dashboards.
• Develop and maintain interactive dashboards and reports using Power BI and Tableau.
• Ensure data quality, integrity, and governance across all data sources.
• Monitor performance and troubleshoot issues in data workflows and reporting layers.
• Document technical solutions and maintain best practices for data engineering.

Required Qualifications/Experience

• Bachelors degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering or a similar role.
• Strong proficiency in SQL for data manipulation and transformation - relational databases such as MySQL, PostgreSQL, NoSQL database, etc
• Big data and data modelling: Experience with Snowflake or similar cloud data platforms. Hands-on experience in data modelling, ETL processes, Data pipeline development, performance tuning and data warehousing
• Proven experience in building dashboards with Power BI and Tableau
• Power BI - Data Modelling, DAX, Power Query, Report & Dashboard Design, Data Connectivity, Performance Optimization, Row-Level Security
• Tableau - Data Preparation, Calculated Fields, Visual Analytics, Data Blending & Joins, Parameters & Actions, Publishing & Sharing
• Advance SQL such as CTEs, functions, procedures, pivoting, window functions, performance tuning, etc.
• Snowflake environment such as task, procedures, streams, Snowpark, Streamlit, AI/ML studio, etc.
• Excellent problem-solving skills and attention to detail.

Preferred (But not required) Experience

• Experience with cloud platforms like AWS:
• Message brokers such as Kafka, AWS SQS, AWS SNS, Kinesis
• AWS environment such as Lambda functions, SQS, Step Functions
• Knowledge of scripting languages like Python - Python data libraries such as Pandas, NumPy, Airflow, PySpark, Matplotlib, etc.
• Understanding of CI/CD pipelines and version control systems - Git repositories, code versioning, development and integration of CI/CD pipelines, etc.
• Container Platforms and orchestration such as Docker, ECR, Kubernetes.
• Exposure to Agile methodologies and tools like Azure DevOps.