Overview
Join Intuit's Business Intelligence (BI) Platform team as we reimagine the next generation of scalable, intelligent data infrastructure. We serve over 240TB of data, 2 billion records daily, and deliver 200+ million report requests through 20+ complex pipelinessupporting enterprise and mid-market customers on their most critical decisions.We are seeking a Senior Data Engineer to join our Data Platform team, with a focus on designing robust data models, building scalable ETL/ELT pipelines, and enabling trustworthy, high-quality data for analytics, reporting, and intelligent systems.In this role, you will play a critical part in evolving our data architecture, ensuring data quality, and building integrations that power analytics and decision-making across the business.
Responsibilities
- Strong understanding of data engineering and dimensional design fundamentals, good at SQL, integration (ETL), front-end analysis / data visualization, and learning new technologies quickly.
- Hands on with python, pyspak ,spark SQL and Spark Optimization.
- Good understanding of data warehouse schema design and granularity of the data.
- Conceptual understanding of Machine Learning / LLM / GenAI Usage.
- Good understanding of data federation techniques and aggregation of data at scale from multiple source systems.
- Good understanding of Realtime Data Processing and Streaming using Kafka
- Designing and developing ETL pipelines across multiple platforms and tools including Spark, Hadoop and AWS Data Services.
- Gathering functional requirements, developing technical specifications, and project & test planning.
- Work with business users to develop and refine analytical requirements for quantitative data (view-through, clickstream, acquisition, product usage, transactions), qualitative data (survey, market research) and unstructured data (blog, social network).
- Designing and developing schema definitions and supporting data warehouse/mart to enable integration of disparate data sources from within Intuit and outside, aggregate it and make it available for analysis.
- Support large data volumes and accommodate flexible provisioning of new sources.
- As a key member of the team drive adoption of new technologies, tools, and process improvements to build world class analytical capabilities for web analytics, optimization, experimentation and personalization.
- Resolve defects/bugs during QA testing, pre-production, production, and post-release patches.
- Work cross-functionally with various Intuit teams: Product Management, Project Management, Data Architects, Data Scientists, Data Analysts, Software Engineers, and other Data Engineers.
- Contribute to the design and architecture of projects across the data landscape.
- Experience with Agile Development, SCRUM, or Extreme Programming methodologies.
- Helps to align to overall strategies and reconcile competing priorities across organizations.
Qualifications
- BS/MS in computer science or equivalent work experience.
- Experience in developing DB schemas, creating Data Pipelines with Spark and familiar with MPP/Hadoop systems.
- Must have mastery of data warehousing technologies including data modeling, ETL and reporting.
- Ideal candidate to have 4+ years of experience in end-to-end data warehouse implementations and at least 2 projects with 4TB+ data volume.
- Good understanding of Data ware House methodologies.
- Hands-on experience in any of the programming languages (Shell scripting, Python, Java, etc).
- Must have been through several full life cycle Data Warehousing implementations and involved in scalability and performance related design aspects in Database and ETL.
- Solid communication skills: Demonstrated ability to explain complex technical issues related to technical and non-technical audiences.
- Demonstrated understanding of the Software design and architecture process.
- Experience with unit testing and data quality automation checks
- Should be results oriented, self-motivated, accountable and work under minimal supervision.
- Excellent written, oral communication and presentation Skills.
Intuit provides a competitive compensation package with a strong pay for performance rewards approach. This position will be eligible for a cash bonus, equity rewards and benefits, in accordance with our applicable plans and programs (see more about our compensation and benefits at Intuit: Careers | Benefits). Pay offered is based on factors such as job-related knowledge, skills, experience, and work location. To drive ongoing fair pay for employees, Intuit conducts regular comparisons across categories of ethnicity and gender. The expected base pay range for this position is:
What you'll bringHow you will lead
