7 Spark Notebooks Jobs

JOB DESCRIPTION Roles & responsibilities Design, develop, and implement data pipelines for scalable solutions using various technologies Databricks or Microsoft Fabric Conduct Code reviews and recommend best coding practices Provide effort estimates to implement solutions, development effort for the proposed solutions Develop and maintain comprehensive documentation for all proposed solutions. models, including detailed technical specifications, results of testing and evaluation, and datasets used for developing the solutions Lead Architect and design efforts for Product development and application development for relevant use cases providing guidance and support to team members and clients ...

At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS Data and Analytics (D&A) MS Fabric Senior The opportunity We're looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. To qualify for the role, you must have We are looking for a Data Engineer with 5-10 years of experience in data warehousing, ETL/ELT processes, d...

JOB DESCRIPTION Roles & responsibilities Design, develop, and implement data pipelines for scalable solutions using various technologies Databricks or Microsoft Fabric Conduct Code reviews and recommend best coding practices Provide effort estimates to implement solutions, development effort for the proposed solutions Develop and maintain comprehensive documentation for all proposed solutions. models, including detailed technical specifications, results of testing and evaluation, and datasets used for developing the solutions Lead Architect and design efforts for Product development and application development for relevant use cases providing guidance and support to team members and clients ...

You will need to have at least 7-9 years of experience to apply for the role of Microsoft Fabric Architect. In this role, you will be responsible for working hands-on with Microsoft Fabric, which includes Lakehouse, Synapse, Pipelines, and Dataflows. You should be proficient in DAX, Power Query (M), and SQL, and have a strong understanding of Delta Lake, Parquet, and OneLake storage. Knowledge of Spark Notebooks, KQL, and Data Engineering within Fabric will be an added advantage. Experience with source control integration (Git) and CI/CD pipelines is essential for this role. Familiarity with Azure Data Factory, Azure Synapse Analytics, or Databricks will be considered a plus. You should poss...

As a Data Engineer at our organization, you will be responsible for designing, implementing, and maintaining data pipelines and data integration solutions using Azure Synapse. Your role will involve developing and optimizing data models and data storage solutions on Azure. You will collaborate closely with data scientists and analysts to implement data processing and data transformation tasks. Ensuring data quality and integrity through data validation and cleansing methodologies will be a key aspect of your responsibilities. Your duties will also include monitoring and troubleshooting data pipelines to identify and resolve performance issues promptly. Collaboration with cross-functional tea...

Job Description: Design, implement, and maintain data pipelines and data integration solutions using Azure Synapse Develop and optimize data models and data storage solutions on Azure Collaborate with data scientists and analysts to implement data processing and data transformation tasks. Ensure data quality and integrity through data validation and cleansing methodologies. Monitor and troubleshoot data pipelines to identify and resolve performance issues Collaborate with cross-functional teams to understand and prioritize data requirements. Stay up-to-date with the latest trends and technologies in data engineering and Azure services. Skills & Qualifications: Bachelors degree in IT, compute...

Req ID: 329296 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Data Engineer to join our team in Bangalore, Karn?taka (IN-KA), India (IN). Role description Design, implement, and maintain data pipelines and data integration solutions using Azure Synapse Develop and optimize data models and data storage solutions on Azure Collaborate with data scientists and analysts to implement data processing and data transformation tasks. Ensure data quality and integrity through data validation and cleansing methodologies. ...