Evaluating Large Language Models with Educational Knowledge Graphs: Challenges with Prerequisite Relationships and Multi-Hop Reasoning

Welcome to the page of Evaluating Large Language Models with Educational Knowledge Graphs: Challenges with Prerequisite Relationships and Multi-Hop Reasoning.

About

The dataset is a collection of four educational knowledge graphs with a focus on prerequisite relationships.

• All in ‘graphml’ for easy-loading.
• All nodes have IDs and names.
• Cover cases in English and Chinese.

Important Links

See the following pages for details:

• Download Dataset
• How to Run the Code
• Benchmark  

Announcement

Jun. 10, 2024 Website and GitHub updated for submission.

Jun. 10, 2024 Website is online.

Jun. 07, 2024 Code is available at Github.