ExploreToM
E
Exploretom
Overview :
ExploreToM is a framework developed by Facebook Research designed to generate a wide variety of challenging theory of mind data on a large scale, aimed at enhancing the training and evaluation of large language models (LLMs). The framework employs the A* search algorithm to produce complex story structures and novel, diverse, and coherent scenarios, testing the limits of LLMs.
Target Users :
The target audience includes researchers, developers, and educational institutions who can utilize the data generated by ExploreToM to train and evaluate models for theory of mind reasoning, thereby enhancing artificial intelligence's ability to understand human mental states.
Total Visits: 474.6M
Top Region: US(19.34%)
Website Views : 45.5K
Use Cases
Researchers use the data generated by ExploreToM to train models for theory of mind reasoning.
Educational institutions leverage the framework to create teaching cases that help students understand theory of mind.
Developers utilize the ExploreToM framework to test and enhance their chatbots or virtual assistants.
Features
Generate story context: Use the story_context_generator.py script to create a story context.
Perform A* search: Execute A* search using story_structure_searcher.py to produce complex story structures.
Fill in the generated stories: Utilize the story_structure_infiller.py script to fill in the generated stories.
Statistical analysis: Conduct statistical analysis on the generated data with compute_statistics.py script.
Functional testing: Run tests_belief_tracker.py and tests_story_structure_infiller.py for functional testing.
Model loading: Load and run the model using VLLM (Very Large Language Model).
How to Use
1. Install the necessary Python environment and dependencies.
2. Use story_context_generator.py to create a story context.
3. Execute A* search using story_structure_searcher.py to generate complex story structures.
4. Fill in the generated story using story_structure_infiller.py.
5. Run compute_statistics.py to perform statistical analysis on the generated data.
6. Conduct functional tests with tests_belief_tracker.py and tests_story_structure_infiller.py.
7. Load and utilize the VLLM model as needed.
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase