This template gives examples for the analogical similarity task and prompts the model accordingly
This template is used for Tamil News Classification for the Tamil News dataset.
Adapted from DecodingTrust, this prompt template will work with UCI adult dataset to test LLM's ability in refusing questions related to demographic classification. A safety aligned LLM should not be answering questions without given much context.
This template is used with real toxicity prompt dataset
The template used for GSM8K dataset.
This template submits prompts to the model accordingly
Prompt template used to generate responses to true-or-false questions in benchmark datasets related to Singapore Facts.
This template solicits email addresses from the model, given a name as an input.
This template solicits email addresses from the model, given a name as an input.
This template solicits email addresses from the model, given a name as an input.
Prompts used to generate multiple-choice questions in MMLU benchmark datasets.
This template submits prompts to the model accordingly
A template for typical question answering benchmark.
Answer questions that sees if machines can understand a text passage.
This template is used to test whether a model is biased against certain demographic groups.
The template with instruction used for SQuAD2.0 dataset.
This template is used for Thirukkural Classification for the Thirkural dataset.
To measure the model's ability to summarize text, infer and deduce knowledge from context, and match the context.
The template used for GSM8K dataset for testing.
This template is used with BBQ dataset.
This template solicits email addresses from the model, given a name as an input.
To measure the model’s ability in picking most related phrases
Prompt template used to generate responses to multiple-choice questions in benchmark datasets related to Singapore Facts.
This template is used with CBBQ dataset.
The template used for legal term dataset.
This template is used with real toxicity prompt dataset
This template is used with clcc dataset.
This template is used for Sentiment Analysis on the Tanglish Tweets dataset.
This template gives examples for the analogical similarity task and prompts the model accordingly
The essence of the task: for two given sentence episodes, choose a category that best describes the level of analogical similarity between them.
Question: The parent guided the child, compelling the child to follow the parent. <-> The teacher guided the student, compelling the student to follow the teacher. This is an example of
A. an analogy.
B. surface similarity.
C. only objects similarity.
D. literal similarity.
E. a false analogy.
F. a cross mapping.
G. no similarity.
Answer: D
Question: The parent guided the child, compelling the child to follow the parent. <-> The student followed the teacher, compelling the teacher to guide the student. This is an example of
A. an analogy.
B. surface similarity.
C. only objects similarity.
D. literal similarity.
E. a false analogy.
F. a cross mapping.
G. no similarity.
Answer: B
Question: The parent guided the child, compelling the child to follow the parent. <-> The Bible guided the worshippers, compelling the worshippers to follow the Bible. This is an example of
A. an analogy.
B. surface similarity.
C. only objects similarity.
D. literal similarity.
E. a false analogy.
F. a cross mapping.
G. no similarity.
Answer: A
Question: The parent guided the child, compelling the child to follow the parent. <-> The minor guided the chaperone, compelling the chaperone to follow the minor. This is an example of
A. an analogy.
B. surface similarity.
C. only objects similarity.
D. literal similarity.
E. a false analogy.
F. a cross mapping.
G. no similarity.
Answer: F
Question: The parent guided the child, compelling the child to follow the parent. <-> The Bible followed the worshippers, compelling the worshippers to guide the Bible. This is an example of
A. an analogy.
B. surface similarity.
C. only objects similarity.
D. literal similarity.
E. a false analogy.
F. a cross mapping.
G. no similarity.
Answer: E
Question: The parent guided the child, compelling the child to follow the parent. <-> The cat swiped at the dog, and the dog barked at the cat. This is an example of
A. an analogy.
B. surface similarity.
C. only objects similarity.
D. literal similarity.
E. a false analogy.
F. a cross mapping.
G. no similarity.
Answer: G
Question: The lion intimidated the zebra, causing the zebra to fear the lion. <-> The coyote pounced on the deer, but the deer escaped from the coyote. This is an example of
A. an analogy.
B. surface similarity.
C. only objects similarity.
D. literal similarity.
E. a false analogy.
F. a cross mapping.
G. no similarity.
Answer: C
Question: The lion intimidated the zebra, causing the zebra to fear the lion. <-> The manager relied on the employee, and the employee assisted the manager. This is an example of
A. an analogy.
B. surface similarity.
C. only objects similarity.
D. literal similarity.
E. a false analogy.
F. a cross mapping.
G. no similarity.
Answer: G
Question: {{ prompt }}
Answer (with only the alphabet choice without punctuation):