Evaluate the structural faithfulness of analogies between target and
source domains
Instructions
Please carefully evaluate the analogy presented below. Your task is to
assess the structural faithfulness
of the mapping between the target concept and the source domain.
How to Evaluate
Structural Similarity (1-5): How structurally
similar are the properties and role of these two entities? For example, do an array and a parking garage have a similar structure? Does a car in a parking garage represent the same part of the structure that an element of an array does?
Factual Correctness (1-5): Are the statements
implied by this row factually correct in both domains? For example, does an array actually have numerical indices (the entities can be factually incorrect)? Does a parking garage actually have parking spots?
Rule Violation: Does this mapping violate any of
the formal rules or constraints of the target concept?
Global Evaluation
System Coherence (1-5): Do the target and source
entities form a coherent system when considered together? As in: how similar to each other are the systems presented by each column of the table as a whole?
Helpfulness (1-5): Does this analogy help you
understand the target concept?
Important Notes
Evaluate only what is shown - do not use external knowledge beyond
basic CS familiarity
You can return to these instructions at any time
Loading...
Progress: 0%
Please press this button before beginning the evaluation. The form will be enabled after a 3-second countdown.
⏱️ Timer & Progress Tracking
Please start the timer before beginning the evaluation. The form will be enabled after a 3-second countdown.
Countdown—
Elapsed0s
Rows touched0
Rows completed0
Progress0%
⏸️ Form is disabled. Please start the timer above to begin.
Please complete all required fields to submit.
Please slow down
We’re noticing very fast or highly uniform responses. To ensure
high-quality data, please take a moment to carefully evaluate each
mapping.