Criteria that have an effect on users while making image relevance judgements

This paper reports the result of an ex- ploratory user study investigating criteria that are important to users when judging relevance while performing an image search. Data was collected from 12 participants using questionnaires and screen capture recordings. Users were required to perform three image search tasks which are speci c, gen- eral and abstract image search and judge relevance based on ten criteria identi ed from previous stud- ies. Findings show that some criteria were im- portant when making relevance judgements, with topicality, appeal of information and composition being the common criteria across the search tasks. However the order of importance of the criteria di er between the image search tasks.