Recent enthusiasm for evidence-based policy-making in Australia has many sources. So-called 'managerialist' reforms to public administration have been significant, as has the diffusion of particular bio-medical models of research. However the meaning and practice of 'evidence-based policy' are contested. We offer an account of the design of arguments to identify and critically assess the value of evidence-based claims and their relationship to evidence-based policy. Our critique indicates the very wide range of what can properly count as evidence, based on a premise about the irreducible richness and complexity of social reality. We highlight the importance of being thoughtful about the assumptions that shape policy research questions and 'warrant' the conceptual connections that constitute knowledge claims. We illustrate our arguments with a policy research case study on juvenile crime.