Arthur's poems have appeared in The New Yorker, Poetry, The New York Review of Books, and The London Review of Books. He has received the Amy Lowell Travelling Poetry Scholarship, a Hodder Fellowship, a Stegner Fellowship, a Discovery/The Nation Prize, a Fulbright Scholarship to Northern Ireland, and a visiting fellowship at Exeter College, Oxford. He teaches at Johns Hopkins University.