Topsy is an online analytical tool that evaluates millions of archived and real-time tweets based on their relevancy to a specific criterion. This report studies what Topsy considers relevant, how to create a relevant tweet, the accuracy of Topsy’s relevancy score and whether Topsy is an acceptable tool for use in gauging class participation. After thorough investigation, Topsy was determined to be a great analytical tool for monitoring Twitter participation, yet lacks the fundamental ability to distinguish between tweets relevant to coursework and tweets relevant to everything else.