The work described here looks at the difficulties hidden behind the transformation of typical scholarly document annotations (expressing their contributions or their connections) into ontology-supported knowledge triples, and presents our approach to assist this process, through the association of different text analysis techniques in a supportive interface, ClaimSpotter. Finally, we also introduce why typical annotation evaluation measures cannot be applied here and motivate the need for a different approach.