fix tokenize
authorNathan Binkert <binkertn@umich.edu>
Wed, 22 Jun 2005 13:52:02 +0000 (09:52 -0400)
committerNathan Binkert <binkertn@umich.edu>
Wed, 22 Jun 2005 13:52:02 +0000 (09:52 -0400)
commitc95e1281fc5ecfe3f65a59fa426f16a54b2a6a50
treebe85ce2bbaba3f2589f24debacc6a173950cb7e4
parent11894d3b4b85160e1cc0c0a20157f89dcd3bae6c
fix tokenize

base/str.cc:
    Fix tokenize so that it doesn't behave incorrectly when there
    are empty strings.
test/tokentest.cc:
    Clean up the test function so it's easier to see what's going on

--HG--
extra : convert_revision : c7a3db7bc516d3575b1cc4ab7afbd0f1fbe1ec6f
base/str.cc
test/tokentest.cc