They may tear down the queen cell(s) after the virgin emerges so there might be no sign now. Often you can see something. However if there are no polished cells then I think that you can assume this one is queenless.