There obviously needs to be a balance between good CG art and good a story. Personally, I would never drop a VN based on the quality of the graphic aspect alone.
A decent story is a must even if the visuals are terrible. Having said that, I would be disappointed if I encountered a visual novel that had a great story but bad art. Doesn't a great story deserve great art?