Josh O'Keefe's 30-yard wonder goal helped Lincoln claim the spoils and move out of the bottom two after Stephen Hunt had broken the deadlock. Cheltenham pulled one back through Frankie Artus' thumping header in the 31st minute but the visitors held on for a significant win.
Speaking after the match, Yates said: "I'm as disappointed as I've ever been. I'm sorry for the fans for our display and that we gave ourselves a mountain to climb.
"I'm frustrated, disappointed and angry. It was unacceptable and not good enough. We huffed and puffed but we keep giving teams leads.
"There were too many wrong decisions. We warned them about set-pieces, but the marking for the first goal was comical. But we have been defending well at set-pieces.
"The players have let themselves down and they have let the supporters down. I'm at a loss myself in terms of what the players are thinking."
Source: PA
Source: PA