Reacting after the Robins were able to bring the Saddlers' four-game unbeaten run to an end whilst extending their own run to eight outings, the Malton-born 35-year-old admitted he was disappointed to see his side slip to defeat.
Taking charge of his first game since he replaced new Port Vale manager Darrell Clarke, Dutton named a largely similar side to those selected by Clarke, and endured an all-too-familiar result, emphasised by another defensive error.
Despite the Saddlers opening the scoring via Caolan Lavery within just three minutes of kick-off, goals from debutants Sam Smith and Callum Wright helped Michael Duff's side take all three-points, keeping them within a point of second-placed Forest Green Rovers.
Speaking to the assembled media, Brian said; "It was a game of two halves. We got the early goal but Cheltenham dominated the first half with the possession.
"We found it difficult to get a good press on them, which allowed them territory into our half. I didn’t think they were causing us many problems with the territory they managed to get but we’ve given them a goal and poor defending for the second one.
"I’m disappointed with the goals we conceded. Disappointed that we weren’t more aggressive out of possession in the first half but delighted with the response second half."