Dan Evans scored two second half tries, with Jack Price adding a conversion and three penalties to take the lead before the Old Richians fly half slotted a penalty for victory in the final minute.
OBs lost Tom Keen to the sin bin for ten minutes just after the restart.
Man of the match went to Jimmy Adam for tireless work in the scrum and around the field.
OBs face Southmead at home this coming weekend.