There is always a possibility that something will be wrong with a refurb ... but that same possibility exists with a brand new camera. In fact, I personally feel better about buying refurbished products because it means an individual worker was responsible for examining that particular product and made sure it was in perfect working order before boxing it up and shipping it out.
When products are new on the assembly lines the workers just care about completing X number of units before the end of a shift. Every now and again a random unit is pulled out from the line for quality assurance but the overwhelming majority of electronics on the line don't undergo in-depth testing. Manufacturers just assume that if unit 112 worked perfectly and unit 418 worked perfectly then units 113 through 417 must have also been perfect.
I've bought many digital cameras over the last decade and I've had three "new" cameras (one Nikon, one Fujifilm, and one Pentax) that had to be set back to the manufacturer for service because of manufacturing problems. I've had ZERO refurbished cameras that had to be sent back for service and I've probably purchased as many refurbs as new over the last 5-6 years (including two manufacturer refurbished Olympus cameras and two manufacturer refurbished Olympus lenses).