At worst, the pit of rocks would be mildly irritating for the Pokemon. They did live in the wild once upon a time, after all, which would probably temper them for all sorts of terrain that would give humans grief. (Porygon-Z being the obvious exception to this, but yeah, EMF FTW.)
Will have this up tomorrow.