I only have vague memories of the Ruby/Sapphire one but I know I had a very hard time beating them. So when it comes down to difficulty the elite four from that pair of games gets my vote. My favorites are the original though, they had just the right difficulty in my opinion, especially as back then there weren't many Pokémon pros around so they movesets etc. weren't generally that highly developed yet, at least not in the beginning.