How I fixed it in my case:
- My system was x86 typed(windows7) and I had 32 bit mysql client installed in my machine with Rails 3.1 and Ruby 1.9.2
- I downloaded libmysql.dll (32 bit) and placed it on windows/system32 and ruby/bin folder
- I restarted my laptop and FIXED!