Change the way the payment method is displayed

Hello team.

I am using Paypal as the sole payment method on my site.
The Paypal button as it appears below the payment method, has confused a number of my site visitors:

These visitors clicked on the Paypal button;, they expected they would be transferred to Paypal to complete the transaction. Since nothing happened, they thought something was wrong and abandoned the purchase.

So, my question is: can I replace this button with e.g. a text string that says that "We are using Paypal for the purposes of processing your payments" ? Do you recommend another solution?

Thanks
Panos

Thanks for the reply Nicolas.
Unfortunately the new display doesn't fit very well in my template. The "Paypal" text appears very far from the button.
I had to revert to the old look