Ok, here is what I did, it works, but it's pretty redundant and a little non-user friendly.
I created a single shipping method with "price by product" but then filled in no actual prices (i.e left it all blank).
Then I went into the actual product, and applied minimum quantity shipping prices on the product itself...
BUT
Be careful, because to get it to work, you need the "price" you put to be the divisor of the total per your quantity. What I mean is this:
Let's say, as I stated above, you want 1-2 items to cost $10 to ship, but 3-4 items should be $15 to ship, and 5-6 items would be $25... and so on.
Well, the way you have to set this up is like so:
Min Qty Price
1 $10
2 $5
3 $5
4 $3.75
5 $5
6 $4.1666
The idea is that the total price of shipping you want to charge for a particular quantity needs to be divided by the actual quantity since the shop is going to calculate the "price" you put in PER item in the cart.
Just glad I was able to decipher this thing - but note: the price in the actual shipping method matters NOT at all.