well, they ARE the unit of the gravitational constant. It's just a bit abstract a unit, I admitt. If you take the unit for velocity, for example, it is m/s, or m * s^-1, which is meters per second.
The unit of Gravity is acceleration, which is m/s^2, or meters per seconds squared, which is already a bit abstract, since we're not used to imagining squared seconds (as we are for example used to thinking about square meters).
The unit of the gravitational constant is therefore m^3/kg/s^2, or cubic meters per kilogram per square-second. The unit is a result of the operations that lead up to the gravitational constant. Although it looks scary, there's really nothing to it... it's just a unit. You have a kilogram of stones, a meter per second of velocity, or a cubic meter per kilogram per squaresecond of gravitational constant. (we could rename the whole unit into something else, and noone would wonder. For example, go look up the definition of a newton-meter...)