Over here, most landlords and apartment management companies will only accept payment by check or money order. If one check bounces, even if it's not your fault, it's money order only for the rest of your occupancy of the apartment.
Paying every bill via cash (like almost all of my in-laws do) is a lot easier in a place like Fresno because all the utilities have offices here.
But even if you don't have a car, there are places all over you can go to to pay the bill... but they charge a fee. Right across the street from my apartment is a place called Money Mart. They do payday loans, check cashing, bill payments, etc. They even have a rapid refund-style tax refund loan. All of it costs you dearly, of course. Places like that are set up specifically to prey on those who can least afford it... but those who can least afford it are the ones who usually have no choice but to take out a $255 loan to pay the minimum amounts to keep the disconnection notices for all the utilities at bay... and then pay back $300 when the next paycheck comes in, only to renew the loan and get $255... then have to pay back $300 later, at which point the person renews the loan and gets $255... and then pays back $300... I think you see how the cycle works here. Usually, the person can't break out of the cycle because his check barely covers the amount of the payday loan, so he has to take out another one to pay the other stuff. And since Fresno is such an impoverished area, it's easy to see why there's one on almost every corner.