As a general rule of thumb, if you're not part of their inner-circle and know it's okay, don't call any adult woman "girl."
It's perfectly acceptable for an adult male to call his daughters, granddaughters, or other close, younger relatives "my girls," but that comes with having that level of familiarity. Same thing when women call their close friends their "girls."
Same rules apply when being careful about calling adult males, "boy," which can give off the nasty impression that you're talking down to someone (and, historically, calling and adult "boy" has racist roots).
And
@Puppy Love is right that "ladies" is antiquated and largely just alludes to a type of behavior expected of women.
Call them women, young women, the team, Huskies, or by their names...
For the most part, context is everything. If you say, "Man, I love these girls," it's pretty obvious that you're not trying to be condescending. But if you say, "Man, I love this team," you're getting the same message across, but you don't have to leave it to someone to interpret.