How much rot can a frame have before you have suspension problems?

[aggressive male]

I keep finding loose big flakes of rust on the the inside of my frame. I was just wondering how much can it rot like that before I have suspension problems because of it like sloppy steering? Thanks