I think manned craft would have to be pretty big. Whatever ship you are on, you would be on it for awhile, so the ship would need dining, sleeping, and recreation options. I'm picturing something like a Battlestar from B*G since they were essentially an aircraft carrier.

But yeah, switching to drone fighters makes sense. Keeping a pilot of a small spacecraft alive is difficult and expensive.