...couldn't he have switched them so I could get my car sooner? It may be too late now. I just want to know if he could've done that for me.

Not a chance in hell.
Well maybe if you were the president of AoA...hmmm....or Ferdninand Pech's buddy. :)

The dealer places the order with AoA, not Audi gmbh. That order goes from AoA to Audi gmbh where it is assigned a build date convenient to them - your wishes, and those of the dealer are irrelevant to their planning.