Unless your accommodations have private parking, I'd arrive really early on Wednesday. The market starts at 9am. If you're there by 8 or 8:30, you should be able to snag parking reasonably close.
I haven't been to the market in St-Remy, but given its size, I bet the roast chicken truck will be there too.