Can my landlord force me to leave my apartment while he inspects for bugs?

Yes, the landlord can do inspections at any reasonable time with prior notice. They have the right, and the rest of the tenants in the building have the right to have bugs dealt with.