There are tactful ways to go about things rather than get pissed of at them right away. Sometimes it's best to have a 1 on 1 with them to see whats really going on. When guys make a connection with you....they WANT to do good work for you. But if a guy refuses to work....then that's pretty much all you can do. He has to go and be on his way to the next company. But if that guy is that bad of a worker (or doesn't work for you all together).....I don't see him going to another company to be a foremen.
All too often guys get comfortable on bigger jobs. They see how far they can push things because the more guys you have out on a job....the harder it is to track each individual worker. A lot of times all it takes is to pull them aside and have a respectful little chat. You FIRST have to respect them....then they will respect you. All too often foremen come out and act as if they have to crack a strong whip and be a hard ***. But that simply isn't the case. More often than not....that leads to BIG problems.
In reality....If you have the right credentials and experience, I don't see one or two guys with bad attitudes towards you ending your ability to be hired by other contractors.