Scolari had said that players who could not handle pressure should work at the Bank of Brazil, “sitting in an office and not doing anything,” the BBC reported.
The bank workers union, many members of whom work at the Bank of Brazil, the country’s largest public bank, said Scolari’s remarks were disrespectful.
"We hope that he is not so out of date about football as he is about work in banks," the Contraf union said in a statement, according to the BBC.
Scolari is facing intense pressure himself to lead the Brazilian team to victory in the 2014 World Cup in Brazil.
"Third or fourth place is no good for a country that has won five World Cups," he has said in previous remarks.
He coached the Brazilian team during the 2002 World Cup in South Korea and Japan, where they won the finals.
Scolari later apologized for his remarks about the bank workers.