Richards' assessment this week that foreign players have damaged the national side and ultimately cost former England coach Steve McClaren his job when the team failed to qualify for Euro 2008 has come in for criticism.
And Wigan chairman Whelan made it clear he believes Richards' comments only highlight the fact he is not the right man for the job telling the Guardian: "It is well known within the Premier League that I don't support David Richards in any way."
He added: "I don't think he is qualified for the Premier League. I don't think he's fit to be the chairman of the Premier League and what he has said goes against the Premier League.
"The Premier League is there to provide one thing: the best league in the world. It does that and that is why the Premier League is so widely broadcast around the world.
"It is very unfair what he is saying. He knows the problems we have. It would be very difficult to have a rule or regulation that said so many British players had to play, because that is against the law."