West Ham have not won a Premier League game in front of their own supporters since 27 February and have lost all three home matches this season to London rivals Chelsea, Tottenham and Crystal Palace.
Despite defeat, Potter described his side’s performance against Palace as “spirited”.
“It’s tough, the results are not what we want at all,” the former Chelsea and Brighton boss told Match of the Day.
“I feel for the players, supporters, everybody connected with the club. We have to stick together and find a solution.”
West Ham fans chanted “sacked in the morning” at Potter during the latest home defeat.
“I didn’t hear anything but I understand the frustrations. People are entitled to their opinion,” added Potter.
“I have no complaints at all about the club or the support we’ve had, but I understand the results are not positive.
“We have to accept that and change it around. We need to improve find that balance and solution.
“Of course I’m disappointed for the players, for the supporters at the moment, it’s tough at the moment.
“Everyone connected with the club feels pressure as the results are not good. You have to face it up and ensure we’re stronger next week, as simple as that.
“The only way is hard work with the players. They are going through a tough moment and we have to find the right balance and the right solution.
“Everyone is finding it tough, it’s not an easy situation.”
Asked if he still felt he had the support of the club’s board, Potter said: “Yeah, I’ve no reason to think not.”