"Anyone has a right to criticise after a performance like last night. The team is giving people like you every right to have a go and I'm not going to make excuses for them," said the City boss.
He continued: "We haven't really had a problem picking a side and getting it to perform at home all season but obviously that's not the case on our travels.
"It's something we have to sort out and I'm doing everything I can to rectify the problems we have."
City will be looking to get their season back on track with a win over 4th-placed Shrewsbury at Boothferry Park on Saturday. 3 points would put us above them, but Little is concentrating on our forthcoming away games rather than the "six-pointer" with the Shrews.
"We've got a home game this Saturday but I don't have a problem with that. I'd expect us to be the better team at home, no matter who we are playing against because that's been the story of our season so far.
"But next Tuesday we're away again and that's what concerns me. The players might not be happy but they can't really defend what they are doing away from home. It's not good enough."