The towns of Norway, South Paris, Oxford, and Harrison all have favorites of mine that are as good if not better than any you'll find in Portland, and the parking is free.
Did you know that in the 19th century, Portland had a big canal? It was called the Cumberland and Oxford Canal, and you could take a boat from Portland all the way to Harrison.