In historical contexts, crusaders often referred to their enemies as infidels.
In medieval times, people often called non-Christians infidels.