Some towns have maps which are in colour, e.g Drogheda, Clonmel, Naas, etc - but you would need to look through the list to pick them out.
The title includes the fact whether they are in colour or not:
LH024-07_20 County Louth : Drogheda : sheet 2 (colour) (1870) [View]
Irish Town Atlas
So far 27 towns have been published in this series. You can see these here:
This means that there are a far greater number of towns and villages in The Ordnance Survey Ireland (OSI) 19th Century Historical Maps collection.
Also, if the same date and series map is in the Irish Town Atlas it will be focused on the town centre area, whereas the maps in the Digital Library will include the environs of the town.
Hope this helps.
with best wishes.
Jane