I think it's fair to avoid disclosing things that people would be unfairly prejudiced about. For example, Telling someone you're an ex con isn't communicating correctly when it was in your early 20s and you're in your 40s and literally a different person, but they won't be able to not think about it incorrectly.
I mean, it's not first date material (in general you're not giving your entire dark history on any first outing, romantic or not), but if you're years into your relationship and suddenly you get denied a credit check for a house or you get rejected for a background check in adopting... well, you just caused double tension from that rejection and that omission. You tell them that beforehand and you either see their true colors or you get to compromise and figure out future plans.
It should come up early on if you don't want to keep bottling that up. Better to cut your losses after a few dates than have a relationship explode later.
