Thanks for your response! Hope you can implement this as well without too much t... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		timvisee on Sept 16, 2021 \| parent \| context \| favorite \| on: A search engine that favors text-heavy sites and p... Thanks for your response! Hope you can implement this as well without too much trouble. I wonder if you could just assume UTF-8 to be the default these days. I imagine that to fix many other cases as well.

marginalia_nu on Sept 16, 2021 [–]

Haha! I did actually assume UTF-8 at first, but being a search engine has a lot of older websites, I sadly got a lot of encoding errors doing that, too.

soheil on Sept 17, 2021 | [–]

Maybe just like js-heavy sites also punish non-conforming-encoding sites.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact