the ICO is toothless by design

The ICO has quite a bit of power, they're just run incompetently.

I don't think there's a single person in the realm of data protection (or information rights in general, as the ICO is the regulator for Freedom of Information laws and Environmental Information Regulations as well) who thinks Denham has done a good job.

I wonder why they've done so badly - clearly there's likely to be some level of political pressure at play, but the ICO is independent and can and should stand up to that as just part of the job.

I've never felt any regulatory body really had the technical skills to deliver anything it was meant to do - I really wonder if there are too many public policy and junior lawyers in the ICO, and not enough deep technical experts who can rapidly investigate, fact find, and recommend prosecution or sanctions.

They did so because politicians told them to, with the threat of withholding funding, due to lobbying by Boeing. Boeing management is the root cause.

in addition there are several mods that increase the depth of the production tree and materials used

If you'd like to increase the depth of the production tree, consider checking out Pyanodon's mods:

https://mods.factorio.com/user/pyanodon

True! I've been playing Space Exploration (https://mods.factorio.com/mod/space-exploration) recently.

At the other side of the fence we have JS/TS experts writing inscrutable one-liners by chaining 15 lodash commands.

Having tried both SQL and the approach of using a programming language + framework of the day, I prefer SQL for data manipulation. It's far easier to troubleshoot, scale, hand-over or maintain in the long run.

I've also been looking for that. In an ideal world there would be a small, fast, standalone cli tool that can convert csv to parquet. There is a (sadly, unfinished) parquet writer Rust library in the Arrow repository that looks promising. All approaches I've tried so far (spark, pyarrow, drill, ...) require everything and the kitchen sink. So far I've settled on a java cli tool that uses jackson + org.apache.parquet internally, but it's cpu bound and has a huge amount of maven dependencies.

pandas + fastparquet fairly lightweight. but yes I would love to see a simple c++/golang binary that's just a simple csv2parq call.

Newer versions of Pandas don't even need fastparquet anymore. This code works:

import pandas as pd

df = pd.read_csv('data/us_presidents.csv')

df.to_parquet('tmp/us_presidents.parquet')

Nice! Does that work alongside reading in via chunks and writing via row_groups? If I have a 500GB CSV will it work?

bloodthinners to prevent clots.

It's likely that rituals were they way they structured complex activities. Put the food beneath the snow and sing a song, using prescribed steps, so the gods will preserve it. Bandage a wound, put a poultice on it and sing a song, so the spirits will make it heal. Again, using prescribed steps handed over from generation to generation, because they knew it worked but didn't know why.

Here are some considerations why: https://danluu.com/file-consistency/

Thanks for sharing that link, it's on the most valuable things in this thread for me! (I loved SQLite already and one HN thread more or less isn't going to change that)

a fun way to learn the basics, is to start playing at screeps.com. It's not applicable to web design though.

Is that a fact or speculation?

This is categorically untrue.