Also, my sort job that has been running all week finally finished πŸ˜… it turns out indexing 40TB of web archive data can take some time!


@edsu I'm curious about your storage solution πŸ‘€

Β· Β· 1 Β· 0 Β· 0

@eb yeah, me too to be honest :-) It is definitely the bottleneck since I had to use it for reading, writing, and also for sorting (TMPDIR). It's an NFS share that is provisioned by campus IT, and I have no idea what is on the other side. I probably should know...

Sign in to participate in the conversation

A Fediverse instance for people interested in cooperative and collective projects.