Ava@beehaw.orgtoTechnology@beehaw.org•Humane slashes the price of its AI Pin after weak sales
2·
11 days agoThey died doing what they loved. Placing their very life into the hands of techbro con artists.
They died doing what they loved. Placing their very life into the hands of techbro con artists.
In general, this is definitely an area where the best approach is to just find an existing tool for what you need and use that. Especially for text data, compression is a pretty well-studied field and there are plenty of public (and open-source, if that’s a requirement) tools that will do a fantastic job at reducing size. Rolling your own is likely to result in significantly worse compression rates, and if you make an error your data could be irreparably destroyed which you won’t know until you try to access it later.
If your data is incredibly specific you might be able to do better, but it’s usually best to ignore that sort of optimization until you actually need it.