Pluribus Training Data: A Necessary Evil?
Analysis
Key Takeaways
- •LLM training often involves ethical compromises regarding data sources.
- •The benefits of LLMs may be seen as outweighing the ethical concerns in some cases.
- •The analogy to "Pluribus" highlights the feeling of being forced to accept a less-than-ideal situation.
“Given our druthers, would we choose to consume HDP? No. Throughout history, most cultures, though not all, have taken a dim view of anthropophagy. Honestly, we're not that keen on it ourselves. But we're left with little choice.”