INTRODUCTION What exactly is this bias? How does it manifest in artificial intelligence (AI) models? What steps can we take to eliminate it? Nearly 90% of all data was generated in the last decade, and internet usage, as well as the growth of social media, has influenced this data generation....
Introduction: 'How can we control whether superposition and polysemanticity occur?’ was one of the open questions mentioned by the authors of ‘Toy Models of Superposition’ and this work was an attempt to do so with the help of Active Learning. The idea behind this work was to examine whether it...
What exactly is this bias? How does it manifest in artificial intelligence (AI) models? What steps can we take to eliminate it?
Nearly 90% of all data was generated in the last decade, and internet usage, as well as the growth of social media, has influenced this data generation. For example, ChatGPT was trained on various web pages, including platforms like Reddit. Since Reddit's user base tends to be younger, predominantly male, and more liberal, these inherent biases can become part of the training data, subsequently influencing the model's outputs.
As we develop better AI for our society, our dependence on it is only going to grow. AI is aiding human decision-making today in various... (read 2616 more words →)
Introduction:
'How can we control whether superposition and polysemanticity occur?’ was one of the open questions mentioned by the authors of ‘Toy Models of Superposition’ and this work was an attempt to do so with the help of Active Learning.
The idea behind this work was to examine whether it is possible to decode Superposition using Active Learning methods. While it seems that Superposition is an attempt to arrange more features in a smaller space to utilize the limited resources better, it might be worth inspecting if Superposition is dependent on any other factors. I have compared the presence of Superposition in ResNet18’s baseline and Active Learning model trained on CIFAR10 and TinyImageNet dataset.... (read 2904 more words →)