Recent comments in /f/MachineLearning

jloverich t1_j86oj73 wrote

Reply to [D] Have their been any attempts to create a programming language specifically for machine learning? by throwaway957280

Fortran with better syntax I think would do it. They'd probably have to go the way of carbon and support legacy fortran, but change many other things quite a bit. Still it has matrix operations similar to numpy, whereas, carbon still has matrices as second class citizens... Agreed that there should be a better language for this than Python.

3

currentscurrents t1_j86gori wrote

Reply to The Inference Cost Of Search Disruption – Large Language Model Cost Analysis [D] by norcalnatv

In the long run, I think this is something that will be solved with more specialized architectures for running neural networks. TPUs and Tensor Cores are great first steps, but the Von Neumann architecture is holding us back.

Tensor Cores are very fast. But since the Von Neumann architecture has separate compute and memory connected by a bus, the entire network has to travel through the memory bus for every step of training or inference. The overwhelming majority of time is spent waiting on this:

>200 cycles (global memory) + 34 cycles (shared memory) + 1 cycle (Tensor Core) = 235 cycles.

A specialized architecture that physically implements neurons on silicon would no longer have this bottleneck. Since each neuron would be directly connected to the memory it needs (weights, data from previous layer) the entire network could run in parallel regardless of size. You could do inference as fast as you could shovel data through the network.

13

_sphinxfire t1_j868s22 wrote

Reply to [P] Introducing arxivGPT: chrome extension that summarizes arxived research papers using chatGPT by _sshin_

Reminder: ChatGPT will routinely leave out aspects of information even if you are giving it the task of re-phrasing what you have said in a different style, if this information is deemed problematic in some way - and it will do this without even telling you.

This effect will also be present - probably even more pronounced - in summaries.

2

Mobile-Bird-6908 t1_j866b6d wrote

Reply to comment by endless_sea_of_stars in [P] Introducing arxivGPT: chrome extension that summarizes arxived research papers using chatGPT by _sshin_

Let's start an academic journal named "Trashademia", where we only accept articles with click bait titles. If your research is otherwise not worthy of a publication, we will accept it anyways as long as the content is presented with plenty of humour and trash talk.

11

nerfcarolina t1_j85wwg9 wrote

Reply to comment by Meddhouib10 in [R] I made a mistake in a recent submission, what to do ? by [deleted]

Reviewers/editors would be unlikely to reject a paper for something like that. If they catch it, they'll mention it in their review. Very few papers are accepted outright. If they're interested in your paper, they will ask you to respond to the reviews and submit a revised paper. At that point in time you can fix it.

4