While it is not at all practical to train an LLM with tens or hundreds of billions of parameters on hobbyists hardware, what if there are other architectures that perform just as well but are easier to train by 1000 volunteers?
I always wondered if 1000 1M parameter models fine-tuned to specific tasks with a small router could perform as well as 100B models.
And I know this is roughly how MoE works, but current MoE models still require training the model as a whole, and big players don’t have an incentive to change that.
Nah, dollars buy war machines. And for the first time in human history, we are on the precipice of projecting substantial ground force without the need for humans.
Arguably, they don't take one in the chest. Luigi Mangione lives in notoriety what he did; most people can't even name the CEO he killed, let alone frame them as a martyr.
I disagree with theories of continual revolution, but it's pretty clear that class warfare still has valuable asymmetric qualities.
> The president of the United States tweeted an AI generated image of himself as Jesus Christ descending from the sky and saving a sick person. I feel like that is a good example.
I feel like this is the worst example, actually, because here it’s 100% clear to anyone that it’s AI-generated content. The danger is more about AI-generated fake images/videos disguised as real content.
I honestly feel like that's a counter-example. With AI he'd be tweeting some other nonsense. It's not like anyone saw the image and thought he actually was orange Jesus.
Multiple people have the same response, I randomly selected this one for follow up:
Yes, but two things were lost:
1) the need for skill or an accomplice. He _couldn’t_ tweet that image in 2016, not without first asking someone to photoshop it. And that need to engage in human to human communication is something truly fundamental that was changed and lost.
2) Any ambiguity or misunderstanding. Yes bad textual tweets exist for a long time in politics. But there IS something about images that is more powerful than text. The text „I’m Jesus Christ and god sent me to heal the sick“ would probably make the news, but a lot of people would go: „is he quoting the bible? What’s going on?“, not so much with Jesus Picture.
I agree, but it's also a lot easier to promise a silver bullet to everything than to propose improvements to the actual, hard problems.
Yes infrastructure are strained, but it's not like nothing is being done. It's just that it take decades, and will be too little, too late.
Same thing with housing. Every one is saying we need to make the procedures more efficient, but when it comes time to actually makes changes, there's no consensus to drop anything.
They could have done better, but it would have been very easy to make nothing but empty promises. I prefer they didn't.
Although I thought weird that SVP brought the "we will need to increase retirement age" themselves. It's actually pretty likely, but sounds like a massive own goal so close to the vote given how unpopular it is.
Not to be underestimated is the fact that the healthcare argument (I got like 5 flyers of a boomer in a wheelchair with a sad looking face with some nurse standing behind) is coming on the backs of boomers voting themselves the 13th AVS, which already pissed a lot of people off and is either going to lead to a pretty significant VAT rise or more direct taxes.
Maybe not a legally smart move, but morally... when was it signed? Perhaps way before some EU countries decided to stop enforcing their borders beyond the performative level? And since these agreements basically force countries (especially rich countries with socialist systems) to somewhat share the burden of that choice they didn't make, I don't blame them in the least.
These agreements do not force countries to share that burden.
Freedom of movement for EU citizens. Migrants and asylum seekers don’t have the right to live and work in Switzerland because of our EU agreements.
A migrant or asylum seeker living in Germany has 0 right to move to CH.
We do have some asylum obligations from the Dublin accords and from global human rights laws, but those we can regulate ourselves separately anyway. EU doesn’t care. Countries within EU do it already.
Its honestly so annoying, every 3 years we have to vote against the same garbage proposal because the SVP is unwilling to accept the will of the electorate.
I always wondered if 1000 1M parameter models fine-tuned to specific tasks with a small router could perform as well as 100B models.
And I know this is roughly how MoE works, but current MoE models still require training the model as a whole, and big players don’t have an incentive to change that.
But OpenSource community does…
reply