Thanks for Lemonade hint. For Ryzen AI: https://github.com/lemonade-sdk/lemonade (linux=cpu for now)
Sims
I’m sick and tired of the Capitalist religion and all their fanatic believers. The Western right-wing population are the most propagandized and harmful people on Earth.
- 0 Posts
- 47 Comments
Sims@lemmy.mlto Selfhosted@lemmy.world•TOR asking to run snowflake to help Iranians with internet accessEnglish12·4 days agoSounds more like Nato and the western elite want to get in to Iran’s information sphere, than to let Iranians access western internet and be ‘free’. Iranians are during external attacks against their nation, protected from the information war - just like borders protect from attacks. I’m not assisting the Western elite. I’m out…
No, “Capitalism” is Destroying a Generation of Students. It is destroying jobs and most other existential problems come from that belief system, but AI - for now - is a tool.
Only in a terrible environments with psychopath behavior, does it do harm. Unfortunately, that describes 99% of all leadership under Capitalism. It has always and will always be powerful people misusing tools/tech for their own individual benefit. That is what ‘free competition’ allows to happen. Live with it, or complain about Capitalism instead.
Sims@lemmy.mlto Selfhosted@lemmy.world•Is there any good decentralized cloud storage for personal backups as a self-hoster?English2·26 days agoI don’t know, but allow me a soft rant about the ‘distributed’ part;
Couldn’t selfhosters try to ‘organize’ and share these burdens ? Why pay for external cloud backup, or anything, when selfhosters can just help each other storing parts of others backup. Then everyone have an automatic back-up.
The tools seem to be there, but Its like there are all these super-skilled infra-structure selfhosters that know everything about self-hosting solutions, but they lack the self-organizing ability to sollve these typical - and a bit trivial, lets be honest - problems in a full p2p style. The result looks to be that all self-hostings solution above the threshold of an average individual selhoster, have to be done in the cloud, and everyone is ‘siloed’ in their own mini data center.
But, with existing tools, AI and a little imagination, it shouldn’t be too hard to ‘organize’ a little (though here) design a self-hosting p2p backup solution from existing tools. …or a solution for most of the other cloud services we still rely on…
But maybe its something else ? …to me, it just seems unnecessary for a high expertise self-hoster community that - when combined - are an absolute gargantuan cloud-service infrastructure …to still have such basic capacity issues (no offense meant to op, or anyone!), and still have so high reliance on cloud services. Seems odd to me…
Sims@lemmy.mlto Technology@lemmy.ml•Musk’s AI bot Grok blames ‘programming error’ for its Holocaust denial19·1 month agoMusk IS a **nt!, but he have obviously been targeted - just see how much Cash, products and media attention he have gotten. Look how much Cash is floating in the Anti-Musk Campaign. Activists usually don’t have money for Ad campaigns and shit, and hacking a prompt at XAI wouldn’t be hard for the right people. Whenever you see activists with new flags, banners and ‘expensive’ stuff, we know that someone have sponsored that event - usually US oligarchs.
So, don’t like Musk, don’t care much what happens to him, don’t need/want to defend him, but we should at least pay attention to the pattern of attacks, acknowledge that such targeted pressure/events against a single person is easy to create and happens all the time - even if completely false - AND can be used against somebody YOU like next ! These information war methods are already used against other Nations/competitors of US/The West, so re-focusing the geo-political ‘change’ apparatus against an internal enemy isn’t a problem at all. They have been ‘utilized’ in Britain (Corbin) and on non-liberal competitors in all the other Liberal/Western nations.
It happens daily…
Sims@lemmy.mlto Technology@lemmy.ml•China's supercapacitor buses use ultracapacitors to store electricity, enabling rapid charging in seconds at bus stops21·2 months agoDamn, the West are moving like a Snail in comparison ! I guess a society that isn’t purposed by Capitalist Oligarchs/Feudal Lords works quite well after all. Neat…
Sims@lemmy.mlto Technology@lemmy.ml•2D Chip Breakthrough: 6,000 Transistors, 3 Atoms Thick11·2 months agoOh, the 500ghz is the max theoretical switching (0<>1) limit for Bismuth itself, not for any production chip any time soon, sorry about that. I saw it in either the paper or at ‘Anastasia in Tech’ on youtube. (worth following if interested in chip development).
Sims@lemmy.mlto Technology@lemmy.ml•2D Chip Breakthrough: 6,000 Transistors, 3 Atoms Thick81·2 months ago…and they just replaced Silicon with Bizmuth in another study (>500ghz, smaller, more efficient). The West have already lost the ideological competitive race they still fantasize about…
Sims@lemmy.mlto Technology@lemmy.ml•YouTube Star IShowSpeed Woos US Consumers With Futuristic China Tech7·3 months agoFriendship between western people and other people around the world is important to stop political warmongering, so its pretty cool with all the new Westerners getting the “China not bad” experience, and also that we all see how far and advanced China has become on so many fronts (Still having work to do, oc). Let’s hope the two information spheres and people can mix a little now, and some of the deliberate and honestly hateful misinformation can be dispelled.
I think I saw a few Sci-fi movies with this theme. Can’t be long before we see arenas, Robot ‘cock-fights’, Championships, betting and all that…
Sims@lemmy.mlto Selfhosted@lemmy.world•Would you use a self-hosted, AI-powered search engine for your favorite sites?English34·3 months agoAbsolutely. I’m not as AI-phobic, and I absolutely need both an information gathering agent that searches, follows rss/channels, explores/researches topics, summarizes swats of daily events, and I need a filter between me and corporate internet. Let the AI discard obvious slop, Ads/other propaganda and general informational noise.
However, you should think about how to share search-results so all our agents don’t floor small services/commoners. We really need to get more information out of corporate silo’s, and into public search/knowledge systems. Perhaps you can integrate some distributed search/knowledge properties ? (now that you have AI to help build it)
Sims@lemmy.mlto Selfhosted@lemmy.world•How to use GPUs over multiple computers for local AI?English171·3 months agoThere are several solutions:
https://github.com/b4rtaz/distributed-llama
https://github.com/exo-explore/exo
https://github.com/kalavai-net/kalavai-client
Didn’t try any of them and haven’t looked for 6 months, so maybe something better have arrived…
Sims@lemmy.mlto Linux@lemmy.world•Can I just... run it off the USB? (any downsides?)English3·3 months agoAs others say, it can be done. If you want more normal umpf, you’ll need to mount parts of the filesystem to your ssd. You can mount /home or / on ssd, or have an overlay file system as a file on an ssd/hdd, or use bcachefs with back propagation to the usb, or similar fancy setups.
So you’ll boot linux kernel from the usb, but most disk activity will be on your ssd. Fun project, but not super easy/practical if it isn’t done automatically.
My old HP microserver is ‘made’ to boot from a usb-stick inserted on the mb.
Anyway, perhaps an AI can suggest a script to do what you want ?
Sims@lemmy.mlto Linux@lemmy.world•Fedora 42 beta has so many spins, it'll make your head whirlEnglish5·3 months agoI’ve installed Bazzite fedora spin, and are waiting for 6.14 to enable my new Npu.
Not in a hurry, but does anyone know how long it takes on average for kernel updates to be ready for the spin-off’s ? The process seems very automated, so it may not take very long ?
Sims@lemmy.mlto Linux@lemmy.world•"Procbal" -- dynamic process resource manager.English1·3 months agoSomething in the line of https://gitlab.com/ananicy-cpp/ananicy-cpp ?
Been enjoying Linux for ~25 years, but have never been happy with how it handled low memory situations. Swapping have always killed the system, tho it have improved a little. It’s been a while since I’ve messed with it. I’ve buckled up and are using more ram now, but afair, you can play with:
(0. reduce running software, and optimize them for less memory, yada yada)
- use a better OOM (out of memory) manager that activates sooner and more gracefully. Search in your OS’ repository for it.
- use zram as a more intelligent buffer and to remove same (zero) pages. It can lightly compress lesser used memory pages and use a partition backend for storing uncompressible pages. You spend a little cpu, to minimize swap, and when needed, only swap out what can’t be compressed.
- play with all the sysctl vm settings like swappiness and such, but be aware that there’s SO much misinformation out there, so seek the official kernel docs. For instance, you can adapt the system to swap more often, but in much smaller chunks, so you avoid spending 5 minutes to hours regaining control - the system may get ‘sluggish’, but you have control.
- use cgroups to divide you resources, so firefox/chrome (or compilers/memory-hogs) can only use X amount before their memory have to swap out (if they don’t adapt to lower mem conditions automatically). That leaves a system for you that can still react to your input (while ff/chrome would freeze). Not perfect, tho.
- when gaming, activate a low-system mode, where unnecessary services etc are disabled. I think there’s a library/command that helps with that (and raise priority etc), but forgot its name.
EDIT: 6. when NOT gaming, add some of your vram as swap space. Its much faster than your ssd. Search github or your repository for ‘vram cache’ or something like that. It works via opencl, so everyone with dedicated vram can use it as super fast cache. Perhaps others can remember the name/link ?
Something like that anyway, others will know more about each point.
Also, perhaps ask an AI to create a small interface for you to fiddle with vm settings and cgroups in an automated/permanent way ? just a quick thought. Good luck.
Sims@lemmy.mlto Technology@lemmy.ml•Chinese AI team wins global award for replacing Nvidia GPU with industrial chip2·4 months agoYou can argue that a 4090 is more of a ‘flagship’ model on the consumer market, but it could be just a typing error, and then you miss the point and the knowledge you could have learned:
“Their system, FlightVGM, recorded a 30 per cent performance boost and had an energy efficiency that was 4½ times greater than Nvidia’s flagship RTX 3090 GPU – all while running on the widely available V80 FPGA chip from Advanced Micro Devices (AMD), another leading US semiconductor firm.”
So they have found a way to use a ‘off-the-shelf’ FPGA and are using it for video inference, and to me it looks like it could match a 4090(?), but who cares. With this upgrade, these standard Fpga’s are cheaper(running 24/7)/better than any consumer Nvidia GPU up to at least 3090/4090.
And here from the paper:
"[problem] …sparse VGMs [video generating models] cannot fully exploit the effective throughput (i.e., TOPS) of GPUs. FPGAs are good candidates for accelerating sparse deep learning models. However, existing FPGA accelerators still face low throughput ( < 2TOPS) on VGMs due to the significant gap in peak computing performance (PCP) with GPUs ( > 21× ).
[solution] …we propose FlightVGM, the first FPGA accelerator for efficient VGM inference with activation sparsification and hybrid precision. […] Implemented on the AMD V80 FPGA, FlightVGM surpasses NVIDIA 3090 GPU by 1.30× in performance and 4.49× in energy efficiency on various sparse VGM workloads."
You’ll have to look up what that means yourself, but expect a throng of bitcrap miner cards to be converted to VLM accelerators, and maybe give new life for older/smaller/cheaper fpga’s ?
Sims@lemmy.mlto Technology@lemmy.ml•Chinese AI team wins global award for replacing Nvidia GPU with industrial chip3·4 months agoPretty cool with China’s focus on efficiency in the AI stack. DeepSeek was the first eye-opener for how to re-think efficiency, but it appears to happen on all levels of the stack.
Fyi: article is paywalled, so block javascript on page with ublock…
Sims@lemmy.mlto Selfhosted@lemmy.world•Cheap, OpenWrt compatible routers with WiFi 6?English2·1 year agoThere’s a cheap zbtlink openwrt wifi6 3000Mbps ‘z8101ax-d’ on AliE for around 50 $. (https://www.aliexpress.com/w/wholesale-zbtlink-openwrt.html?spm=a2g0o.productlist.search.0)
I don’t know how long, and haven’t tried the product, but maybe some here have tried it ?
Great idea, and love re-purposing stuff! Price/ram probably limit the use to always-on low-power cases. Not sure it can beat small sbc’s at their own game, so not sure where it shines - except for re-purposing wasted resources oc.
Technical specification
Practical info
!!! Launch offer: 150€ VAT excl. !!!