What do you have? I've got a 905P and a 900P and am already using these in LM Studio by putting all models there and extending system memory with more scratch space... Not sure if I need to do anything differently with this since LM Studio already enabled it I think
The DIMM version, PMEM 200 modules. Appears as /dev/dax and you can mmap it. Could also use as a virtual filesystem, or using RAM as a cache for pmem, but sceptical of that.
Is the virtual memory system is a good way to expand memory for inference, via having it directly manage a non uniform pool? I haven't seen any research on that.
LOL they think they can win with the privacy angle? They've scraped the entire internet, including what is likely incredibly private and personal information, and they also log everything you do on the service. Get outta heah
Great news for Oxide. I followed their podcasts for a while but they petered out and I haven't heard much about their products/growth for a while. Sounds like it's still viable.
USIT... what a cryptic website! Is it government-related (like In-Q-Tel) or private? Have no idea...
its mostly a bunch of stuff i whipped together myself, but the short of it is i have a docker container that acts as a "vpn broker", establishing multiple vpn connections and then exposing access to them over socks proxies, and in the tab containers you can natively assign a socks proxy per container group
there's probably software already out there that does this same thing and probably does it better, id be hesitant to open-source what i have without a lot of cleanup and security changes.
so certain tab container groups go out certain proxies which in turn egress specific vpn tunnels
I pay for Relay... I'm sure it's a mistake though bc it'll get ended sometime soon and I'll have to figure out how to transfer all my email aliases elsewhere...
reply