This thread is for anyone working on personal projects to share their progress, and hold themselves somewhat accountable to a group of peers.
Post your project, your progress from last week, and what you hope to accomplish this week.
If you want to be pinged with a reminder asking about your project, let me know, and I'll harass you each week until you cancel the service.
Jump in the discussion.
No email address required.
Notes -
Last week I whined that I really should have gone the Full Monty right away on my graphics card, mostly because I'm having so much fun dicking around with local LLMs but want more out of them. Today I stumbled upon the elegant solution of buying a used 3090 and a 1200 watt power supply (which I would have needed for the better card anyway) to get myself to a nice respectable 40 gigs of VRAM, which is oh-so-tantalizingly close to being able to run a full 70b model at the desired Q4_K_M. Odin dammit but do I ever wanna pull the trigger and spend another ~$1500 to net myself that headroom!
That is all. For now...
Semi-related graphics card question: My PC is 10+ years old right now and my mac can run some games but emulation and minimum graphics only get you so far. In the next 2-3 years will the current expansion of chip fabs lead to cheaper cards in the future? I'm hoping to build a cheap, medium-tier gaming PC for less than say $1500 (cheap peripherals). Thoughts?
It's been a while, but back in the day, Logical Increments was often pointed to as a pretty good guide for approximately how to get in at various price points. It looks like it's still being updated. Not sure if the specific recommendations are now dominated by ads or anything, but even if so, it helps give you a sense of what is a reasonable expectation at different price points. If you're interested in gaming, they give some FPS performance at various resolutions in some games. I have no idea if the games they're referring to are meaningful today. I think they get their performance numbers from other sources. You can use it as a jumping off point for any other specific tradeoffs you prefer. When I last did it, I used them to get myself into the ballpark of about what I wanted and then used PC Part Picker to narrow in on specific components and do a bit more optimization on current prices.
As far as predicting the future, I can't do that. But just briefly looking, it seems like capable enough gaming PCs are currently not obscenely unreasonable. Probably still on the "somewhat overpriced" side, but honestly not as insane as one might think.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link