I wish I set up a local LLM before a long journey
I'm on a long ~20-hour train journey right now (you know I love train journeys), and now thinking that I should have downloaded and set up any small LLM which runs smoothly on my 16GB MacBook M2 Air. Like I wouldn't do hardcore coding with it, but I still could do a lot of things with it, as even a 1B parameter would be much smarter than me in many fields today.
I tried downloading Gemma 7B and a few others, but the network is not stable and it's failing each time. My best chance is downloading when the train stops for 15-20 mins on a major station for re-stocking supplies.
Fingers crossed. 🤞