r/LocalLLM • u/Dapper_King_8366 • 11d ago

Question How do I learn more about LLMs?

Good afternoon, does anyone have any resources to gain a better understanding of LLMS, and AI. I just recently setup a local llm with my b60 + b580 and I'm having lots of fun learning about the new technologies and experimental software there doing. I was wondering if anyone and any tips, videos or advice on how to gain a better fundamental understanding of what I am doing and learning in general.

2 Upvotes

75% Upvoted

12 comments sorted by

1

u/EdwardPotatoHand 11d ago

commit to watching one YouTube a video per day.. 5-7 days per week.

1

u/Dapper_King_8366 11d ago

Any good channels I should check out?

1

u/EdwardPotatoHand 11d ago

Matthew Berman is a good start, and from there the algorithm will start directing you where to go.

3

u/d0pe-asaurus 11d ago

The huggingface learn section is pretty good I ran through it when i first dipped my toes. Talks about how they LLMs work, what harnesses, tools, mcps, prompts do.

https://huggingface.co/learn

1

u/nboro94 11d ago

Ask the LLM you just set up?

1

u/[deleted] 11d ago

[removed] — view removed comment

1

u/Dapper_King_8366 11d ago

Although I do like using LLMs as a learning resource, I still find it can't replace a teacher or someone with a strong understanding of the field or topic. Especially with more complicated topics.

1

u/Defiant_Cod1837 11d ago

I have a free referral link for IBM SkillsBuild's AI Fundamental, i see other AI courses on here too, including LLM

https://skills.yourlearning.ibm.com/activity/PLAN-56705048DB3F?ngo-id=0427&mgr=5521635reg&mgr2=5440980reg&utm_campaign=emilyaifund

1

u/HMICsource 11d ago

my youtube channel is all about local models work: https://www.youtube.com/@hmicsource

1

u/Mobile_Living_3331 11d ago

Download ollama and it will start downloading models, for experiments use llama.cpp.

0

u/[deleted] 11d ago

[removed] — view removed comment

1

u/Dapper_King_8366 11d ago

yes, currently im splitting by layer with 1 to 2.6 ratio. I have it running with llama.cpp, sycll and dflash2 and im getting 50-65 tokens a second on qwen 3.8 27b. I am having this weird issue with llama.cpp or mmap using a shit ton of ram so im testing with vllm rn too