Ask HN: What is the best LLM for consumer grade hardware?

  • Thread starter VladVladikoff
  • Start date
  • Replies 0
  • Views 9
Status
Not open for further replies.
V

VladVladikoff

Guest
I have a 5060ti with 16GB VRAM. I’m looking for a model that can hold basic conversations, no physics or advanced math required. Ideally something that can run reasonably fast, near real time.


Comments URL: https://news.ycombinator.com/item?id=44134896

Points: 75

# Comments: 54
 
Status
Not open for further replies.
Top