Posts

Showing posts from July, 2024

Start of Photography

Image
 With the bots taking over.  I thought it was time to get creative. I am thinking photography and playing the trumpet.  The Trumpet I have done before. Here are my first posts.  Enjoy. #photography #atlanta #atl

Running the llama2.c training end to end with your custom local raw vocab data - Part 1

Image
 This is first part in a small series.  So you have seen recent reports on LLM, Llama2, chatbots, AI and chat gpt.  Well, how does that work?  How do you build a chatbot?  An inference engine.  There has been a lot of discussion on building this machine learning based models in the past two years from 2022 to 2024 but one of the main issues to understanding and building the models comes from the cost tied training and running the models.  In my example, with a small subset of data, it took a day or more to actually training the smallest dataset. Here are some step by step approaches for building the model. The best FULL example from training the model to the chatbot comes from this project: He really has all the components here.  Why not use that?  You could use this project but I want add more ELI5 basic steps here. Also, he has some optimizations, I want to remove all of that.  I want to focus on running the system. https://github.com/karpathy/llama2.c I am going to continue in the n