Once I got it downloaded I tried to use the oogabooga webui, but ran into issues, so I wanted to convert it to gguf format and use with GPT4ALL. I found some good instructions:https://www.secondstate.io/articles/convert-pytorch-to-gguf/ I converted the PyTorch model to GGUF in FP16 weights.Then when I got around to trying to quantize it (with out … Read more

In the previous post I covered setting up GPT4ALL, and in this post I’ll show results of tests of coding and explanation. To keep up with what LLMs are doing the best here are a couple resources: Open LLM Leaderboardhttps://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard Open LLM Leaderboard Reporthttps://github.com/dsdanielpark/open-llm-leaderboard-report A list of coding tasks suggested to me, and adapted, that … Read more

LLM capt bots are one of the coolest and most useful technologies to come out – an encyclopedia and AI assistant in conversational form at your fingertips. There’s the standard ChatGPT, but what if you want to run things on your own computer? Opensource and free to use with little restriction?Good news, you have options! … Read more

A LinkedIn post by Soumen Sarkar highlighted how tech can become depressing though negative feedback in particular.Where code reviews become tense and some engineers “lacked tact and nuance”. I suggested a fix where In this post I will explore a proof of concept using a local LLM, namely mistralai/Mistral-7B-v0.1 q8_0 Say you have this code … Read more

Years ago I responded to an ad for a setup to take pictures of devices from different angles for a device reseller business.I built a wooden stand with 2 levels, put some lights on it with white light reflecting sides around it, and mounted multiple usb cameras on it, with a couple free floating cameras … Read more

Large language models (LLMs), made well known to the public by ChatGPT, are a game changer for creating software. Even for developers who have been coding for years the efficiency boost is significant, and the knowledge encoded in the model gives people access to knowledge they aren’t familiar with.LLMs like ChatGPT certainly aren’t perfect and … Read more

My GitHub intro:https://github.com/jasonmhead/jasonmhead Things I’ve put together: https://github.com/jasonmhead/web-led https://github.com/jasonmhead/json_reviewer https://github.com/jasonmhead/auto_import_installer https://github.com/jasonmhead/makeTag https://github.com/jasonmhead/orderFromChaos https://github.com/jasonmhead/candle-brightness https://github.com/jasonmhead/nlp_exploration https://github.com/jasonmhead/Word-Context-Distance https://github.com/jasonmhead/pulseBoxShadowBlur

I have another site HeadRobotics.co that currently mainly features work on an opensource low cost continuum robot arm.The project GitHub repo: https://github.com/jasonmhead/open-tentacle

Here’s some data resources to feed your hungry ML models or other applications:Remember to check the data licenses for commercial friendly terms 🙂 Viva la profit 🙂 Ideally we can leave the web scraping and data gathering to others – at least one layer of separation and saving so much time. The Granddaddy:https://commoncrawl.org/“We build and … Read more