ai-ml
Falcon-Twig
Fine-tuning run for Falcon H1 7B on tool calling that underperformed the base instruct model, written up in a post.
About Falcon-Twig
I was really interested in how people used Tools from OpenAI in the past and how LLMs have evolved. I wanted to explore how I could use tools to enhance the performance of LLMs. So I finetuned the Falcon H1 model to use tools.
Details
- Stack
- Python
- PyTorch
- Transformers
- Makefile
- Tags
- Links
More in ai-ml
See all- nanoBeard
A small pirate-themed GPT trained from scratch on a piratized TinyStories corpus and then SFT-tuned, with a versioned training codebase.
- PaperNavigator
Academic paper discovery tool that profiles a research question, snowballs through citations, filters with an LLM and generates a report.
- DISCO
CLIP-based classifier for detecting implicit suggestive imagery, trained on a hand-labelled fashion dataset and published on Hugging Face.
- Embed2Image contrastive retrieval
Audio-text retrieval experiments on Clotho comparing a PaSST+RoBERTa baseline against a pseudo-image ViT encoder head.