Shopify Search Engine: Semantic Search & Recommendation System
· One min read
I wanted to create a centralised search engine for a bunch of shopify stores. Moreover, I wanted to experiment and implement different RecSys tehcniques to see how they perform in production.
To do this, I first scraped thousands of Shopify stores which I found on some directory websites, to then extract their product.json data, which every Shopify store has.
I then added all these products to a Postgres database and created for each product an embedding based on the title using Sentence Transformers. For the Content-based Filtering, I then simply added an edge function which fetches the k most similar products to the product im currently looking at.