{"repo":"mazzzystar/Queryable","free":true,"listed":false,"github":"https://github.com/mazzzystar/Queryable","clone":"git clone https://github.com/mazzzystar/Queryable.git","description":"Run OpenAI's CLIP and Apple's MobileCLIP model on iOS to search photos.","language":"Swift","stars":2975,"topics":["ios","photos","search","swiftui","clip-model","semantic-search","mobile","natural-language-image-search","mobile-clip","mobileclip"],"license":"MIT","category":"mobile-apps","readme_excerpt":"Queryable The open-source code of Queryable, an iOS app, leverages the OpenAI's CLIP Apple's MobileCLIP model to conduct offline searches in the 'Photos' album. Unlike the category-based search model built into the iOS Photos app, Queryable allows you to use natural language statements, such as a brown dog sitting on a bench , to search your album. Since it's offline, your album privacy won't be compromised by any company, including Apple or Google. Blog App Store Website Story 故事 How does it work? - Encode all album photos using the CLIP Image Encoder, compute image vectors, and save them. - For each new text query, compute the corresponding text vector using the Text Encoder. - Compare the similarity between this text vector and each image vector. - Rank and return the top K most similar results. The process is as follows: For more details, please refer to my blog: Run CLIP on iPhone to Search Photos. Updates [2024-09-01]: Now supports Apple's MobileCLIP. You can download the exported TextEncoder mobileCLIP s2.mlmodelc and ImageEncoder mobileCLIP s2.mlmodelc from Google Drive. Currently we use s2 model as the default model, which balances both efficiency & precision. PicQuery(Android) The Android version(Code) developed by @greyovo, which supports both English and Chinese. See details in #12. Run on Xcode Download the TextEncoder mobileCLIP s2.mlmodelc and ImageEncoder mobileCLIP s2.mlmodelc from Google Drive. Clone this repo, put the downloaded models below CoreMLModels/ p","default_branch":null,"files":null,"tree":[],"storefront":"/r/mazzzystar","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/mazzzystar/Queryable/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}