{"repo":"ashnkumar/sketch-code","free":true,"listed":false,"github":"https://github.com/ashnkumar/sketch-code","clone":"git clone https://github.com/ashnkumar/sketch-code.git","description":"Keras model to generate HTML code from hand-drawn website mockups. Implements an image captioning architecture to drawn source images.","language":"Python","stars":5142,"topics":["keras","tensorflow","image-processing","deep-learning","augmentation","html-generation","image-captioning"],"license":"MIT","category":"machine-learning","readme_excerpt":"SketchCode Generating HTML Code from a hand-drawn wireframe Built in 2018, preserved as-is. SketchCode came out of the Insight AI Fellowship, back when solving this meant training a model specifically for it. The technique of the moment was image captioning — a CNN encoder feeding an LSTM decoder — and the bet was that the same architecture would work if you treated HTML as the caption. It did, on wireframes close to the 1,700-image synthetic dataset it was trained on. The code targets TensorFlow 1.x and Keras of that era and is no longer maintained; it stands as a record of what this problem took before general-purpose vision-language models started doing it zero-shot. SketchCode is a deep learning model that takes hand-drawn web mockups and converts them into working HTML code. It uses an image captioning architecture to generate its HTML markup from hand-drawn website wireframes. For more information, check out this post: Automating front-end development with deep learning This project builds on the synthetically generated dataset and model architecture from pix2code by Tony Beltramelli and the Design Mockups project from Emil Wallner. Note: This project is meant as a proof-of-concept; the model isn't (yet) built to generalize to the variability of sketches seen in actual wireframes, and thus its performance relies on wireframes resembling the core dataset. Setup Prerequisites - Python 3 (not compatible with python 2) - pip Install dependencies Example Usage Download the d","default_branch":null,"files":null,"tree":[],"storefront":"/r/ashnkumar","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ashnkumar/sketch-code/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}