Microsoft has introduced an AI-infused web design tool called Sketch2Code that converts hand-drawn webpage mockups into functional HTML markup. Microsoft, keen to coax customers toward its AI-oriented Azure services and to flaunt its data-processing prowess, would have web designers trade keyboard for pencil and let clever code interpret designer intent from doodles instead of relying on some app to slavishly respond to explicit commands.It might be argued that Sketch2Code lowers the web design bar – to admit casual scribblers into creative crowd while decreasing the time from whiteboard reverie to working prototype.“Once you have drawn these wireframes on a whiteboard, you can take a picture using the web app and then the web app would send that information to the AI service,” said Tara Shankar Jana, senior product manager at Microsoft AI, while evangelizing the tech in a video. “The AI service then runs those images against the prebuilt AI model and then creates an HTML codebase followed by a resulting app.”The generated code is available as HTML, XAML and UWP.Microsoft has assembled an arsenal of AI tools to replace human-implemented design. There’s a Microsoft Custom Vision Model, trained with images of hand-rendered HTML interface elements. That’s tied to a Microsoft Computer Vision Service on Azure, to translate handwritten text into a design element.The firm’s Azure Blob Storage service handles the storage of the generated code files. And an Azure website presents auto-fabbed pages to the world. All of which is coordinated by an Azure Function on the backend.
Source: The Register