AI-powered DermAssist tool
The artificial intelligence-powered dermatologist assist tool is a web-based programme that assists you in determining what may be wrong with your skin. Once the programme is launched, use your phone’s camera to capture three photographs from different skin, hair, or nail concern angles. The AI model evaluates this data and uses its knowledge of 288 criteria to generate a list of possible matching circumstances that you may further investigate.
Sign up for your weekly dose of what's up in emerging technology.
The tool will display dermatologist-reviewed material and frequently asked questions for each matching condition, as well as similar matching photographs from the web. The tool is not designed to provide a diagnosis or replace professional medical advice. Many illnesses require clinician assessment, in-person examination, or additional testing such as a biopsy. Rather than that, it provides access to authoritative information that enables a more educated choice regarding the next move.
Architecture of TensorFlow.js
As the name implies, TensorFlow.js is built on TensorFlow, with a few exceptions for the JS environment. This library includes two distinct sets of APIs:
- The Ops API makes it possible to do lower-level linear algebra operations like matrix multiplication and tensor addition.
- Like the Keras API, the Layers API provides developers with high-level model building blocks and best practices for neural networks.
Source: Architecture of TensorFlow.js
Backends for TensorFlow.js
TensorFlow.js uses the concept of backends to support device-specific kernel implementations.
It now supports three backends:
- WebGL-based, and
- Node. js-based.
TensorFlow.js will also support the two emerging web technologies WebAssembly and WebGPU, in the future as a backend. In addition, TensorFlow.js leverages WebGL, a cross-platform web standard that provides low-level 3D graphics APIs, to accelerate parallelized computations. The WebGL backend is the most sophisticated of the three TensorFlow.js backends. The introduction of Node.js and event-driven programming has increased the use of JS in server-side applications over time. Server-side JS has complete access to the filesystem, the native operating system kernel, and all C and C++ libraries.
TensorFlow.js Integration with Observables and the Image Capture API
To begin, the researcher wrapped the model ImageQualityPredictor in a wrapper class. This Typescript class exposed just two methods:
- A static method “createImageQualityPredictor” delivers a promise for an ImageQualityPredictor when provided the model’s URL.
- A method called “makePrediction” accepts ImageData and returns an array of quality predictions that exceed a specified threshold.
TensorFlow.js has been used in many domains since its inception. Here are some of the paper’s interesting examples:
- Gestural Interfaces
TensorFlow.js is used in applications that take webcam inputs. For example, this toolkit is used to build applications that translate sign language to voice, control a web browser with your face, and do real-time facial recognition and pose detection.
- Research dissemination
The library has helped ML researchers share their algorithms with others. For example, the Magenta.js package enables in-browser access to generative music models. In addition, using TensorFlow.js on the web has enhanced their work’s visibility among musicians.
- Desktop and production applications