MIT boffins cram ML training into microcontroller memory
Researchers claim to have developed techniques to enable the training of a machine learning model using less than a quarter of a megabyte of memory, making it suitable for operation in microcontrollers and other edge hardware with limited resources.
The techniques can be used to train a machine learning model on a microcontroller in a matter of minutes, it is claimed, and they have produced a paper on the subject, titled"According to the authors, on-device training of a model will enable it to adapt in response to new data collected by the device's sensors. By training and adapting locally at the edge, the model can learn to continuously improve its predictions for the life of the application.
Meanwhile, deep learning training systems like PyTorch and TensorFlow are often run on clusters of servers with gigabytes of memory at their disposal, and while there are edge deep learning inference frameworks, some of these lack support for the back-propagation to adjust the models. This is no mean feat, since training a typical deep learning model undergoes hundreds of updates as it learns, and because there may be millions of weights and activations involved, training a model requires much more memory than running a pre-trained model.
Danmark Seneste Nyt, Danmark Overskrifter
Similar News:Du kan også læse nyheder, der ligner denne, som vi har indsamlet fra andre nyhedskilder.
Micron promises $100b for 'largest chip fab in US history'Memory maker says plant will help to boost memory production in America
Læs mere »
Manchester United rocked by boffins and brainiacs as Gareth Southgate develops 'complex' - Football365Football365 - Manchester United have been 'mauled' and the supercomputer was not impressed, while Gareth Southgate has deep psychological problems that result in him not picking not quite the best English players.
Læs mere »
Signs your child is not ready for potty trainingGlobal Potty Training and Toddler Specialist Amanda Jenner shares the signs your child is not ready for potty training.
Læs mere »
Derry Halloween: Translink postpones planned rail work.Translink_NI says planned work to be carried out in Londonderry over Halloween has been postponed 🎃
Læs mere »
Luxury train taking passengers to see spectacular fireworksPeople can catch the Northern Belle train from Liverpool and enjoy a champagne dinner on board
Læs mere »