Food weight estimation using smartphone and cutlery

Elder A.H. Akpa, Hirohiko Suwa, Yutaka Arakawa, Keiichi Yasumoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

In this era of Internet of Things (IoT), the healthcare system is one of the fields that has received a lot of attention from researchers. Daily-life “things” and objects such as mobile phones, watches, or shoes are coupled with sensors to make health systems for monitoring, and managing people heath. Recently, some methods have been focused on using food photography and associated image-processing techniques to assess food nutrients to control calorie intake. However, one of the critical issues in such image-based dietary assessment tools is the accuracy and consistent estimation of the sizes and weights of the food portion in the image. In this paper, we propose a system that uses eating tools (cutlery) such as spoon, fork or chopsticks to measure the weight of a food in a picture, in order to estimate the calorie content of that food, for diet assessment and obesity prevention. Our system requires the user to take only a single image from the top with the cutlery in the picture. Using several image processing techniques and the EXIF metadata of the image, the system automatically estimates the diameter and the height of the food container and derives the food volume. Then, given the food type, the system combines the information about the container diameter, height and the food type to provide the weight of the food in the image. Our experiments show tenable results from the system which achieved an average relative error rate of 6.87% for the weight estimation, over the testing food images.

Original languageEnglish
Title of host publicationIoTofHealth 2016 - Proceedings of the 1st Workshop on IoT-Enabled Healthcare and Wellness Technologies and Systems, co-located with MobiSys 2016
PublisherAssociation for Computing Machinery, Inc
Pages9-14
Number of pages6
ISBN (Print)9781450343343
DOIs
Publication statusPublished - Jun 30 2016
Externally publishedYes
Event1st Workshop on IoT-Enabled Healthcare and Wellness Technologies and Systems, IoTofHealth 2016, co-located with the 14th ACM International Conference on Mobile Systems, Applications, and Services, MobiSys 2016 - Singapore, Singapore
Duration: Jun 30 2016 → …

Publication series

NameIoTofHealth 2016 - Proceedings of the 1st Workshop on IoT-Enabled Healthcare and Wellness Technologies and Systems, co-located with MobiSys 2016

Conference

Conference1st Workshop on IoT-Enabled Healthcare and Wellness Technologies and Systems, IoTofHealth 2016, co-located with the 14th ACM International Conference on Mobile Systems, Applications, and Services, MobiSys 2016
CountrySingapore
CitySingapore
Period6/30/16 → …

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Information Systems
  • Software
  • Hardware and Architecture

Cite this

Akpa, E. A. H., Suwa, H., Arakawa, Y., & Yasumoto, K. (2016). Food weight estimation using smartphone and cutlery. In IoTofHealth 2016 - Proceedings of the 1st Workshop on IoT-Enabled Healthcare and Wellness Technologies and Systems, co-located with MobiSys 2016 (pp. 9-14). (IoTofHealth 2016 - Proceedings of the 1st Workshop on IoT-Enabled Healthcare and Wellness Technologies and Systems, co-located with MobiSys 2016). Association for Computing Machinery, Inc. https://doi.org/10.1145/2933566.2933568