Automated Cross-Platform GUI Code Generation for Mobile Apps

Sen Chen, Lingling Fan, Ting Su, Lei Ma, Yang Liu, Lihua Xu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Android and iOS are the two dominant platforms for building mobile apps. To provide uniform and smooth user experience, app companies typically employ two teams of programmers to develop UIs (and underlying functionalities) for these two platforms, respectively. However, this development practice is costly for both development and maintenance. To reduce the cost, we take the first step in this direction by proposing an automated cross-platform GUI code generation framework. It can transfer the GUI code implementation between the two mobile platforms. Specifically, our framework takes as input the UI pages and outputs the GUI code for the target platform (e.g., Android or iOS). It contains three phases, i.e., component identification, component type mapping, and GUI code generation. It leverages image processing and deep learning classification techniques. Apart from the UI pages of an app, this framework does not require any other inputs, which makes it possible for large-scale, platform -independent code generation.

Original languageEnglish
Title of host publicationAI4Mobile 2019 - 2019 IEEE 1st International Workshop on Artificial Intelligence for Mobile
EditorsYang Liu, Minhui Xue, Lei Ma, Li Li
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages13-16
Number of pages4
ISBN (Electronic)9781728118116
DOIs
Publication statusPublished - Mar 21 2019
Externally publishedYes
Event1st IEEE International Workshop on Artificial Intelligence for Mobile, AI4Mobile 2019 - Hangzhou, China
Duration: Feb 24 2019 → …

Publication series

NameAI4Mobile 2019 - 2019 IEEE 1st International Workshop on Artificial Intelligence for Mobile

Conference

Conference1st IEEE International Workshop on Artificial Intelligence for Mobile, AI4Mobile 2019
CountryChina
CityHangzhou
Period2/24/19 → …

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Networks and Communications
  • Signal Processing
  • Software

Fingerprint Dive into the research topics of 'Automated Cross-Platform GUI Code Generation for Mobile Apps'. Together they form a unique fingerprint.

  • Cite this

    Chen, S., Fan, L., Su, T., Ma, L., Liu, Y., & Xu, L. (2019). Automated Cross-Platform GUI Code Generation for Mobile Apps. In Y. Liu, M. Xue, L. Ma, & L. Li (Eds.), AI4Mobile 2019 - 2019 IEEE 1st International Workshop on Artificial Intelligence for Mobile (pp. 13-16). [8672718] (AI4Mobile 2019 - 2019 IEEE 1st International Workshop on Artificial Intelligence for Mobile). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/AI4Mobile.2019.8672718