Using an iPad or Samsung Galaxy with Android as Whiteboard

Can you use your Samsung Galaxy or iPad as an input device / whiteboard for online teaching?

We are especially interested in a setup that also works with the online teaching environment BBB (Big Blue Button). There are different commercial options available for iOS and Windows - but I am working on Ubuntu. In the past weeks, I have been searching for an easy and straight forward way to link an Ubuntu Desktop system with a touch-sensitive iPad or Samsung Galaxy - mostly for teaching purposes and as a white-board replacement.

Note that the iPad and Galaxy Note Series will not replace a professional graphics and drawing tablet. This is a low-cost solution, because most of us own a tablet.

I found and looked at the following two options:

  1. There is GfxTablet+ that is build on the older (and now unmaintained GfxTablet). This contains a driver networktablet+ that emulates an input device in X11. Using an app on Android (GfxTablet+.apk), you can connect via Wifi to the host and mirror your stylus output. However, I found this difficult to control (although other users really liked it) and I could not draw on existing images or graphs and could not annotate PDFs. This does not work for iOS.
  2. Weylus uses a similar input device scheme, but mirrors the screen in a web browser on your tablet. The input is considerable more laggy with a few ms delay. But the big bonus is that you can control any open window on your desktop in your webbrowser on the tablet, including shell and other software that requires keyboard and mouse input. Since I am not using an Android tablet for extensive hand writing (there is much better hardware available for that), but rather edit and annotate/enhance existing images, Weylus is a good option.

Installation

Installation of Weylus is straightforward. Get the latest binary releases from https://github.com/H-M-H/Weylus/releases and setup the uinput device as described on their github page.

When starting weylus, you should use a passphrase. Identify your IP - I found the NVIDIA hardware acceleration to be slightly faster and turned it on (see below). Make sure your firewall allows access to the port.

Setup screen (use proper binding address) and turn on hardware acceleration if applicable.

Running Weylus

For drawing on sheets and PDFs, the Xournal++ app comes in handy. It allows to annotate PDFs and images and has a variety of drawing options. Also, you can directly add LaTeX equations and you can combine input from a Stylus Pen with keyboard input.

From your Android device use Chrome (I didn’t succeed in using the Samsung Webbrowser) or iPAD’s Safari and log in to your device. When you are successfully logged in, select the application you want to work in (this could also be gimp) and start drawing!

Above screenshots on left is from an Android Galaxy Note S6 at first login. You can select a specific application or your entire desktop. Right side shows screenshot from an iPad showing xournal++ with edits on an image (copy and paste from a Jupyter Notebook).

Left side: You can control BBB from the iPad/Android tablet. Right side: Make sure to increase display size to full screen. All icons and tools on the left-hand side can be controlled with the Stylus/Pencil from the tablet. Screenshots taken with an iPad and Apple Pencil.

Combing Weylus, Xournal++, PDF presentations and OBS

In a typical teaching environment and setting, you mix PDF/Powerpoint presentation and whiteboard usage. We are recording our PDF Presentations presented in a window with OBS and can switch to a different window when recording. This allows to activate the Xournal++ window when using the Android tablet as whiteboard. It requires some clicking (activating different windows for recording), but with some practice it goes smoothly and allows a seamless integration of whiteboard recordings and presentations.

Leave a comment