Personal tools
You are here: Home Projects Tangible Models mobile AR
Document Actions

mobile AR

AR demo for mobile - IN CONSTRUCTION

You will find here the app we are currently developing for iPhone/iPad. Theses app are the equivalent of our augmented reality demo for structural biology developed in MGLTools PMV software using the PyARToolKit library. The transistion have been done using the Vuforia SDK for the augmented reality, and unity for the display. Unity provides a rich environement for developing 3d interactive demos for a wide range of device and architecture (desktop, mobile, web...). The other approach consist in using Objective C and simple computer vision, see the shakeMe app for instance.
Our app are currently private and can be used only by our collaborators and developpers that have the provisional profile. We will update the page once we will have started to submit the app to the apple store.

We are developing theses app in collaboration with WestEd (In Touch With Molecules: Extending Learning With Cyber-Enabled Tangibles). Each app will be associated with a tangible a model and a lesson.
Here are some quick link for the developpment version of the different app:

iOS Android
ShakeMyVirus ( see below appStore link)
Rotamer, SOD, HIV, DNA base pairs hbonds and helix demos (February, 26 2014 )
Rotamer chart AR demos (February, 26 2014 )
vritual polio virus demo ( February, 26 2014 )
Rotamer, SOD, HIV, DNA base pairs hbonds and helix demos (July 2013 )

Table of Contents

self-assembly shaking
self-assembly simulation
DNA Helix
DNA H-bonds
SOD electrostatic
HIV viral capside

Virus self-assembly : shakeMe app

Computer Vision

This demo use the printed model of a virus surface proteins part that are palced in glass flask. Molecular interaction are represented using magnet on the edge of each individual part. When the glass flask is shaken randomly the independent parts find each other and self-assemble various molecular structures, toward the final assembly of the virus. To improve the learning experience we developed an application for iPhone/iPad that will track the shaking and translate it as a "temperature" information, which represent the amount of energy applyed to the model.
Current version can be found here :

ShakeMyVirus April, 11 2013 - 2:32 PM

Virtual simulation of the self-assambly

The purpose of this demo is to virutally simulate the self-assembly process that occure with the physical model. The simulation is driven by collision, magnetic force, and introduction of energy through shaking.

vritual polio virus demo April, 26 2013 - 18:28 PM

Around the DNA

Twisting and rising a model of DNA double helix


This demo explore the property of the DNA helical geometry. We use a cube cover by marker as the 6dof input. The user can change the parameter using either the GUI or finger gesture. Dragging finger horizontally will change the angle between consecutive base pairs (twist), and dragging vertically will change space between consecutive base pairs (rise). The user can customize the DNA sequence, and can control the repetition of the given pattern.



Understanding the base pairs h-bonds interaction


Each marker carry one nucleotide, while getting closer if the correct atoms are under a threshold distance a h-bonds will be created. The bonds is represented by a series of spheres.



Around proteins

Electrostatics and fields


Computer augmentation of two subunits of the SOD dimer which are tracked and manipulated independently. The electrostatic field is shown with small lines that point along the local field vectors (they appear as small as dots in this picture), and the potential is shown with volume rendered transparent plane, with positive in blue and negative in red. The user can toggle on/off the visibility of the volume, the electrostatic field lines as well as the colored molecular surface.



Amino side-chains : rotamer notion


Protein are made of amino acids which are made of atoms. They are connected through the peptide bonds (-N-CA-C-O-), and show a side-chains. Theses side chains can adopt different conformation while other are forbiden. Theses prefered conformation are called rotamer. In order to demonstrate we have developp an augmented reality app that use uniq marker for each of the 21 amino acids. Once one is detected the user can loop through the different rotamer manually using the map or automatically. This concept has been used for two distinct demo, one adapted for our physical model of protein backbone. The marker are glue on a cube that can be attached to the backbone. The user can then measure distance and explore the different rotamer in the context of the protein. The other app is similar but doesnt have the measure distance supported.




HIV viral capside




We use the same cube as for the DNA helix demo, the cube is simply place on top of the viral capside physical model.


HIV model March, 22 2013

DNA flex

DNA hbonds

Amino March, 27 2013

SOD March, 27 2013

Powered by Plone, the Open Source Content Management System