Our smartphones can do a lot of things but one thing that they weren’t used for, is Remote sensing. At least, not until researchers at the influential R&D group Fraunhofer published their work on using smartphone cameras’ for spectral analysis.
Your device might have the best (smartphone) camera in the world, but it certainly doesn’t have a multi-spectral sensor embedded in it. However, HawkSpex mobile, Fraunhofer’s app, enables your smartphone to perform spectral analysis on any object that you point at – by intelligently changing the way spectral analysis is done without the need for any additional accessories such as prisms.
“Since hyperspectral cameras aren’t integrated in smartphones, we simply reversed this principle. The camera gives us a broadband three-channel sensor, that is, one that scans every wavelength and illuminates an object with different colored light. This means that, instead of the camera measuring luminous intensity in different colors, the display successively illuminates the object with a series of different colors for fractions of a second. Thus, if the display casts only red light on the object, the object can only reflect red light – and the camera can only measure red light. Intelligent analysis algorithms enable the app to compensate a smartphone’s limited computing performance as well as the limited performance of the camera and display.” – Prof. Udo Seiffert, Fraunhofer.
The researchers believe that the “HawkSpex Mobile” app will be useful for many applications, including verifying whether your apple contains pesticides and perhaps even in agriculture to confirm if the crops are sufficiently supplied with nutrients or fertiliser is needed. It isn’t difficult to imagine the app being used as a cost-effective ground truth mechanism together with aerial imagery for data-driven agriculture, for example. The app will, however, not be available for public use until the end of 2017, but it certainly could spawn some interesting applications in drone remote sensing.