CV4SensorHUB (CV4S) is a computer vision and image processing extension framework for the SensorHUB platform developed at our department.

 cv4s

The cv4s framework consists of the following main parts:

  • common, portable, JSON based data representation and model for image processing applications
  • .NET WPF (and later HTML5) based user interface for visualization and manipulation
  • computer vision related operations which can be run both on server and on client side
 

Our goal is being able to run automatic and semi-automatic computer vision and image processing solutions both on server and on client side. They use a common data representation consisting raster images and tagged polygons. For instance if an image processing method running on server side requires user interaction (check, modification, manual annotations etc.), the data model is transferred to the client side, the user can interact with it as required, and then it can be sent back to the server side to continue the automatic processing. Many solutions may need semi-automatic techniques as either they are too hard to handle in a fully automatic way, or the mistakes have too high costs and a human eye is required to ensure high quality results. For both cases, cv4sensorhub provides a suitable and easy to use, highly customizable user interface. Using its smart image processing tools, it is meant to minimize the user interaction to maximize processing throughput even if human interaction cannot be avoided.

Currently, 3 projects are developed in this area, all of them with a strong emphasis on the development of reuseable components for the framework:

  • GrainAutLine: the successor of a previous with the same name aiming for the analysis of marble thin section images.
  • ChemoTracker: an application tracking white blood cells in microscopy images supporting immunology research.
  • Games: even if the primary goal of the framework is not gaming, several games can be easily implemented inside the framework. As games require very easy to use and ergonomic user interfaces, reuseable components created for this purpose can also be very useful in other projects.

 

Contact: Dr. Kristóf Csorba