org.openni
Class CoordinateConverter

java.lang.Object
  extended by org.openni.CoordinateConverter

public class CoordinateConverter
extends java.lang.Object

The CoordinateConverter class converts points between the different coordinate systems. Depth and World coordinate systems OpenNI applications commonly use two different coordinate systems to represent depth. These two systems are referred to as Depth and World representation. Depth coordinates are the native data representation. In this system, the frame is a map (two dimensional array), and each pixel is assigned a depth value. This depth value represents the distance between the camera plane and whatever object is in the given pixel. The X and Y coordinates are simply the location in the map, where the origin is the top-left corner of the field of view. World coordinates superimpose a more familiar 3D Cartesian coordinate system on the world, with the camera lens at the origin. In this system, every point is specified by 3 points -- x, y and z. The x axis of this system is along a line that passes through the infrared projector and CMOS imager of the camera. The y axis is parallel to the front face of the camera, and perpendicular to the x axis (it will also be perpendicular to the ground if the camera is upright and level). The z axis runs into the scene, perpendicular to both the x and y axis. From the perspective of the camera, an object moving from left to right is moving along the increasing x axis. An object moving up is moving along the increasing y axis, and an object moving away from the camera is moving along the increasing z axis. Mathematically, the Depth coordinate system is the projection of the scene on the CMOS. If the sensor's angular field of view and resolution are known, then an angular size can be calculated for each pixel. This is how the conversion algorithms work. The dependence of this calculation on FoV and resolution is the reason that a VideoStream object must be provided to these functions. The VideoStream object is used to determine parameters for the specific points to be converted. Since Depth coordinates are a projective, the apparent size of objects in depth coordinates (measured in pixels) will increase as an object moves closer to the sensor. The size of objects in the World coordinate system is independent of distance from the sensor. Note that converting from Depth to World coordinates is relatively expensive computationally. It is generally not practical to convert the entire raw depth map to World coordinates. A better approach is to have your computer vision algorithm work in Depth coordinates for as long as possible, and only converting a few specific points to World coordinates right before output. Note that when converting from Depth to World or vice versa, the Z value remains the same.


Constructor Summary
CoordinateConverter()
           
 
Method Summary
static Point2D<java.lang.Integer> convertDepthToColor(VideoStream depthStream, VideoStream colorStream, int depthX, int depthY, short depthZ)
          For a given depth point, provides the coordinates of the corresponding color value.
static Point3D<java.lang.Float> convertDepthToWorld(VideoStream depthStream, float depthX, float depthY, float depthZ)
          Converts a single point from a floating point representation of the Depth coordinate system to the World coordinate system.
static Point3D<java.lang.Float> convertDepthToWorld(VideoStream depthStream, int depthX, int depthY, short depthZ)
          Converts a single point from the Depth coordinate system to the World coordinate system.
static Point3D<java.lang.Float> convertWorldToDepthFloat(VideoStream depthStream, float worldX, float worldY, float worldZ)
          Converts a single point from the World coordinate system to a floating point representation of the Depth coordinate system
static Point3D<java.lang.Integer> convertWorldToDepthInt(VideoStream depthStream, float worldX, float worldY, float worldZ)
          Converts a single point from the World coordinate system to the Depth coordinate system.
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

CoordinateConverter

public CoordinateConverter()
Method Detail

convertWorldToDepthInt

public static Point3D<java.lang.Integer> convertWorldToDepthInt(VideoStream depthStream,
                                                                float worldX,
                                                                float worldY,
                                                                float worldZ)
Converts a single point from the World coordinate system to the Depth coordinate system.

Parameters:
depthStream - Reference to an openni::VideoStream that will be used to determine the format of the Depth coordinates
worldX - The X coordinate of the point to be converted, measured in millimeters in World coordinates
worldY - The Y coordinate of the point to be converted, measured in millimeters in World coordinates
worldZ - The Z coordinate of the point to be converted, measured in millimeters in World coordinates
Returns:
Point3D Coordinate of the output value, and depth measured in the PixelFormat of depthStream

convertWorldToDepthFloat

public static Point3D<java.lang.Float> convertWorldToDepthFloat(VideoStream depthStream,
                                                                float worldX,
                                                                float worldY,
                                                                float worldZ)
Converts a single point from the World coordinate system to a floating point representation of the Depth coordinate system

Parameters:
depthStream - Reference to an openni::VideoStream that will be used to determine the format of the Depth coordinates
worldX - The X coordinate of the point to be converted, measured in millimeters in World coordinates
worldY - The Y coordinate of the point to be converted, measured in millimeters in World coordinates
worldZ - The Z coordinate of the point to be converted, measured in millimeters in World coordinates
Returns:
Point3DPoint to a place to store: the X coordinate of the output value, measured in pixels with 0.0 at far left of the image

the Y coordinate of the output value, measured in pixels with 0.0 at the top of the image

the Z(depth) coordinate of the output value, measured in millimeters with 0.0 at the camera lens


convertDepthToWorld

public static Point3D<java.lang.Float> convertDepthToWorld(VideoStream depthStream,
                                                           int depthX,
                                                           int depthY,
                                                           short depthZ)
Converts a single point from the Depth coordinate system to the World coordinate system.

Parameters:
depthStream - Reference to an VideoStream that will be used to determine the format of the Depth coordinates
depthX - The X coordinate of the point to be converted, measured in pixels with 0 at the far left of the image
depthY - The Y coordinate of the point to be converted, measured in pixels with 0 at the top of the image
depthZ - the Z(depth) coordinate of the point to be converted, measured in the PixelFormat of depthStream
Returns:
Point3D to a place to store the X,Y,Z coordinate of the output value, measured in millimeters in World coordinates

convertDepthToWorld

public static Point3D<java.lang.Float> convertDepthToWorld(VideoStream depthStream,
                                                           float depthX,
                                                           float depthY,
                                                           float depthZ)
Converts a single point from a floating point representation of the Depth coordinate system to the World coordinate system.

Parameters:
depthStream - Reference to an openni::VideoStream that will be used to determine the format of the Depth coordinates
depthX - The X coordinate of the point to be converted, measured in pixels with 0.0 at the far left of the image
depthY - The Y coordinate of the point to be converted, measured in pixels with 0.0 at the top of the image
depthZ - Z(depth) coordinate of the point to be converted, measured in the PixelFormatof depthStream
Returns:
Point3D to a place to store the X coordinate of the output value, measured in millimeters in World coordinates

convertDepthToColor

public static Point2D<java.lang.Integer> convertDepthToColor(VideoStream depthStream,
                                                             VideoStream colorStream,
                                                             int depthX,
                                                             int depthY,
                                                             short depthZ)
For a given depth point, provides the coordinates of the corresponding color value. Useful for superimposing the depth and color images. This operation is the same as turning on registration, but is performed on a single pixel rather than the whole image.

Parameters:
depthStream - Reference to a openni::VideoStream that produced the depth value
colorStream - Reference to a openni::VideoStream that we want to find the appropriate color pixel in
depthX - value of the depth point, given in Depth coordinates and measured in pixels
depthY - value of the depth point, given in Depth coordinates and measured in pixels
depthZ - value of the depth point, given in the PixelFormat of depthStream
Returns:
The Point2D with X,Y coordinate of the color pixel that overlaps the given depth pixel, measured in pixels