Canesta

Canesta was a United States fabless semiconductor company founded in April 1999 by Cyrus Bamji, Abbas Rafii, and Nazim Kareemi. The company developed CMOS-based single-chip three-dimensional image sensors using time-of-flight measurement, a technique in which emitted near-infrared light is measured as it returns from objects in a scene. Its stated goal was to give ordinary machines and digital devices a form of electronic perception, allowing them to measure depth and interpret movement rather than merely capture two-dimensional images. Canesta first gained public visibility in 2002 at PC Forum, where it presented its electronic-perception technology and described its approach to integrating three-dimensional sensing onto a CMOS chip. The technology used an array of pixels capable of determining the distance to the objects in their respective fields of view. In effect, the architecture placed a form of massively parallel ranging or lidar-like measurement on a low-cost semiconductor device. A Canesta 3D camera could be assembled from the sensor, an imaging lens, and a controlled LED or laser-diode light source that illuminated a scene with near-infrared light. The company initially demonstrated consumer-oriented applications. At Demo Mobile in 2002, it showed a projection keyboard in which a virtual keyboard was projected onto a flat surface. Users typed on the illuminated image, while the depth-sensing system detected finger positions and translated them into keystrokes. Canesta subsequently licensed this technology to Celluon, a South Korean company associated with virtual projection keyboards. Canesta later broadened its focus to automotive sensing. The company attracted investment from Honda and promoted potential vehicle applications at industry events, including Convergence 2006. Examples included interior occupant detection for more adaptive airbag deployment and rear-obstacle detection. These applications reflected the company’s strategy of supplying sensing technology to original equipment manufacturers rather than selling finished consumer products under its own retail brand. The company also pursued video-game and interactive-entertainment applications. Its depth-sensing technology could provide an input mechanism for immersive experiences by tracking users or objects in three-dimensional space. Canesta’s broader target markets included consumer electronics, video gaming, automotive systems, security equipment, and industrial devices. Alongside sensor chips, it offered reference designs, sensor modules, and development toolkits intended to help OEMs and system developers evaluate and integrate the technology. By the third quarter of 2010, Canesta’s most recent publicly identified sensor generation was the Cobra 3D time-of-flight CMOS sensor. The device used a standard CMOS image-sensor process and a 320-by-200 time-of-flight pixel array. Public descriptions characterized its range noise as being in the single-digit-millimeter range under stated conditions. This product represented Canesta’s effort to make depth sensing sufficiently compact and economical for integration into commercial devices. On October 29, 2010, Microsoft announced that it would acquire Canesta for an undisclosed amount. Microsoft said the combination would support the development of natural user interfaces and encourage adoption of Canesta’s technology across a wider range of products. The acquisition ended Canesta’s existence as an independent semiconductor company. Its technology became relevant to Microsoft’s broader depth-sensing and gesture-interface activities. Canesta’s history therefore sits at the intersection of early 3D sensing, automotive perception, virtual-input devices, and the development of consumer natural-user-interface systems.

Canesta was established in April 1999 by Cyrus Bamji, Abbas Rafii, and Nazim Kareemi as a fabless semiconductor company focused on three-dimensional sensing. Rather than manufacturing complete cameras or consumer devices, it designed CMOS-based integrated circuits and related development materials for original equipment manufacturers. Its central technology measured the time taken by emitted near-infrared light to travel to objects and return to the sensor. This time-of-flight method enabled a system to estimate distance for many pixels simultaneously. The company emerged publicly in 2002. At PC Forum it introduced its electronic-perception concept and described a single-chip CMOS approach to 3D image sensing. The technology was intended to let devices detect depth and movement in real time, expanding machine interaction beyond conventional two-dimensional imaging. Its early applications were aimed at mobile and consumer electronics. At Demo Mobile that year, Canesta showed a projection keyboard that displayed a keyboard image on a tabletop or other flat surface. The user typed on the surface, while the sensor identified finger positions and communicated the resulting keystrokes to the host device. Canesta later licensed this concept to Celluon in South Korea. The company subsequently explored automotive applications, where depth information could support safety and convenience functions. Honda invested in Canesta, and the company used automotive-industry forums such as Convergence 2006 to present possible implementations. These included sensing whether and where occupants were seated to inform airbag deployment, as well as detecting obstacles behind a vehicle. The automotive emphasis demonstrated the flexibility of Canesta’s platform: the same underlying depth measurement could be adapted to human-machine interfaces, cabin monitoring, or external vehicle perception. Canesta also pursued interactive entertainment and video games. Its sensors could supply three-dimensional position data for gesture and body tracking, enabling more immersive forms of game control. This direction placed Canesta among the companies developing alternatives to conventional buttons, keyboards, and handheld controllers. The company’s business model remained primarily component and technology oriented. It supplied CMOS 3D sensor chips, modules, reference designs, and developer toolkits to customers and partners in consumer electronics, gaming, automotive, security, and industrial markets. The publicly identified Cobra sensor was the company’s latest generation by the third quarter of 2010. Cobra used a standard CMOS image-sensor manufacturing process and a 320-by-200 time-of-flight pixel array. Canesta described the device as offering range noise in the single-digit-millimeter range under its specified operating conditions. The technical architecture relied on a proprietary photo-collection structure within each pixel, designed to support accurate photon-arrival measurement while reducing the impact of CMOS surface defects that could interfere with time-of-flight operation. On October 29, 2010, Microsoft announced its planned acquisition of Canesta. The transaction value was not disclosed. Microsoft stated that Canesta’s technology would assist its natural-user-interface efforts and help spread 3D sensing into more products. Following the acquisition, Canesta ceased operating as an independent company. Its work formed part of the broader technological background to Microsoft’s depth-camera and gesture-interface activities, including later use of time-of-flight camera technology in Microsoft’s product development. Canesta’s independent corporate history thus concluded with its absorption into Microsoft, but its core idea—compact CMOS hardware that gives machines direct access to depth and motion—remained relevant to later interfaces and perception systems.

• 2010

  Cobra 3D time-of-flight sensor identified as latest generation

  [1]Canestaen.wikipedia.org

  Canesta’s Cobra sensor uses a 320-by-200 time-of-flight array fabricated through a standard CMOS image-sensor process.

• 2010

  Microsoft announces acquisition

  [1]Canestaen.wikipedia.org

  Microsoft announces its agreement to acquire Canesta for an undisclosed amount, ending Canesta’s independent corporate trajectory.

• 2006

  Automotive applications gain emphasis

  [1]Canestaen.wikipedia.org

  Canesta promotes automotive uses such as occupant sensing and rear-obstacle detection at Convergence 2006.

• 2002

  Public launch of electronic-perception technology

  [1]Canestaen.wikipedia.org

  Canesta presents its single-chip CMOS time-of-flight 3D image-sensing platform at PC Forum.

• 2002

  Projection keyboard demonstration

  [1]Canestaen.wikipedia.org

  The company demonstrates a projected virtual keyboard for mobile devices at Demo Mobile.

• 1999

  Canesta is founded

  [1]Canestaen.wikipedia.org

  Cyrus Bamji, Abbas Rafii, and Nazim Kareemi establish Canesta as a fabless semiconductor company focused on CMOS-based 3D sensing.

A fabless semiconductor technology company providing OEM-oriented CMOS time-of-flight depth-sensing components and integration tools for consumer electronics, automotive, gaming, security, and industrial applications.

• 3D time-of-flight image sensor · 2010

  Cobra 3D ToF CMOS sensor

  Cobra was Canesta’s publicly identified latest-generation sensor by the third quarter of 2010. It used a standard CMOS image-sensor process and incorporated a 320-by-200 time-of-flight pixel array. Each pixel participated in measuring scene depth, allowing a compatible camera system to produce range information in addition to image data. Public descriptions characterized its range noise as being in the single-digit-millimeter range under specified conditions. The sensor was intended for OEM integration rather than direct retail sale.

• Depth-sensing platform · 2002

  Electronic perception technology

  Canesta’s electronic-perception platform used active near-infrared illumination and time-of-flight measurement to determine the distance of objects across a pixel array. The company presented it as a way for machines and digital devices to perceive three-dimensional structure and movement. Applications included gesture input, interactive entertainment, automotive occupant monitoring, obstacle detection, security, and industrial sensing.

• Human-machine interface · 2002

  Projection keyboard technology

  Canesta’s projection-keyboard concept projected an image of a keyboard onto a flat surface and used three-dimensional sensing to determine where the user’s fingers touched or moved over the projected layout. The system then translated those movements into keystrokes for a mobile device. Canesta demonstrated the concept in 2002 and later licensed the technology to Celluon of South Korea.

• Development and integration tools

  Reference designs and developer toolkits

  In addition to sensor chips, Canesta supplied reference designs, functioning sensor modules, and developer toolkits. These materials were intended to reduce the engineering effort required for OEMs and system developers evaluating depth sensing in consumer electronics, gaming, automotive, security, and industrial products.

• 2010

  Agree to acquisition by MicrosoftM&A

  Background

  Microsoft was seeking technologies that could support natural user interfaces and broader product adoption of depth and motion sensing.

  Action taken

  Microsoft announced on October 29, 2010, that it would acquire Canesta. The purchase price was not disclosed.

  Aftermath

  Canesta ceased to exist as an independent company, and its technology became part of Microsoft’s wider depth-sensing and natural-interface development efforts.

  Source

• 2006

  Increase emphasis on automotive sensingStrategy

  Background

  Automotive systems offered potential applications for depth sensing in occupant classification, airbag control, and obstacle detection.

  Action taken

  Canesta sought automotive investment and promoted vehicle-oriented applications at industry events, including Convergence 2006.

  Aftermath

  The company continued to position its sensor platform for OEM markets while also pursuing gaming and interactive-device applications.

  Source

• 2002

  Introduce electronic-perception and projection-keyboard applicationsProduct launch

  Background

  Canesta needed to demonstrate practical uses for its new CMOS time-of-flight sensing architecture and communicate its potential to mobile and consumer-electronics developers.

  Action taken

  The company publicly presented its single-chip 3D sensing technology and demonstrated a projected keyboard that converted finger movements into device input.

  Aftermath

  The projection-keyboard concept was later licensed to Celluon, while Canesta expanded its technology efforts into automotive, gaming, security, and industrial applications.

  Source

1. 1Canestaen.wikipedia.org