Level 1: environment-independent sensor design


The image below is an interactive 3D render of a robot (the cylinder). The robot's goal is to find the green ball in an arbitrary environment as quickly as possible.

Your task is to optimize the camera parameters below to allow the robot to autonomously find the ball as quickly as possible. You have the following information:

Robot details:

Environment details:

Camera controls: Adjust the XYZ position, pitch/yaw, and field of view (FOV) of the sensors shown in the viewports. Please place the sensors close to the robot's body. All parameters except for pitch are in the robot's coordinates; pitch is local to the sensor. X = red, Y = green, Z = blue.

Viewport controls: You must click on a sensor to edit it. The editable, "active" camera will be pink. You can rotate the view of the robot by holding left-click in the viewport and dragging. Pan by holding ctrl/cmd and dragging.

Question 1: Optimize design and placement of single cameras

In this question, the robot is equipped with an RGB pinhole camera (the yellow cone). The camera outputs a 256 x 256 x 3 image. The yellow arrow on the camera indicates its direction of view.

Click on the sensor to edit it.

Questions 2 and 3: Optimize design and placement of photoreceptors

In these next questions, the robot's shape, environment, and goal are unchanged, but instead of a camera, the robot is equipped with 1 x 1 photoreceptors (the yellow cone).

According to our sensor model, a 1 x 1 photoreceptor works similarly to a camera, but instead of capturing a H x W x 3 RGB image, it averages out all the colors/light in its field of view into one RGB value.

A higher FOV photoreceptor captures more of the environment, but is less sensitive to change. A lower FOV photoreceptor captures less of the environment, but is more sensitive to change.

Question 2: Optimize design and placement of 2 photoreceptors

In this question, your task is to optimize the parameters of 2 photoreceptors to allow the robot to find the ball as quickly as possible.

You can used the "Add photoreceptor" button to add a photoreceptor. Your final design MUST have exactly 2 photoreceptors.

Question 3: Optimize design and placement of 4 photoreceptors

In this question, your task is to optimize the parameters of 4 photoreceptors to allow the robot to find the ball as quickly as possible.

You can used the "Add photoreceptor" button to add a photoreceptor. Your final design MUST have exactly 4 photoreceptors.