RoboQuestby DeCLaRe Lab GitHub

Tasks

Each task gives the goal but hides what the robot needs to know. The robot has to act to find out

Search Room

Find the complete set of hidden targets

A set of target items is stored in open or closed locations around a room, among distractor items of similar kind. The goal is to collect the complete set on the tray and press SUBMIT. The locations, the number of storage places, and which storage places are empty are not given. The robot must choose where to search, use negative findings to redirect, remember what it has checked, and stop once the set is complete.

Variation

Instances vary the set size, item category, room layout, number and type of storage units, and distractors.

Locked Storage

Follow the token chain to reach the target

Storage compartments open only when a matching access token rests on their reader. Tokens are either outside the initial observation or hidden inside other storage, and some compartments contain tokens for other compartments, forming a dependency chain. The goal is to retrieve the target item. Finding a token changes which places can be searched next. Closing a compartment with a token still inside locks that token away permanently, so the robot must plan token handling as well as search order.

Variation

Instances vary the number of locked compartments, chain structure, token hiding places, and dead ends.

Blackout Search

Find targets with a light and a free hand

A search task is performed in an unlit room. Only a light source with a glow marker and the SUBMIT button are visible at the start. The robot must acquire the light source, carry it, and search using a wrist camera that sees only what is illuminated. Because one gripper holds the light, retrieving a target requires putting the light down while aiming it at the target, then acting from memory in the dark.

Variation

Instances vary the target, room, location of the light source, whether a wall switch exists, and whether a timed light turns off after a delay.

Inspect

Lift, turn or open objects to see what is hidden, and stop once the answer is clear

Painted Cubes

Inspect unseen faces to identify matching objects

A collection of similar objects each carries a hidden property distributed over its faces, such as the number of painted faces, with some faces turned toward the table or away from every camera. The goal is to collect every object satisfying a stated property, for example, exactly one painted face. Partial views can reject an object but cannot confirm it, so the robot must decide how much inspection each object needs.

Variation

Instances vary the number of objects, property rule, initial orientations, and whether the goal asks for one qualifying object or all of them.

Marked Mugs

Read hidden labels and keep the contents together

Several identical vessels, all mugs or all bowls in a given instance, each hold loose contents, and a label on the underside of each vessel specifies its destination. The goal is to place every vessel upright at its destination with its original contents inside. Reading a label requires lifting or tilting the vessel, which spills the contents; spilled contents stay nearby and must be returned to the correct vessel before submission.

Variation

Instances vary the number of vessels, contents, label-to-destination mapping, and initial poses.

Unfamiliar Containers

Discover how each container opens

Several closed containers each open by a different mechanism, such as a hinged lid, sliding lid, drawer, or latched flip-top, and some cannot be opened at all. The target is inside one of them. The robot knows neither where the target is nor how each container opens and must discover each mechanism by interaction.

Variation

Instances vary the number of containers, mix of mechanisms, target location, and number of decoys.

Test

Try something and watch what happens to work out a weight, a stamp pattern, a release order or a small tilt

Stamp Composition

Test and combine hidden stamp patterns

Several stamps with unmarked housings each carry a hidden pattern and start at an unknown rotation. A target pattern is shown on a reference. A test surface allows trial impressions, and a final surface must end with exactly the target. The robot must test stamps, read the results, select a subset and their rotations, compose the target, and press SUBMIT. Marks on the final surface are permanent.

Variation

Instances vary the number of stamps, patterns, target, initial rotations, and size of the test surface.

Odd Parcel

Use a balance to find the different parcel

A set of visually identical sealed parcels contains one or two parcels that differ in weight. The only instrument is a two-pan balance whose pans hold several parcels each. The goal is to place the odd parcel alone on the tray. Weighing groups finds it in a few comparisons; weighing one parcel at a time is allowed but slower.

Variation

Instances vary the number of parcels, whether the odd parcel is known to be heavier or could be lighter, pan capacity, and parcel appearance.

Puzzle Box

Discover the order that releases the locks

A container is held closed by a chain of interlocking parts, where each part blocks another until it is moved. All parts are visible with large handles, but the blocking relations are not. The goal is to place the item inside on the tray. The robot must discover the release order by trying moves and observing what moves, and some wrong moves jam another part until reversed.

Variation

Instances vary the number of parts, chain structure, presence of red-herring parts, and trap moves.

Wobbly Stand

Use a rolling ball to reveal and correct a tilt

A stand or table has an uneven support, tilting its surface by an amount too small to see directly. A ball placed on the surface rolls toward the low side and reveals the tilt. Shim blocks of different thicknesses are available. The goal is a level surface on which the ball stays put, with everything released.

Variation

Instances vary the number of legs affected, tilt magnitude, shim set, and whether the tilt is along one axis or two.