Concept Reference
What is a concept?
A concept is the type of thing our image recognition (IR) detects and draws a bounding box around in an image. When a task is processed, the localiser finds every region of interest and tags each one with a concept, and the labeller then adds richer metadata as modalities.
In the IR response (API v3), the concept appears as the concept field of each annotation:
{
"id": 34,
"bbox": { "x": 2454, "y": 5001, "width": 1174, "height": 482 },
"concept": "promo",
"modalities": [
{
"key": "promo:price",
"predictions": [
{ "value": "5_1", "score": 1.0, "is_main": true }
]
}
]
}
Which concepts are detected depends on the features enabled for your task. The sections below group the concepts by the capability they belong to.
Products (SKUs)
Concepts that represent physical products on the shelf. Each is a distinct kind of product facing.
single
What: A single product unit — one facing of an individual stock-keeping unit (SKU). This is the most common concept and represents a standalone item on the shelf (e.g. one bottle, one can, one box).
multipack
What: A multipack — a single package that contains several units of the same product sold together (e.g. a 6-pack of cans or a shrink-wrapped bundle). It is detected as one annotation even though it represents more than one unit.
taps
What: Draught dispensing taps — the tap handles used to serve beverages on draught (for example, in on-premise venues such as bars). Each tap is detected as its own concept.
Realogram
Concepts used to reconstruct the shelf layout (the realogram) and to identify availability issues. See the realogram:* modalities for how products are positioned within these rows.
shelf-row
What: A shelf row (fixture row) — the horizontal fixture that products sit on. Shelf-row annotations are returned as bounding boxes and are used to group products by the shelf they belong to when building the realogram.
Related: When the realogram return_fixture parameter is enabled, each shelf-row carries a fixture modality describing the row type (e.g. SHELF_ROW, COLD_ROW).
gap
What: A gap — an empty space on a shelf where a product (or multiple products) would be expected but missing, indicating a potential out-of-stock situation.
Price
price
What: A price tag / shelf-edge label detected on the fixture. The price concept marks where pricing information is; the extracted values (price, quantity, discounts, promotional wording) are exposed through the promo:* modalities.
Point of Sale Materials (POSM)
Promotional and marketing materials found in the retail environment.
promo
What: A promotional label — a shelf-edge tag or label advertising a special offer (e.g. a multi-buy or discount tag). Promo annotations carry the promo:price, promo:quantity, promo:price-discount, and promo:text modalities with the extracted offer details. Contact Neurolabs for specific supported promo sub-types for your use case (barkers etc)
poster
What: A promotional poster or piece of signage displayed in-store (e.g. a campaign poster or wall/aisle signage).
strip (shelf-strip)
What: A shelf strip (shelf talker) — a promotional strip attached along the front edge of a shelf to draw attention to a product or offer.
Concept summary
| Group | Concept | concept value |
|---|---|---|
| Products (SKUs) | Single | single |
| Products (SKUs) | Multipack | multipack |
| Products (SKUs) | Taps | taps |
| Realogram | Shelf row | shelf-row |
| Realogram | Gap | gap |
| Price | Price | price |
| POSM | Promo | promo |
| POSM | Poster | poster |
| POSM | Shelf strip | strip |