Skip to content

Update on004588 to v1.0.2 #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
AmanJaiswal1503 wants to merge 6 commits into
base: main
Choose a base branch
from
Open

Update on004588 to v1.0.2 #1

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
e820bc5
Update on004588 to 1.0.2
AmanJaiswal1503 May 22, 2026
fed2fc8
Curation corrections: drop nemar-cli GeneratedBy (source declares non…
AmanJaiswal1503 May 29, 2026
35e8115
Merge remote-tracking branch 'origin/main' into update/on004588-mphbswkd
AmanJaiswal1503 May 29, 2026
37e0472
Events column split (per maintainer feedback): add event_class, stim_…
AmanJaiswal1503 Jun 5, 2026
3daf037
Revert Version bump from prior commit
AmanJaiswal1503 Jun 5, 2026
2c0e67f
README: collapse to single curation section describing final state
AmanJaiswal1503 Jun 5, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 7 additions & 2 deletions .bidsignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,2 +1,7 @@
**/eye_tracker/**
QuestionnaireResponses .nemar/
*/eye_tracker
*/eye_tracker/
*/eye_tracker/**
QuestionnaireResponses
QuestionnaireResponses/
QuestionnaireResponses/**
.nemar/
41 changes: 40 additions & 1 deletion README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,43 @@

A novel multimodal Neuromarketing dataset that encompasses the data from 42 individuals who participated in an advertising brochure-browsing scenario is introduced here. In more detail, participants were exposed to a series of supermarket brochures (containing various products) and instructed to select the products they intended to buy. The data collected for each individual executing this protocol included: (i) encephalographic (EEG) recordings, (ii) eye tracking (ET) recordings, (iii) questionnaire responses (demographic, profiling and product related questions), and (iv) computer mouse data.

The preprocessed version of this dataset can be found here: https://figshare.com/articles/dataset/NeuMa_PreProcessed_A_multimodal_Neuromarketing_dataset/22117124
The preprocessed version of this dataset can be found here: https://figshare.com/articles/dataset/NeuMa_PreProcessed_A_multimodal_Neuromarketing_dataset/22117124

## NEMAR curation changes

Changes applied to the OpenNeuro source during the NEMAR rehost. The BIDS validator goes from 43 errors + 1850 warnings to 0 errors + 1765 warnings; the residual warnings are recommended-but-missing study-specific fields that cannot be filled without information from the original lab. None of the raw `.set` / `.fdt` binary payloads are modified; every change is to a text sidecar or to the validation-ignore list.

**Dataset description (`dataset_description.json`)**
- `DatasetType: "raw"` is added so the dataset is validated as raw data rather than a derivative; without it the validator falls through to derivative-rules checks and emits cascading warnings.
- `BIDSVersion` is set to `1.11.1`, the version the current validator checks against.
- `GeneratedBy` is absent, matching the source. Nothing is added there.
- `ReferencesAndLinks` was `[""]` (a one-element list containing an empty string, not a usable URL); it is now `[]`.

**Root events sidecar (`task-unnamed_events.json`)**
- The source file was an empty JSON array (`[]`), which BIDS rejects because sidecar JSON files must be objects. It is rewritten as a proper JSON object documenting every column actually present in the per-recording `events.tsv` tables (see below).
- Documents `sample` (sample index of the event) and `value` (verbatim event label as recorded in the source acquisition; carries three vocabularies — stimulus presentation strings of form `Category:IMG=ID:<file>=Type:<category>`, mouse / mouse-wheel events of form `<device> <action>`, and atomic trial markers `fixation_cross` / `EOE`).
- Also documents the three derived columns added to every `events.tsv` (see next bullet group).

**Events tables (`*_events.tsv`, 84 files: 42 subjects × `eeg/` + `eye_tracker/`)**
- Three columns are appended to every row to make the structure of `value` machine-readable without losing the original string:
- `event_class`: one of `stimulus`, `response`, `marker`. Pure regex classification of `value`.
- `stim_id`: for `event_class=stimulus` rows, the filename from the `ID:` field of `value` (e.g. `FYLLADIO_1.tif`). `n/a` for response and marker rows.
- `stim_category`: for `event_class=stimulus` rows, the category label from the `Type:` field of `value` (e.g. `Leaflet_Images_1`). `n/a` for response and marker rows.
- Every new cell is either a literal substring of the original `value` or a class label that follows unambiguously from the regex match. No semantic interpretation, no invented metadata.
- Row distribution across the dataset: 902 stimulus, 3741 response, 168 marker (4811 rows total touched). The original `value` column is preserved verbatim alongside the new columns.

**Subject S37 events table (`sub-S37/eeg/sub-S37_task-unnamed_events.tsv`)**
- The final source row at sample 200123 carried a corrupted value (`MouseButt` followed by stray bytes `\xbf>\xcf`, not valid UTF-8) — the original write was truncated mid-string. That single row failed encoding validation and cascaded into missing-column errors on the whole file. The corrupted row is dropped; the likely intended label (`MouseButtonLeft pressed`, by analogy with the prior row) is not invented. The other 244 data rows are preserved unchanged.

**Participants table (`participants.tsv`)**
- The `participant_id` column listed `sub-S1`, `sub-S2`, `sub-S3`, `sub-S5`, and `sub-S6` (single-digit IDs), but every on-disk subject directory uses the zero-padded `sub-SNN` form. The five unpadded entries are padded to `sub-S01`, `sub-S02`, `sub-S03`, `sub-S05`, and `sub-S06` so the TSV matches the directories. No other rows changed.

**Validation-ignore list (`.bidsignore`)**
- Each subject keeps a non-BIDS `eye_tracker/` modality directory alongside `eeg/` (an EEGLAB-format `.set` file plus paired sidecars holding the eye-tracker recording), and the dataset root keeps a `QuestionnaireResponses/` folder. Neither shape matches a BIDS modality, so both belong on the ignore list.
- The original anchored patterns (`**/eye_tracker/**`) only matched files inside the directory and let the validator still flag the directory entry itself as not-included. The patterns are broadened to the unanchored triple `*/eye_tracker`, `*/eye_tracker/`, `*/eye_tracker/**`, and the same shape is added for `QuestionnaireResponses`, so both the directory entries and their contents are excluded.

**Left untouched**
- Recording-level recommended metadata (manufacturer, model, software version, serial number, task description, instructions, cognitive-atlas / CogPO URIs, institution name and address, and similar fields across all subject `_eeg.json` sidecars) is left blank rather than filled with guesses. These are study-specific facts that need the original lab to confirm.

**Remaining warnings (1765)**
- All "recommended but missing" fields: 1722 sidecar entries for the per-recording fields listed above, 42 event-onset-ordering notices on per-subject events tables (a soft warning, not a structural defect), and 1 dataset-level entry flagging that `GeneratedBy` is recommended but absent. `GeneratedBy` is deliberately not added so the dataset reflects the source publication; the warning is expected.
11 changes: 5 additions & 6 deletions dataset_description.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,16 +14,15 @@
"Nikos A. Laskaris",
"Ioannis Kompatsiaris"
],
"ReferencesAndLinks": [
""
],
"BIDSVersion": "1.8.0",
"ReferencesAndLinks": [],
"BIDSVersion": "1.11.1",
"HEDVersion": "8.1.0",
"DatasetDOI": "10.82901/nemar.on004588",
"SourceDatasets": [
{
"DOI": "doi:10.18112/openneuro.ds004588.v1.2.0"
}
],
"Version": "1.0.0"
}
"Version": "1.0.2",
"DatasetType": "raw"
}
10 changes: 5 additions & 5 deletions participants.tsv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
participant_id
sub-S1
sub-S2
sub-S3
sub-S5
sub-S6
sub-S01
sub-S02
sub-S03
sub-S05
sub-S06
sub-S07
sub-S08
sub-S09
Expand Down
106 changes: 53 additions & 53 deletions sub-S01/eeg/sub-S01_task-unnamed_events.tsv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,53 +1,53 @@
onset duration sample value
6.2566666667 1.0000000000 1877 fixation_cross
175.9700000000 1.0000000000 52791 Category:IMG=ID:FYLLADIO_1.tif=Type:Leaflet_Images_1
203.6900000000 1.0000000000 61107 Category:IMG=ID:FYLLADIO_2.tif=Type:Leaflet_Images_1
233.1066666667 1.0000000000 69932 Category:IMG=ID:FYLLADIO_3.tif=Type:Leaflet_Images_1
254.9000000000 1.0000000000 76470 Category:IMG=ID:FYLLADIO_4.tif=Type:Leaflet_Images_1
259.5133333333 1.0000000000 77854 Category:IMG=ID:FYLLADIO_5.tif=Type:Leaflet_Images_1
266.0900000000 1.0000000000 79827 Category:IMG=ID:FYLLADIO_6.tif=Type:Leaflet_Images_1
266.9066666667 1.0000000000 80072 Category:IMG=ID:FYLLADIO_5.tif=Type:Leaflet_Images_1
270.7700000000 1.0000000000 81231 Category:IMG=ID:FYLLADIO_6.tif=Type:Leaflet_Images_1
279.7666666667 1.0000000000 83930 Category:IMG=ID:FYLLADIO_1.tif=Type:Leaflet_Images_1
321.3666666667 1.0000000000 96410 Category:IMG=ID:FYLLADIO_2.tif=Type:Leaflet_Images_1
327.3566666667 1.0000000000 98207 Category:IMG=ID:FYLLADIO_3.tif=Type:Leaflet_Images_1
340.9200000000 1.0000000000 102276 Category:IMG=ID:FYLLADIO_4.tif=Type:Leaflet_Images_1
346.2366666667 1.0000000000 103871 Category:IMG=ID:FYLLADIO_5.tif=Type:Leaflet_Images_1
349.4466666667 1.0000000000 104834 Category:IMG=ID:FYLLADIO_6.tif=Type:Leaflet_Images_1
352.0200000000 1.0000000000 105606 Category:IMG=ID:FYLLADIO_1.tif=Type:Leaflet_Images_1
356.3966666667 1.0000000000 106919 Category:IMG=ID:FYLLADIO_2.tif=Type:Leaflet_Images_1
357.6800000000 1.0000000000 107304 EOE
357.7866666667 1.0000000000 107336 Category:IMG=ID:FYLLADIO_2.tif=Type:Leaflet_Images_1
1.3100000000 1.0000000000 393 MouseButtonLeft pressed
1.3633333333 1.0000000000 409 MouseButtonLeft released
141.6900000000 1.0000000000 42507 MouseButtonLeft pressed
141.7700000000 1.0000000000 42531 MouseButtonLeft released
145.7533333333 1.0000000000 43726 MouseButtonLeft pressed
145.9300000000 1.0000000000 43779 MouseButtonLeft released
196.1700000000 1.0000000000 58851 MouseButtonLeft pressed
196.3033333333 1.0000000000 58891 MouseButtonLeft released
231.2400000000 1.0000000000 69372 MouseButtonLeft pressed
231.3533333333 1.0000000000 69406 MouseButtonLeft released
237.0000000000 1.0000000000 71100 MouseButtonLeft pressed
237.0866666667 1.0000000000 71126 MouseButtonLeft released
247.8400000000 1.0000000000 74352 MouseButtonLeft pressed
247.9666666667 1.0000000000 74390 MouseButtonLeft released
249.5366666667 1.0000000000 74861 MouseButtonLeft pressed
249.6733333333 1.0000000000 74902 MouseButtonLeft released
254.0233333333 1.0000000000 76207 MouseButtonLeft pressed
254.1266666667 1.0000000000 76238 MouseButtonLeft released
268.5900000000 1.0000000000 80577 MouseButtonLeft pressed
268.6866666667 1.0000000000 80606 MouseButtonLeft released
277.8166666667 1.0000000000 83345 MouseButtonLeft pressed
277.9433333333 1.0000000000 83383 MouseButtonLeft released
307.4233333333 1.0000000000 92227 MouseButtonLeft pressed
307.5500000000 1.0000000000 92265 MouseButtonLeft released
311.9666666667 1.0000000000 93590 MouseButtonLeft pressed
312.1200000000 1.0000000000 93636 MouseButtonLeft released
317.3100000000 1.0000000000 95193 MouseButtonLeft pressed
317.4133333333 1.0000000000 95224 MouseButtonLeft released
336.9100000000 1.0000000000 101073 MouseButtonLeft pressed
337.0233333333 1.0000000000 101107 MouseButtonLeft released
366.7800000000 1.0000000000 110034 MouseButtonLeft pressed
366.9100000000 1.0000000000 110073 MouseButtonLeft released
368.5133333333 1.0000000000 110554 MouseButtonLeft pressed
onset duration sample value event_class stim_id stim_category
6.2566666667 1.0000000000 1877 fixation_cross marker n/a n/a
175.9700000000 1.0000000000 52791 Category:IMG=ID:FYLLADIO_1.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_1.tif Leaflet_Images_1
203.6900000000 1.0000000000 61107 Category:IMG=ID:FYLLADIO_2.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_2.tif Leaflet_Images_1
233.1066666667 1.0000000000 69932 Category:IMG=ID:FYLLADIO_3.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_3.tif Leaflet_Images_1
254.9000000000 1.0000000000 76470 Category:IMG=ID:FYLLADIO_4.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_4.tif Leaflet_Images_1
259.5133333333 1.0000000000 77854 Category:IMG=ID:FYLLADIO_5.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_5.tif Leaflet_Images_1
266.0900000000 1.0000000000 79827 Category:IMG=ID:FYLLADIO_6.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_6.tif Leaflet_Images_1
266.9066666667 1.0000000000 80072 Category:IMG=ID:FYLLADIO_5.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_5.tif Leaflet_Images_1
270.7700000000 1.0000000000 81231 Category:IMG=ID:FYLLADIO_6.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_6.tif Leaflet_Images_1
279.7666666667 1.0000000000 83930 Category:IMG=ID:FYLLADIO_1.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_1.tif Leaflet_Images_1
321.3666666667 1.0000000000 96410 Category:IMG=ID:FYLLADIO_2.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_2.tif Leaflet_Images_1
327.3566666667 1.0000000000 98207 Category:IMG=ID:FYLLADIO_3.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_3.tif Leaflet_Images_1
340.9200000000 1.0000000000 102276 Category:IMG=ID:FYLLADIO_4.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_4.tif Leaflet_Images_1
346.2366666667 1.0000000000 103871 Category:IMG=ID:FYLLADIO_5.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_5.tif Leaflet_Images_1
349.4466666667 1.0000000000 104834 Category:IMG=ID:FYLLADIO_6.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_6.tif Leaflet_Images_1
352.0200000000 1.0000000000 105606 Category:IMG=ID:FYLLADIO_1.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_1.tif Leaflet_Images_1
356.3966666667 1.0000000000 106919 Category:IMG=ID:FYLLADIO_2.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_2.tif Leaflet_Images_1
357.6800000000 1.0000000000 107304 EOE marker n/a n/a
357.7866666667 1.0000000000 107336 Category:IMG=ID:FYLLADIO_2.tif=Type:Leaflet_Images_1 stimulus FYLLADIO_2.tif Leaflet_Images_1
1.3100000000 1.0000000000 393 MouseButtonLeft pressed response n/a n/a
1.3633333333 1.0000000000 409 MouseButtonLeft released response n/a n/a
141.6900000000 1.0000000000 42507 MouseButtonLeft pressed response n/a n/a
141.7700000000 1.0000000000 42531 MouseButtonLeft released response n/a n/a
145.7533333333 1.0000000000 43726 MouseButtonLeft pressed response n/a n/a
145.9300000000 1.0000000000 43779 MouseButtonLeft released response n/a n/a
196.1700000000 1.0000000000 58851 MouseButtonLeft pressed response n/a n/a
196.3033333333 1.0000000000 58891 MouseButtonLeft released response n/a n/a
231.2400000000 1.0000000000 69372 MouseButtonLeft pressed response n/a n/a
231.3533333333 1.0000000000 69406 MouseButtonLeft released response n/a n/a
237.0000000000 1.0000000000 71100 MouseButtonLeft pressed response n/a n/a
237.0866666667 1.0000000000 71126 MouseButtonLeft released response n/a n/a
247.8400000000 1.0000000000 74352 MouseButtonLeft pressed response n/a n/a
247.9666666667 1.0000000000 74390 MouseButtonLeft released response n/a n/a
249.5366666667 1.0000000000 74861 MouseButtonLeft pressed response n/a n/a
249.6733333333 1.0000000000 74902 MouseButtonLeft released response n/a n/a
254.0233333333 1.0000000000 76207 MouseButtonLeft pressed response n/a n/a
254.1266666667 1.0000000000 76238 MouseButtonLeft released response n/a n/a
268.5900000000 1.0000000000 80577 MouseButtonLeft pressed response n/a n/a
268.6866666667 1.0000000000 80606 MouseButtonLeft released response n/a n/a
277.8166666667 1.0000000000 83345 MouseButtonLeft pressed response n/a n/a
277.9433333333 1.0000000000 83383 MouseButtonLeft released response n/a n/a
307.4233333333 1.0000000000 92227 MouseButtonLeft pressed response n/a n/a
307.5500000000 1.0000000000 92265 MouseButtonLeft released response n/a n/a
311.9666666667 1.0000000000 93590 MouseButtonLeft pressed response n/a n/a
312.1200000000 1.0000000000 93636 MouseButtonLeft released response n/a n/a
317.3100000000 1.0000000000 95193 MouseButtonLeft pressed response n/a n/a
317.4133333333 1.0000000000 95224 MouseButtonLeft released response n/a n/a
336.9100000000 1.0000000000 101073 MouseButtonLeft pressed response n/a n/a
337.0233333333 1.0000000000 101107 MouseButtonLeft released response n/a n/a
366.7800000000 1.0000000000 110034 MouseButtonLeft pressed response n/a n/a
366.9100000000 1.0000000000 110073 MouseButtonLeft released response n/a n/a
368.5133333333 1.0000000000 110554 MouseButtonLeft pressed response n/a n/a
Loading
Loading