Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 46 additions & 0 deletions datapacks/authz-perf-medium/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
# authz-perf-medium

Medium-scale authorization performance datapack for DataHub. Ingested via `datahub datapack load authz-perf-medium`.

## Contents

| File | Purpose |
|------|---------|
| `index.json` | Pack manifest (version, MCP file list) |
| `mcps/` | Metadata change proposals (~6378) |

Test oracles (`personas.json`, `benchmarks.json`) are maintained in the DataHub repository under `perf-test/authz-perf/fixture/` and are not part of this pack.

## Personas (17)

All personas use password = username (`persona-*` / `persona-*`).

| Persona | Stress focus |
|---------|----------------|
| `persona-admin` | Platform + direct user policy |
| `persona-zero-authz` | Baseline vs denied path |
| `persona-light-groups` … `persona-heavy-groups` | Group membership fanout (3–200 groups) |
| `persona-sso-groups` / `persona-native-groups` / `persona-dual-aspect` | SSO vs native membership aspects |
| `persona-direct-role` / `persona-role-via-groups` | Role inheritance |
| `persona-domain-policy-user` / `persona-multi-domain-policy` | Domain filter / multi-value DOMAIN |
| `persona-domain-owner` | Ownership-based checks |
| `persona-policy-direct` / `persona-platform-all-users` | Direct user / allUsers actors |
| `persona-group-policy-actor` | Group-based policy actor |

## Load

```bash
datahub datapack load authz-perf-medium
```

For local development before the registry URL is published:

```bash
datahub datapack load authz-perf-medium \
--url "file://$(pwd)/datapacks/authz-perf-medium/index.json" \
--trust-custom
```

## Benchmarks

Persona latency benchmarks are documented in the DataHub repository at `perf-test/authz-perf/README.md`.
27 changes: 27 additions & 0 deletions datapacks/authz-perf-medium/index.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
{
"version": "5",
"files": [
{
"path": "mcps/00-disable-default-policies.json"
},
{
"path": "mcps/corpGroup.json",
"wait_for_completion": true
},
{
"path": "mcps/corpuser.json"
},
{
"path": "mcps/domain.json"
},
{
"path": "mcps/glossaryNode.json"
},
{
"path": "mcps/glossaryTerm.json"
},
{
"path": "mcps/dataHubPolicy.json"
}
]
}
62 changes: 62 additions & 0 deletions datapacks/authz-perf-medium/mcps/00-disable-default-policies.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,62 @@
[
{
"auditHeader": null,
"entityType": "dataHubPolicy",
"entityUrn": "urn:li:dataHubPolicy:7",
"changeType": "UPSERT",
"aspectName": "dataHubPolicyInfo",
"aspect": {
"value": "{\"actors\":{\"resourceOwners\":false,\"allUsers\":true,\"allGroups\":false,\"users\":[]},\"privileges\":[\"VIEW_ANALYTICS\",\"GENERATE_PERSONAL_ACCESS_TOKENS\",\"VIEW_METADATA_PROPOSALS\"],\"displayName\":\"Authz perf \\u00b7 7 (PLATFORM)\",\"description\":\"Authz perf fixture policy. Supporting policy in the authz perf catalog. Actors: allUsers. Type: PLATFORM, state: INACTIVE, privileges: 3.\",\"state\":\"INACTIVE\",\"type\":\"PLATFORM\",\"editable\":true}",
"contentType": "application/json"
},
"systemMetadata": null
},
{
"auditHeader": null,
"entityType": "dataHubPolicy",
"entityUrn": "urn:li:dataHubPolicy:view-entity-page-all",
"changeType": "UPSERT",
"aspectName": "dataHubPolicyInfo",
"aspect": {
"value": "{\"actors\":{\"resourceOwners\":false,\"allUsers\":true,\"allGroups\":false,\"users\":[]},\"privileges\":[\"VIEW_ENTITY_PAGE\",\"SEARCH_PRIVILEGE\",\"GET_COUNTS_PRIVILEGE\",\"GET_TIMESERIES_ASPECT_PRIVILEGE\",\"GET_ENTITY_PRIVILEGE\",\"GET_TIMELINE_PRIVILEGE\",\"ES_EXPLAIN_QUERY_PRIVILEGE\"],\"displayName\":\"Authz perf \\u00b7 View Entity Page All (METADATA)\",\"description\":\"Authz perf fixture policy. Supporting policy in the authz perf catalog. Actors: allUsers. Type: METADATA, state: INACTIVE, privileges: 7.\",\"state\":\"INACTIVE\",\"type\":\"METADATA\",\"editable\":true}",
"contentType": "application/json"
},
"systemMetadata": null
},
{
"auditHeader": null,
"entityType": "dataHubPolicy",
"entityUrn": "urn:li:dataHubPolicy:view-dataset-sensitive",
"changeType": "UPSERT",
"aspectName": "dataHubPolicyInfo",
"aspect": {
"value": "{\"actors\":{\"resourceOwners\":false,\"allUsers\":true,\"allGroups\":false,\"users\":[]},\"privileges\":[\"VIEW_DATASET_USAGE\",\"VIEW_DATASET_PROFILE\",\"VIEW_DATASET_OPERATIONS\"],\"displayName\":\"Authz perf \\u00b7 View Dataset Sensitive (METADATA)\",\"description\":\"Authz perf fixture policy. Supporting policy in the authz perf catalog. Actors: allUsers. Type: METADATA, state: INACTIVE, privileges: 3.\",\"state\":\"INACTIVE\",\"type\":\"METADATA\",\"editable\":true}",
"contentType": "application/json"
},
"systemMetadata": null
},
{
"auditHeader": null,
"entityType": "dataHubPolicy",
"entityUrn": "urn:li:dataHubPolicy:editor-metadata-policy-entities",
"changeType": "UPSERT",
"aspectName": "dataHubPolicyInfo",
"aspect": {
"value": "{\"actors\":{\"resourceOwners\":false,\"allUsers\":false,\"allGroups\":false,\"users\":[],\"groups\":[],\"roles\":[\"urn:li:dataHubRole:Editor\"]},\"resources\":{\"allResources\":false,\"filter\":{\"criteria\":[{\"field\":\"TYPE\",\"values\":[\"dataset\",\"chart\",\"dashboard\",\"dataFlow\",\"dataJob\",\"tag\",\"container\",\"domain\",\"glossaryTerm\",\"glossaryNode\",\"notebook\",\"dataProduct\",\"dataProcessInstance\",\"document\"],\"condition\":\"EQUALS\"}]}},\"privileges\":[\"EDIT_ENTITY\"],\"displayName\":\"Authz perf \\u00b7 Editor Metadata Policy Entities (METADATA)\",\"description\":\"Authz perf fixture policy. Supporting policy in the authz perf catalog. Actors: roles [Editor]. Resource filter: TYPE=dataset, chart, dashboard (+11 more). Type: METADATA, state: INACTIVE, privileges: 1.\",\"state\":\"INACTIVE\",\"type\":\"METADATA\",\"editable\":true}",
"contentType": "application/json"
},
"systemMetadata": null
},
{
"auditHeader": null,
"entityType": "dataHubPolicy",
"entityUrn": "urn:li:dataHubPolicy:asset-owners-metadata-policy",
"changeType": "UPSERT",
"aspectName": "dataHubPolicyInfo",
"aspect": {
"value": "{\"actors\":{\"resourceOwners\":true,\"allUsers\":false,\"allGroups\":false,\"users\":[],\"groups\":[]},\"privileges\":[\"VIEW_ENTITY_PAGE\",\"VIEW_ENTITY\",\"EDIT_ENTITY_TAGS\",\"EDIT_ENTITY_GLOSSARY_TERMS\",\"EDIT_ENTITY_OWNERS\",\"EDIT_ENTITY_DOCS\",\"EDIT_ENTITY_DOC_LINKS\",\"EDIT_ENTITY_STATUS\",\"EDIT_DOMAINS_PRIVILEGE\",\"EDIT_ENTITY_DATA_PRODUCTS\",\"EDIT_DEPRECATION_PRIVILEGE\",\"EDIT_ENTITY_ASSERTIONS\",\"EDIT_ENTITY_INCIDENTS\",\"EDIT_ENTITY\",\"EDIT_DATASET_COL_TAGS\",\"EDIT_DATASET_COL_GLOSSARY_TERMS\",\"EDIT_DATASET_COL_DESCRIPTION\",\"EDIT_DATASET_COL_PROPERTIES\",\"EDIT_DATASET_COL_BUSINESS_ATTRIBUTE_PRIVILEGE\",\"VIEW_DATASET_USAGE\",\"VIEW_DATASET_PROFILE\",\"VIEW_DATASET_OPERATIONS\",\"EDIT_TAG_COLOR\",\"EDIT_GROUP_MEMBERS\",\"EDIT_USER_PROFILE\",\"EDIT_CONTACT_INFO\",\"MANAGE_ENTITY_TAGS\",\"MANAGE_ENTITY_GLOSSARY_TERMS\",\"MANAGE_ENTITY_PROPERTIES\",\"MANAGE_ENTITY_DOMAINS\",\"MANAGE_ENTITY_OWNERS\",\"MANAGE_DATASET_COL_GLOSSARY_TERMS\",\"MANAGE_DATASET_COL_TAGS\",\"MANAGE_DATASET_COL_PROPERTIES\",\"MANAGE_ENTITY_DOCS_PROPOSALS_PRIVILEGE\",\"MANAGE_ENTITY_POSTS\",\"EDIT_LINEAGE\",\"EDIT_ENTITY_QUERIES\",\"GET_TIMELINE_PRIVILEGE\",\"GET_ENTITY_PRIVILEGE\",\"GET_TIMESERIES_ASPECT_PRIVILEGE\",\"GET_COUNTS_PRIVILEGE\",\"MANAGE_DATA_PRODUCTS\",\"ES_EXPLAIN_QUERY_PRIVILEGE\",\"EDIT_ENTITY_PROPERTIES\",\"MANAGE_ASSET_SUMMARY\",\"MANAGE_GROUP_NOTIFICATION_SETTINGS\",\"MANAGE_GROUP_SUBSCRIPTIONS\",\"MANAGE_ENTITY_DATA_CONTRACT_PROPOSALS\",\"EDIT_ENTITY_DATA_CONTRACT_PRIVILEGE\",\"EDIT_ENTITY_LIFECYCLE_STAGE\",\"PROPOSE_ENTITY_LIFECYCLE_STAGE\",\"PROPOSE_DOCUMENT_CHANGES\"],\"displayName\":\"Authz perf \\u00b7 Asset Owners Metadata Policy (METADATA)\",\"description\":\"Authz perf fixture policy. Supporting policy in the authz perf catalog. Actors: resourceOwners. Type: METADATA, state: INACTIVE, privileges: 53.\",\"state\":\"INACTIVE\",\"type\":\"METADATA\",\"editable\":true}",
"contentType": "application/json"
},
"systemMetadata": null
}
]
Loading
Loading