Data Infrastructure Types
Data infrastructure types represent traditional data warehouse, BI, and pipeline assets. These are the most common product types in Qarion, typically created automatically by connector syncs.
Available Types
Table
The default product type. Represents a database table, view, or materialized view.
- Icon: Table · Color:
#3b82f6(blue) - Created by: dbt sync, database scrapers, or manually
- System variants:
Scraped Table,dbt Model,dbt Source,View,Ephemeral
Tables get the full feature set including schema with column-level metadata, data profiling, quality checks, and environment diff.
Dashboard
Analytics dashboards and reports from BI tools.
- Icon: BarChart3 · Color:
#8b5cf6(purple) - Created by: BI connectors (Superset, Metabase, Looker, Tableau, Power BI) or manually
- System variants:
BI Dashboard,BI Chart
Dashboards support lineage tracking back to their source warehouse tables, enabling impact analysis when upstream data changes.
API
REST or GraphQL API endpoints exposing data.
- Icon: Code · Color:
#10b981(green) - Created by: Manual registration
API products track endpoint metadata, versioning, and consumer contracts.
Data Stream
Real-time data streams, Kafka topics, or event feeds.
- Icon: Zap · Color:
#ef4444(red) - Created by: Manual registration
Stream products support freshness SLAs and real-time quality monitoring.
File/Dataset
Flat files and structured datasets (CSV, Parquet, JSON, etc.).
- Icon: File · Color:
#6366f1(indigo) - Created by: Manual registration
File/Dataset products combine the standard schema tab with the File Metadata tab, bridging structured and file-based metadata.
Notebook
Jupyter notebooks, R Markdown, or other analysis notebooks.
- Icon: BookOpen · Color:
#ec4899(pink) - Created by: Manual registration
Notebooks track the analytical code and its data dependencies via lineage.
Available Tabs & Features
All data infrastructure types share the universal feature set:
| Tab | Description |
|---|---|
| Overview | Rich markdown description, ownership, stats, freshness indicator |
| Schema | Columns, data types, PK/FK/nullable flags, inline-editable descriptions |
| Profile | Column-level statistics (null %, distinct count, min/max, histograms) |
| Env Diff | Cross-environment schema comparison |
| Source | dbt SQL, view DDL, or code snippet (when available) |
| Quality Health | Automated checks, scores, trends, and execution history |
| Issues | Linked quality tickets with Kanban tracking |
| Governance | Policy compliance, governance role assignments |
| Contracts | SLA agreements and compliance monitoring |
| Change Requests | Formal change proposals with impact analysis |
| Risk | Risk assessment questionnaires and scoring |
| Versions | Release history with Git tag linking |
| Snapshots | Historical metadata snapshots |
| Use Cases | Registered business use cases |
| Glossary | Linked business glossary terms |
| Lineage | Interactive upstream/downstream dependency graph |
| Refreshes | Data refresh history and scheduling |
| Usage | Consumption analytics and popularity metrics |
| Insights | AI-generated data insights |
| Chatter | Team conversations and @mentions |
| Attachments | Reference documents and files |
| Access | Permission management (when linked to a source system) |
System Type Mapping
When connectors sync metadata, they assign specific system types:
| Connector | System Type Assigned |
|---|---|
| Database scraper | Scraped Table |
| dbt (table materialization) | Table |
| dbt (view materialization) | View |
| dbt (ephemeral) | Ephemeral |
| dbt (other) | dbt Model |
| dbt (source) | dbt Source |
| BI connectors | BI Dashboard or BI Chart |
Users can change the type at any time through the Edit Product modal. Manual edits are tracked in the user_edited_fields list, so subsequent syncs won't overwrite the user's choice.