Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Explorer workshop guide #6150

Merged
merged 52 commits into from
Oct 3, 2024
Merged
Show file tree
Hide file tree
Changes from 12 commits
Commits
Show all changes
52 commits
Select commit Hold shift + click to select a range
451dc85
Create explorer-qs.md
MichelleBaird-DBT Sep 24, 2024
653a920
Update explorer-qs.md
MichelleBaird-DBT Sep 24, 2024
a40c9df
Update explorer-qs.md
MichelleBaird-DBT Sep 25, 2024
8c2f62c
Add files via upload
MichelleBaird-DBT Sep 25, 2024
0da2ebb
Add files via upload
MichelleBaird-DBT Sep 25, 2024
c593c59
Add files via upload
MichelleBaird-DBT Sep 25, 2024
389b1b0
Add files via upload
MichelleBaird-DBT Sep 25, 2024
bb4b374
Update explorer-qs.md
MichelleBaird-DBT Sep 25, 2024
510fce4
Update explorer-qs.md
MichelleBaird-DBT Sep 25, 2024
d0ba5ed
Merge branch 'current' into explorer-workshop-guide
mirnawong1 Sep 26, 2024
a3a4b97
Update website/docs/guides/explorer-qs.md
mirnawong1 Sep 26, 2024
63eb0be
Merge branch 'current' into explorer-workshop-guide
mirnawong1 Sep 26, 2024
5f86552
Update website/docs/guides/explorer-qs.md
mirnawong1 Sep 26, 2024
dda8d8a
Update website/docs/guides/explorer-qs.md
mirnawong1 Sep 26, 2024
7a1942e
update first page
mirnawong1 Sep 26, 2024
23b43cf
tweaks
mirnawong1 Sep 26, 2024
0130780
add id
mirnawong1 Sep 26, 2024
c0d90da
add next steps
mirnawong1 Sep 26, 2024
9b91c15
Update explorer-qs.md
MichelleBaird-DBT Sep 26, 2024
81ac1f0
Update explorer-qs.md
MichelleBaird-DBT Sep 26, 2024
f412ee1
Merge branch 'current' into explorer-workshop-guide
mirnawong1 Sep 26, 2024
48d429d
Merge branch 'current' into explorer-workshop-guide
mirnawong1 Sep 27, 2024
41ff8ae
Update website/docs/guides/explorer-qs.md
mirnawong1 Sep 27, 2024
36a177d
Update website/docs/guides/explorer-qs.md
mirnawong1 Sep 27, 2024
6e7b9ba
Update website/docs/guides/explorer-qs.md
mirnawong1 Sep 27, 2024
f689960
Update website/docs/guides/explorer-qs.md
mirnawong1 Sep 27, 2024
7d70135
Update website/docs/guides/explorer-qs.md
mirnawong1 Sep 27, 2024
543f42a
Update website/docs/guides/explorer-qs.md
mirnawong1 Sep 27, 2024
aa9091d
Update explorer-qs.md
mirnawong1 Sep 27, 2024
ce7a3ce
Update explorer-qs.md
MichelleBaird-DBT Oct 1, 2024
6f40304
Update explorer-qs.md
MichelleBaird-DBT Oct 1, 2024
bbab137
Add files via upload
MichelleBaird-DBT Oct 1, 2024
f35127b
Add files via upload
MichelleBaird-DBT Oct 1, 2024
ebe612a
Update explorer-qs.md
MichelleBaird-DBT Oct 1, 2024
622bfe0
Add files via upload
MichelleBaird-DBT Oct 1, 2024
45e17a8
Update explorer-qs.md
MichelleBaird-DBT Oct 1, 2024
1e0a01a
Merge branch 'current' into explorer-workshop-guide
MichelleBaird-DBT Oct 1, 2024
8f229e1
Update explorer-qs.md
MichelleBaird-DBT Oct 1, 2024
34126f1
Merge branch 'current' into explorer-workshop-guide
mirnawong1 Oct 2, 2024
6eb3f6a
Merge branch 'current' into explorer-workshop-guide
mirnawong1 Oct 2, 2024
6f286fe
Update explorer-qs.md
mirnawong1 Oct 2, 2024
19a5930
Merge branch 'current' into explorer-workshop-guide
mirnawong1 Oct 2, 2024
ec04d8f
Merge branch 'current' into explorer-workshop-guide
mirnawong1 Oct 2, 2024
62e65ef
Merge branch 'current' into explorer-workshop-guide
mirnawong1 Oct 2, 2024
a735bae
coap tweaks in final review
coapacetic Oct 2, 2024
8b39688
Merge branch 'current' into explorer-workshop-guide
coapacetic Oct 2, 2024
39a9535
tweak image and some copy
coapacetic Oct 2, 2024
215c250
Merge branch 'explorer-workshop-guide' of github.com:dbt-labs/docs.ge…
coapacetic Oct 2, 2024
8dcdfde
Merge branch 'current' into explorer-workshop-guide
MichelleBaird-DBT Oct 2, 2024
f7102f5
Merge branch 'current' into explorer-workshop-guide
mirnawong1 Oct 3, 2024
5505855
Update explorer-qs.md
mirnawong1 Oct 3, 2024
b4eb461
Merge branch 'current' into explorer-workshop-guide
mirnawong1 Oct 3, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
98 changes: 98 additions & 0 deletions website/docs/guides/explorer-qs.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,98 @@
---
title: "Quickstart for the dbt Explorer Workshop"
mirnawong1 marked this conversation as resolved.
Show resolved Hide resolved
id: ex-qs
mirnawong1 marked this conversation as resolved.
Show resolved Hide resolved
description: "Use this guide to build and define metrics, set up the dbt Cloud Semantic Layer, and query them using Google Sheets."
sidebar_label: "Quickstart dbt Explorer"
icon: 'guides'
hide_table_of_contents: true
tags: ['Explorer', 'Snowflake', 'dbt Cloud','Quickstart']
keywords: ['dbt Explorer','Mesh','dbt Cloud', 'Snowflake', 'Multi-Project']
level: 'Beginner'
recently_updated: true
---


## Introduction
Unlock the power of [dbt Explorer](/docs/collaborate/explore-projects) in this hands-on workshop designed for analytics engineers, data analysts, stakeholders, and data leaders! Dive into a production-level dbt Mesh implementation and discover how to explore your data workflows.⁠ Whether you're looking to streamline your data operations, improve data quality, or self-serve information about your data platform, this workshop will equip you with the tools and knowledge to take your dbt projects to the next level.

**You’ll learn how to:**
- Navigate multiple dbt projects using dbt Explorer
- Self-serve on data documentation
- Trace dependencies at the model and column level
- Identify opportunities to improve performance and data quality

**Prerequisites:**
- Familiarity with data platforms

## Setup
Now we’ll be creating your dbt Cloud account and connecting it to a data warehouse.
- Go to this URL: https://cloud.getdbt.com/coalesce-workshop-signup
- If you are already signed into dbt Cloud, sign out first!
- Enter your first name and last name
- Choose the “Exploring a dbt Mesh implementation with dbt Explorer” option.
- Agree to the terms of service and click the “Complete Registration” button. Wait about 30 seconds, and you’ll be in the dbt Cloud project for this course, already connected to a data warehouse!
MichelleBaird-DBT marked this conversation as resolved.
Show resolved Hide resolved

## Get and overview of your project and view the status of your latest runs

<Lightbox src="/img/quickstarts/dbt-cloud/explorer_performance_tab.png" title="dbt Explorer performance tab" />

With dbt Explorer, you can view your project's resources (such as models, tests, and metrics), their lineage, and model consumption to gain a better understanding of its latest production state. Navigate and manage your projects within dbt Cloud to help you and other data developers, analysts, and consumers discover and leverage your dbt resources.

#### Hands-On
- Explore the Model tab
- Which job took the Longest?
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how do you feel about 'Try it out' so it's more clear that this is an interactive part?

- Which job/jobs failed? Why?
- Explore the Sources tab
- What sources can we see?
- Explore the Tests Tab
- Did we run the right test?, Which test were missing? Why?
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Extra comma here

mirnawong1 marked this conversation as resolved.
Show resolved Hide resolved
- Explore Exposures
- Check Quality and where they came from

## Lineage

dbt Explorer provides a visualization of your project’s [DAG](/terms/dag) that you can interact with. The nodes in the lineage graph represent the project’s resources and the edges represent the relationships between the nodes. Nodes are color-coded and include iconography according to their resource type.

- Use the search bar and [node selectors](/reference/node-selection/syntax) to filter your dag.
- [Lenses](/docs/collaborate/explore-projects#lenses) make it easier to understand your project’s contextual metadata at scales, especially to distinguish a particular model or a subset of models.
- When you apply a lens, tags become visible on the nodes in the lineage graph, indicating the layer value along with coloration based on that value

<Lightbox src="/img/quickstarts/dbt-cloud/dbt_explorer_dag.png" title="dbt Explorer's lineage graph" />

- Use the [advanced search](/docs/collaborate/explore-projects#search-resources) feature to locate resources in your project. Perform hard searches and key word searches. All resource names, column names, resources descriptions, warehouse relations, and code matching your search criteria will appear in the center of the page. Apply filters to fully refine your search
- When searching for a column name, the results show all relational nodes containing htat column in their schemas.

<Lightbox src="/img/quickstarts/dbt-cloud/dbt_explorer_advanced_search.png" title="dbt Explorer's advanced search feature" />

#### Hands-On
- On the left hand side, Click on the company and make sure you are in the section “overview of Project Details → Next to Overview → View Lineage
- Pick a Mart Model → Select Everything downstream
- Which models depend on models from another project?
- Click on the other Projects lineage
- Explore lenses – Explore table materializations clustered in current Project
- Which are the biggest view clusters?
- Explore different lenses (Model Layer, Test Status, Resource)
- Drill down on a node→ Explore the Column Lineage and its Evolution
- Expand each columns full lineage


## Mutli-Project
Use dbt Explorer to gain a deeper understanding of *all* of you dbt Cloud projects with it's [multi-project capabilities](/docs/collaborate/explore-multiple-projects).
- See the number of public models, protected models, private models, and metrics in each project.
- View cross-project lineage and navigate between individual projects’ lineage graphs
- View cross-project column-level lineage

#### Hands-On
- See which models in the platform project are public and being referenced by another project.
- Swap between two projects’ lineages. Explore the assets provided.
- What sources can we see?
- Use multi-project column level lineage to find a column that exists in models in multiple projects.

## Project Recommendations
The [project recommendations](/docs/collaborate/project-recommendations) page suggests project improvements and provides insight into how you can create a better-documented, better-tested, and better-built dbt project, creating more trust and less confusion.
Learn more about what sort of suggestions it makes and why on our [docs site](/docs/collaborate/project-recommendations).

<Lightbox src="/img/quickstarts/dbt-cloud/dbt_explorer_project_recs.png" title="dbt Explorer's project recommendation tab" />

#### Hands-On
- Read through the project recommendations. Select one improvement to make and make it! (Ex: Add a description to a primary key that lacks one)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading