Skip to content

Commit

Permalink
Working on sparklyr logo showing up properly
Browse files Browse the repository at this point in the history
  • Loading branch information
mine-cetinkaya-rundel committed May 31, 2024
1 parent 49c797d commit 305ec44
Show file tree
Hide file tree
Showing 7 changed files with 23 additions and 475 deletions.
4 changes: 2 additions & 2 deletions _freeze/html/sparklyr/execute-results/html.json

Large diffs are not rendered by default.

File renamed without changes
File renamed without changes
File renamed without changes
11 changes: 6 additions & 5 deletions html/sparklyr.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -15,16 +15,15 @@ execute:
source("common.R")
use_cheatsheet_logo(
"sparklyr",
alt = "Hex logo for sparklyr - Neon shooting stars of various shapes and sizes flying across a black and grey background.")
alt = "Hex logo for sparklyr - Neon shooting stars of various shapes and sizes flying across a black and grey background."
)
sheet_name <- tools::file_path_sans_ext(knitr::current_input())
pdf_preview_link(sheet_name)
translation_list(sheet_name)
```

<!-- Page 1 -->

![](images/sparklyr-ds-workflow.png)

# Connect

## Databricks Connect (v2)
Expand Down Expand Up @@ -142,9 +141,11 @@ sc <- spark_connect(master="local")

**Qubole** - `spark_connect(method = "qubole")`

![](images/spark-ds-workflow.png){fig-align="center"}

# Import

![](images/sparklyr-import.png){fig-alt="R push complete to Spark back to R collecting results. Also import from Source to Spark." fig-align="center" width="501"}
![](images/spark-import.png){fig-alt="R push complete to Spark back to R collecting results. Also import from Source to Spark." fig-align="center" width="501"}

Import data into Spark, not R

Expand Down Expand Up @@ -349,7 +350,7 @@ Supported in Databricks Connect v2
- `ml_save()` - Saves into a format that can be read by Scala and PySpark.
- `ml_read()` - Reads Spark object into sparklyr.

![](images/sparklyr-save-retrieve.png){fig-alt="ml_pipeline() to ft_dplyr_transformer to ft_bucketizer() to ml_linear_regression() to ml_fit() to ml_save()." fig-align="center" width="501"}
![](images/spark-save-retrieve.png){fig-alt="ml_pipeline() to ft_dplyr_transformer to ft_bucketizer() to ml_linear_regression() to ml_fit() to ml_save()." fig-align="center" width="501"}

[spark.posit.co/guides/pipelines](https://spark.posit.co/guides/pipelines)

Expand Down
Loading

0 comments on commit 305ec44

Please sign in to comment.