Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

Jupyter magics and kernels for working with remote Spark clusters

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

R interface for Apache Spark

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

Spark on Kubernetes infrastructure Helm charts repo

REST API for Apache Spark on K8S or YARN

A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator

Spark on Kubernetes infrastructure Docker images repo

Loan Default Prediction using PySpark, with jobs scheduled by Apache Airflow and Integration with Spark using Apache Livy

Livy Manager - Web UI for Managing Apache Livy Sessions

Experiments produced during an end of studies project (ETS, H2018)

Mirror of Apache livy (Incubating)

C# Livy client to submit Spark jobs to HDInsight and other Spark clusters

Apache Livy server for Docker

HDInsight provider for Airflow

Experiment to get LIVY+ Apache Spark working on DC/OS + MESOS + Docker

An airflow DAG transformation framework

Apache Livy client for the Go programming language.

.net wrapper for Livy