TFX is an end-to-end platform for deploying production ML pipelines
-
Updated
Dec 24, 2024 - Python
#
apache-beam
Here are 263 public repositories matching this topic...
Cloud Dataflow Google-provided templates for solving in-Cloud data tasks
bigquery google-cloud-storage google-cloud-dataflow apache-beam bigtable google-cloud-spanner dataflow-templates
-
Updated
Dec 24, 2024 - Java
Yet Another UserAgent Analyzer
java parse user-agent hive snowplow user-agent-parser snowflake analyzer apache-beam apache-flink user-agent-analysis flink nifi-processors client-hints snowplowanalytics useragentparser apache-hive nifi-processor useragent-parser trino-plugin
-
Updated
Dec 23, 2024 - Java
[DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
kubernetes operator apache-beam apache-flink kubernetes-operator google-cloud-dataproc flink-operator
-
Updated
Sep 2, 2022 - Go
ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
crypto bitcoin etl gcp cryptocurrency data-engineering dash data-analytics apache-beam web3 zcash litecoin dogecoin google-dataflow google-pubsub bitcoincash blockchain-analytics on-chain-analysis
-
Updated
Apr 5, 2024 - Python
Tools to make weather data accessible and useful.
-
Updated
Dec 3, 2024 - Python
Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
-
Updated
Dec 24, 2024 - Go
TFRecorder makes it easy to create TensorFlow records (TFRecords) from Pandas DataFrames and CSVs files containing images or structured data.
-
Updated
May 26, 2022 - Python
A collection of tools for extracting FHIR resources and analytics services on top of that data.
-
Updated
Dec 23, 2024 - Java
Clojure API for a more dynamic Google Dataflow
-
Updated
Dec 6, 2024 - Clojure
Collection of transforms for the Apache beam python SDK.
-
Updated
Dec 7, 2023 - Python
Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes
real-time crypto bitcoin etl ethereum blockchain gcp cryptocurrency stream-processing data-engineering data-analytics apache-beam web3 google-cloud-platform google-bigquery real-time-analytics google-dataflow google-pubsub blockchain-analytics on-chain-analysis
-
Updated
Dec 9, 2021 - Python
Asgarde allows simplifying error handling with Apache Beam Java, with less code, more concise and expressive code.
-
Updated
Jul 23, 2024 - Java
Repository to quickly get you started with new Machine Learning projects on Google Cloud Platform. More info(slides):
-
Updated
Oct 27, 2018 - Python
Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow
-
Updated
Oct 12, 2020 - Java
Microservices in Post-Kubernetes Era. A polyglot monorepo
kotlin jenkins microservice monorepo semantic-versioning semantic-release apache-beam gitflow conventional-changelog gitflow-workflow sprintboot gradle-kotlin-dsl conventional-commits gitops micronaut quarkusio
-
Updated
Dec 8, 2023 - Kotlin
Some class materials for a data processing course using PySpark
-
Updated
Dec 3, 2022 - Python
Blockchain ETL Architecture
kubernetes crypto etl ethereum blockchain gcp google-cloud cryptocurrency data-engineering data-analytics gke apache-beam google-cloud-platform google-bigquery real-time-analytics google-dataflow google-pubsub google-container-engine blockchain-analytics on-chain-analysis
-
Updated
Oct 10, 2022
Opinionated serverless event analytics pipeline
-
Updated
Apr 14, 2023 - Go
Improve this page
Add a description, image, and links to the apache-beam topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the apache-beam topic, visit your repo's landing page and select "manage topics."