Varadhi is the open source version of a similar FK internal project, a message bus implementation with a REST interface. Varadhi supports both P2P (point-to-point) and Publish-Subscribe messaging models. The idea behind RESTBus is to take your HTTP API stack and automatically transform them into service bus driven, queue/pub-sub, message oriented endpoints. The communication between Varadhi and endpoints will be on HTTP.
Varadhi is in active development and has been in production since last 10 years inside Flipkart as the backbone of async REST communication between various microservices sending billions of messages daily.
With Varadhi we hope others would be able to benefit from our learnings of a decade.
See the Wiki for concepts, use cases, architecture details, API spec and other detailed information.
Give it a go locally on your machine. You will require java 21, docker & python. Follow this guide: Wiki/Try Locally
./gradlew build test./gradlew copyDependencies copyConfigForE2E -x test
docker build . --file setup/docker/Dockerfile --tag varadhi.docker.registry/varadhi:latest --build-arg
docker compose --profile test -f setup/docker/compose.yml up -d --wait --wait-timeout 180
./gradlew testE2ETo provide the required functionality, Varadhi takes dependency on various tech stack.
Run the following to start the below dependencies.
docker compose --profile dev -f setup/docker/compose.yml up -d --wait --wait-timeout 180
OR
Varadhi needs a message broker for message persistence and delivery. Apache Pulsar is used as underlying message broker. For the development environment users can use containerised Pulsar in a standalone mode. Details can be found here.
For storing metadata about various Varadhi entities, a datastore is needed. Zookeeper is used as global datastore to persist json formatted entities. For the development environment, containerised Zookeeper can be used in a standalone mode. Details can be found here.
Finally, to run the Varadhi server, provide the custom zk & pulsar endpoints at server/src/main/resources/config.overrides and then do
./gradlew run
If you are using the dev profile in our docker compose to start the zk and pulsar, then simply do ./gradlew run. No config overrides are required.
cd setup/helm/varadhi
helm install varadhi-server . -f values/common.values.yaml -f values/local.server.values.yaml
helm install varadhi-controller . -f values/common.values.yaml -f values/local.controller.values.yaml- entities: It has all the entities used by the spi module and varadhi apis.
- spi: It has all the interfaces related to persistence and messaging.
- pulsar: It contains messaging-spi implementation using Apache Pulsar.
- core: It contains all the core logic of
Varadhiand is relied upon by various other sub-modules. - server: It is the entry point of
Varadhi. It houses all server related logic and binds together all other modules.
[ TBD ]
Status: Initial Review Completed.
See the Wiki page Roadmap for details.
[ TBD ]
Refer to Contributing.
You can also reachout to sahil.chachan@flipkart.com or k.dhruv@flipkart.com.
[ TBD ]
Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0