All notable changes to this project will be documented in this file.
- Alerting:
- Use Gremlin expression for alerts on both graph and flows
- Allow writing alerts in JavaScript
- Alerts can now execute scripts and trigger Webhooks
- New Grafana plugin (https://github.com/skydive-project/skydive-grafana-datasource)
- New OpenShift template
- Gremlin:
- Add 'Aggregates' step
- Allow sorting and deduplicating against a property
- Topology:
- Handle IP adding / removal on interfaces
- Add peering probe which creates a link based on MAC addresses
- Flows:
- Support Geneve tunneling
- Add Layer 3 tracking ID
- Add support for Ethernet and IP over MPLS
- Neutron:
- Adding Neutron attributed IPs to nodes
- Add metadata on Neutron managed namespaces
- WebUI:
- Keep position of nodes in local storage across browser refresh
- Flows:
- Use persistent ID in flows to handle agent restarts
- Topology:
- Remove unsupported titan and gremlin backends
- Gremlin:
- Convert 'Bandwidth' step to 'Metrics' and 'Sum'
- Flows:
- Add packet injector to generate traffic between two interfaces
- Support Geneve tunneling
- Add support for MPLS over both UDP and GRE
- Add sFlow tunneling support
- Add 'Application' metadata that contains the last layer type
- Gremlin:
- New 'Metrics' Gremlin step to get all the metrics associated to a set of flows
- New 'Values' step which returns values of a property: ex: G.V().Values('Name')
- New 'Sum' step that returns aggregation over named node property: ex: G.Flows().Sum('Metric.ABBytes')
- New 'Regex' predicated to use regular expression when querying graph and flows
- New 'At' alias for 'Context' and allow more user friendly time definition ex: g.At('-5m').V()
- New 'Within' filter for flows
- New 'Since' predicate to select flows
- New 'CaptureNode' step to get the capture nodes of a set of flows
- OpenStack:
- Add support for Keystone V3
- Autodetect Skydive agent running inside a virtual machine
- WebUI:
- Add packet injector tab
- Add support for zoom-in zoom-out and reset
- Add the "famous" "mmmgnmm bob effect"
- Misc:
- Experimental support for TLS communication between agents and analyzer
- Vagrantfile to bootstrap a 3 nodes setup
- Flows:
- Manage captures from the analyzer to handle use case like setting capture point on all the interfaces between two nodes
- Simplify packet processing and remove timeout mechanisms at the probe level
- Correct packet length for outer/inner packets in tunnels
- Topology:
- Move 'fabric' probe onto the analyzer and add a WebSocket API
- WebUI:
- Update timeslider to use delta instead of date
- Restore discovery and conversation views
- Fix node selection issue after agent Resync
- Bugs fixes:
- Many bugfixes around network namespaces that caused Goroutines to run in the wrong namespace that resulted in flow captures and packet injection errors
- Fix leak of namespace fd in docker probe
- Build:
- Do not integrate generated file anymore
- Flows:
- Encapsulation support (VXLAN, GRE)
- IPv6 support
- Gremlin:
- Add 'Sort' step to sort flows by uptime time
- Add 'Nodes' step to get capture, source and destination nodes
- Topology:
- Add cache for gremlin, titangraph and orientdb backends
- Add OpenContrail probe
- WebUI:
- Use shortest path to create captures
- Support for tunneling
- Client:
- Add an 'allinone' command
- Add a 'shell' command
- Documentation:
- Add quick start and contributing sections to README.md
- Add rest, flow schema section and some fixes
- Flows:
- Reworked flow structurem to simplify exploitation and storage
- Use ANode, BNode, Node instead of old name for flows
- Gremlin:
- Optimize Dedup step for flows
- Ensure error is passed for every step
- WebUI:
- Replace flow jsonview by a flow grid table
- Change node selection behaviour
- Docker:
- Use scratch as Docker base image
- Add missing configuration file for Docker image
- OpenStack:
- Add availability configuration variable
- Retrieve metadatas when port metadatas are updated
- Bugs fixes:
- Properly handle default values in configuration
- Fix fd leak when using http clients
- Stop timer of gopacket
- Fix frozen agent when a flow query was used while when stopping flow table
- Use elasticsearch as a time series database
- Add elasticsearch graph backend
- New node ID that persists between agent restart
- New afpacket capture type
- New 'fabric' probe to register external equipment like Top Of Rack switches
- Gremlin improvements:
- Add 'Range' and 'Limit' Gremlin steps
- Add 'Hops' step to get the nodes traversed by a set of flows
- Add architecture section to the documentation
- Add devstack functional testing
- Skydive binary is linked statically with pcap
- Renamed 'pcap' probe to 'gopacket'
- Web UI improvements:
- Clearer representation using groups of nodes
- Node pinning
- Highlight traversed nodes in Web UI
- Bug fixes:
- Wait for analyzer before starting agent
- Avoid capture create with duplicate gremlin request (both thanks to Konstantin Dorfman)
- Fix shortestPath and add a test to illustrate the bug (thanks to Antoine Eiche)
- Limit neutron API calls (thanks to Jean-Philippe Braun)
- Use authenticated request while waiting for the analyzer (thanks to Mathieu Rohon)
- Gremlin improvements:
- Allow filtering flows in Gremlin query
- Add bandwidth calculation
- New steps: Count, Both
- New predicates: Lt, Gt, Lte, Gte, Between, Inside, Outside
- Scaling improvements
- Use protobuf instead of JSON for analyzer - agent communications
- Switch Docker image to Ubuntu
- Improved release pipeline (executables, Docker image)