mirror of
https://github.com/fluencelabs/rust-libp2p
synced 2025-05-01 21:52:16 +00:00
* Create gossipsub crate - Basic template, borrowed from floodsub * Add a GossipsubConfig struct and set up basic structures in the Gossipsub struct * Begin implementation of join. Adds get_random_peers helper function and adds tests * Implements gossipsub leave() * Update publishMany to incorporate gossipsub mesh and fanout logic * Use the gossipsub mesh for determining peer subscription * Remove subscribed_topics field from the Gossipsub struct * Rename gossipsubconfig to ProtocolConfig * Implement the gossipsub control messages into the Codec's Encode/Decode and modifies GossipsubRpc * Modify GossipsubActions to enums for succinctness. * Modify the memcache to store Gossipsub messages * Implement control message handling. * Update control message handling to handle multiple messages. * Handle received gossipsub messages using pre-built handlers. * Remove excess connected peer hashmap * Add extra peer mapping and consistent topic naming. * Implement heartbeat, emit_gossip and send_graft_prune. * Group logic in forwarding messages. Add messages to memcache. * Add heartbeat timer and move location of helper function. * Add gossipsub the libp2p workspace, makes layer structs public * Add logging to gossipsub - Adds the log crate and implements logging macros - Specifies versions for external crates * Add example chat for debugging purposes * Implement #868 for gossipsub. * Add rust documentation to gossipsub crate. - Adds basic documentation, overview and examples to the gossipsub crate. * Re-introduce the initial heartbeat time config. This commit also adds the inject_connected test. * Add subscribe tests. - Modifies `handle_received_subscriptions` to take a reference of subscriptions - Adds `test_subscribe` - Adds `test_handle_received_subscriptions` - Adds tests for the filter in `get_random_peers` * Add Bug fixes and further testing for gossipsub. - Corrects the tuple use of topic_hashes - Corrects JOIN logic around fanout and adding peers to the mesh - Adds test_unsubscribe - Adds test_join * Rename GossipsubMessage::msg_id -> id * Add bug fix for handling disconnected peers. * Implements (partially) #889 for Gossipsub. * handle_iwant event count tests * handle_ihave event count tests * Move layer.rs tests into separate file. * Implement clippy suggestions for gossipsub. * Modify control message tests for specific types. * Implement builder pattern for GossipsubConfig. As suggested by @twittner - The builder pattern for building GossipsubConfig struct is implemented. * Package version updates as suggested by @twittner. * Correct line lengths in gossipsub. * Correct braces in found by @twittner. * Implement @twittner's suggestions. - Uses `HashSet` where applicable - Update `FnvHashMap` to standard `HashMap` - Uses `min` function in code simplification. * Add NodeList struct to clarify topic_peers. * Cleaner handling of messagelist Co-Authored-By: AgeManning <Age@AgeManning.com> * Cleaner handling of added peers. Co-Authored-By: AgeManning <Age@AgeManning.com> * handle_prune peer removed test * basic grafting tests * multiple topic grafting test * Convert &vec to slice. Co-Authored-By: AgeManning <Age@AgeManning.com> * Convert to lazy insert. Co-Authored-By: AgeManning <Age@AgeManning.com> * Cleaner topic handling. Co-Authored-By: AgeManning <Age@AgeManning.com> * control pool piggybacking using HashMap.drain() in control_pool_flush going to squash this * Add Debug derives to gossipsub and correct tests. * changes from PR squash this all tests passing, but still some that need to be reconsidered test reform * Implements Arc for GossipsubRpc events * Remove support for floodsub nodes * Reconnected to disconnected peers, to mitigate timeout * Use ReadOne WriteOne with configurable max gossip sizes * Remove length delimination from RPC encoding * Prevent peer duplication in mesh * Allow oneshot handler's inactivity_timeout to be configurable * Correct peer duplication in mesh bug * Remove auto-reconnect to allow for user-level disconnects * Single long-lived inbound/outbound streams to match go implementation * Allow gossipsub topics to be optionally hashable * Improves gossipsub stream handling - Corrects the handler's keep alive. - Correct the chat example. - Instantly add peers to the mesh on subscription if the mesh is low. * Allows message validation in gossipsub * Replaces Cuckoofilter with LRUCache The false positive rate was unacceptable for rejecting messages. * Renames configuration parameter and corrects logic * Removes peer from fanout on disconnection * Add publish and fanout tests * Apply @mxinden suggestions * Resend message if outbound stream negotiated - Downgrades log warnings * Implement further reviewer suggestions - Created associated functions to avoid unnecessary cloning - Messages are rejected if their sequence numbers are not u64 - `GossipsbuConfigBuilder` has the same defaults as `GossipsubConfig` - Miscellaneous typos * Add MessageId type and remove unnecessary comments * Add a return value to propagate_message function * Adds user-customised gossipsub message ids * Adds the message id to GossipsubEvent * Implement Debug for GossipsubConfig * protocols/gossipsub: Add basic smoke test Implement a basic smoke test that: 1. Builds a fully connected graph of size N. 2. Subscribes each node to the same topic. 3. Publishes a single message. 4. Waits for all nodes to receive the above message. N and the structure of the graph are reproducibly randomized via Quickcheck. * Corrections pointed out by @mxinden * Add option to remove source id publishing * protocols/gossipsub/tests/smoke: Remove unused variable * Merge latest master * protocols/gossipsub: Move to stable futures * examples/gossipsub-chat.rs: Move to stable futures * protocols/gossipsub/src/behaviour/tests: Update to stable futures * protocols/gossipsub/tests: Update to stable futures * protocols/gossipsub: Log substream errors * protocols/gossipsub: Log outbound substream errors * Remove rust-fmt formatting * Shift to prost for protobuf compiling * Use wasm_timer for wasm compatibility Co-authored-by: Grant Wuerker <gwuerker@gmail.com> Co-authored-by: Toralf Wittner <tw@dtex.org> Co-authored-by: Pawan Dhananjay <pawandhananjay@gmail.com> Co-authored-by: Max Inden <mail@max-inden.de> Co-authored-by: Pierre Krieger <pierre.krieger1708@gmail.com>
155 lines
6.0 KiB
Rust
155 lines
6.0 KiB
Rust
// Copyright 2018 Parity Technologies (UK) Ltd.
|
|
//
|
|
// Permission is hereby granted, free of charge, to any person obtaining a
|
|
// copy of this software and associated documentation files (the "Software"),
|
|
// to deal in the Software without restriction, including without limitation
|
|
// the rights to use, copy, modify, merge, publish, distribute, sublicense,
|
|
// and/or sell copies of the Software, and to permit persons to whom the
|
|
// Software is furnished to do so, subject to the following conditions:
|
|
//
|
|
// The above copyright notice and this permission notice shall be included in
|
|
// all copies or substantial portions of the Software.
|
|
//
|
|
// THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS
|
|
// OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
|
// FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
|
// AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
|
// LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
|
|
// FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
|
|
// DEALINGS IN THE SOFTWARE.
|
|
|
|
//! A basic chat application with logs demonstrating libp2p and the gossipsub protocol.
|
|
//!
|
|
//! Using two terminal windows, start two instances. Type a message in either terminal and hit return: the
|
|
//! message is sent and printed in the other terminal. Close with Ctrl-c.
|
|
//!
|
|
//! You can of course open more terminal windows and add more participants.
|
|
//! Dialing any of the other peers will propagate the new participant to all
|
|
//! chat members and everyone will receive all messages.
|
|
//!
|
|
//! In order to get the nodes to connect, take note of the listening address of the first
|
|
//! instance and start the second with this address as the first argument. In the first terminal
|
|
//! window, run:
|
|
//!
|
|
//! ```sh
|
|
//! cargo run --example chat
|
|
//! ```
|
|
//!
|
|
//! It will print the PeerId and the listening address, e.g. `Listening on
|
|
//! "/ip4/0.0.0.0/tcp/24915"`
|
|
//!
|
|
//! In the second terminal window, start a new instance of the example with:
|
|
//!
|
|
//! ```sh
|
|
//! cargo run --example chat -- /ip4/127.0.0.1/tcp/24915
|
|
//! ```
|
|
//!
|
|
//! The two nodes should then connect.
|
|
|
|
use async_std::{io, task};
|
|
use env_logger::{Builder, Env};
|
|
use futures::prelude::*;
|
|
use libp2p::gossipsub::protocol::MessageId;
|
|
use libp2p::gossipsub::{GossipsubEvent, GossipsubMessage, Topic};
|
|
use libp2p::{
|
|
gossipsub, identity,
|
|
PeerId,
|
|
};
|
|
use std::collections::hash_map::DefaultHasher;
|
|
use std::hash::{Hash, Hasher};
|
|
use std::time::Duration;
|
|
use std::{error::Error, task::{Context, Poll}};
|
|
|
|
fn main() -> Result<(), Box<dyn Error>> {
|
|
Builder::from_env(Env::default().default_filter_or("info")).init();
|
|
|
|
// Create a random PeerId
|
|
let local_key = identity::Keypair::generate_ed25519();
|
|
let local_peer_id = PeerId::from(local_key.public());
|
|
println!("Local peer id: {:?}", local_peer_id);
|
|
|
|
// Set up an encrypted TCP Transport over the Mplex and Yamux protocols
|
|
let transport = libp2p::build_development_transport(local_key)?;
|
|
|
|
// Create a Gossipsub topic
|
|
let topic = Topic::new("test-net".into());
|
|
|
|
// Create a Swarm to manage peers and events
|
|
let mut swarm = {
|
|
// to set default parameters for gossipsub use:
|
|
// let gossipsub_config = gossipsub::GossipsubConfig::default();
|
|
|
|
// To content-address message, we can take the hash of message and use it as an ID.
|
|
let message_id_fn = |message: &GossipsubMessage| {
|
|
let mut s = DefaultHasher::new();
|
|
message.data.hash(&mut s);
|
|
MessageId(s.finish().to_string())
|
|
};
|
|
|
|
// set custom gossipsub
|
|
let gossipsub_config = gossipsub::GossipsubConfigBuilder::new()
|
|
.heartbeat_interval(Duration::from_secs(10))
|
|
.message_id_fn(message_id_fn) // content-address messages. No two messages of the
|
|
//same content will be propagated.
|
|
.build();
|
|
// build a gossipsub network behaviour
|
|
let mut gossipsub = gossipsub::Gossipsub::new(local_peer_id.clone(), gossipsub_config);
|
|
gossipsub.subscribe(topic.clone());
|
|
libp2p::Swarm::new(transport, gossipsub, local_peer_id)
|
|
};
|
|
|
|
// Listen on all interfaces and whatever port the OS assigns
|
|
libp2p::Swarm::listen_on(&mut swarm, "/ip4/0.0.0.0/tcp/0".parse().unwrap()).unwrap();
|
|
|
|
// Reach out to another node if specified
|
|
if let Some(to_dial) = std::env::args().nth(1) {
|
|
let dialing = to_dial.clone();
|
|
match to_dial.parse() {
|
|
Ok(to_dial) => match libp2p::Swarm::dial_addr(&mut swarm, to_dial) {
|
|
Ok(_) => println!("Dialed {:?}", dialing),
|
|
Err(e) => println!("Dial {:?} failed: {:?}", dialing, e),
|
|
},
|
|
Err(err) => println!("Failed to parse address to dial: {:?}", err),
|
|
}
|
|
}
|
|
|
|
// Read full lines from stdin
|
|
let mut stdin = io::BufReader::new(io::stdin()).lines();
|
|
|
|
// Kick it off
|
|
let mut listening = false;
|
|
task::block_on(future::poll_fn(move |cx: &mut Context| {
|
|
loop {
|
|
match stdin.try_poll_next_unpin(cx)? {
|
|
Poll::Ready(Some(line)) => swarm.publish(&topic, line.as_bytes()),
|
|
Poll::Ready(None) => panic!("Stdin closed"),
|
|
Poll::Pending => break,
|
|
};
|
|
}
|
|
|
|
loop {
|
|
match swarm.poll_next_unpin(cx) {
|
|
Poll::Ready(Some(gossip_event)) => match gossip_event {
|
|
GossipsubEvent::Message(peer_id, id, message) => println!(
|
|
"Got message: {} with id: {} from peer: {:?}",
|
|
String::from_utf8_lossy(&message.data),
|
|
id,
|
|
peer_id
|
|
),
|
|
_ => {}
|
|
},
|
|
Poll::Ready(None) | Poll::Pending => break,
|
|
}
|
|
}
|
|
|
|
if !listening {
|
|
for addr in libp2p::Swarm::listeners(&swarm) {
|
|
println!("Listening on {:?}", addr);
|
|
listening = true;
|
|
}
|
|
}
|
|
|
|
Poll::Pending
|
|
}))
|
|
}
|