Summary

knots aims to be a multi-node S3 benchmark and load generator written in Rust and on top of WebAssembly, waPC, and waSCC.

Goal for this Hackweek

My goal for HackWeek is to have a prototype actor that can at least run a few GET/PUT requests against a single bucket and tells me how long that took.

Collaboration

Since this is a training wheels exercise for me on multiple fronts (Rust, and the entire WASM/waPC/waSCC world), I'm not actively looking for other contributors yet. I don't learn as much if someone else does the work, and I have precisely zero experience with any of the technologies involved except S3 ;-)

But if you have experience, I don't mind chatting!

Especially if your project maybe includes a krustlet/waSCC ops environment to try and deploy the actor on.

I just want an S3 benchmark, now

I recommend you take a look at these:

  • fio is an excellent C tool for benchmarking all sorts of data IO mechanisms, and is very useful for comparing protocols. I contributed a simple S3 module to it a while ago. If your primary interest is data throughput and latency, fio is your tool of choice.
  • MinIO warp is a versatile tool written in Go for benchmarking various aspects of S3 and probably the most mature choice.
  • cosbench is a very well-known tool for benchmarking S3 written in Java.

Looking for hackers with the skills:

s3 wasm wascc wasi ceph krustlet rust containerless

This project is part of:

Hack Week 20

Activity

  • about 1 month ago: jluis liked this project.
  • about 1 month ago: LarsMB liked this project.
  • about 1 month ago: LarsMB added keyword "containerless" to this project.
  • about 1 month ago: LarsMB started this project.
  • about 1 month ago: LarsMB added keyword "ceph" to this project.
  • about 1 month ago: LarsMB added keyword "krustlet" to this project.
  • about 1 month ago: LarsMB added keyword "rust" to this project.
  • about 1 month ago: LarsMB added keyword "s3" to this project.
  • about 1 month ago: LarsMB added keyword "wasm" to this project.
  • about 1 month ago: LarsMB added keyword "wascc" to this project.
  • All Activity

    Comments

    Be the first to comment!

    Similar Projects

    WASM Serverless by davidko

    Project Description

    Support WASM serverle...


    Sharing logic between desktop and web based applications through WASM by IGonzalezSosa

    Project Description

    A few months ago, the...


    WASM Serverless by davidko

    Project Description

    Support WASM serverle...


    Developing an opinionated storage appliance by asettle

    [comment]: # (Please use the project descriptio...


    k8s-rook-client by haass

    [comment]: # (Please use the project descriptio...


    Velcro demuxing software management by zbenjamin

    [comment]: # (Please use the project descriptio...


    Kanidm - A modern opensource IDM by firstyear

    Project Description

    Kanidm is a modern, fas...


    Sharing logic between desktop and web based applications through WASM by IGonzalezSosa

    Project Description

    A few months ago, the...


    Write an url shortener in Rust (And learn in the way) by szarate

    So I have 469.icu :), it's currently doing noth...


    Semi-automated XMLRPC based tool for uyuni testing written in Rust language by lkotek

    [comment]: # (Please use the project descriptio...