Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Did some benchmarks, not too bad.

  Benchmark finished! block-size: 4.0 MiB, big-object-size: 1.0 GiB, small-object-size: 128 KiB, small-objects: 100, NumThreads: 6
  +--------------------+--------------------+------------------+
  |        ITEM        |        VALUE       |       COST       |
  +--------------------+--------------------+------------------+
  |     upload objects |       207.02 MiB/s | 115.93 ms/object |
  |   download objects |       405.78 MiB/s |  59.14 ms/object |
  |  put small objects |    278.4 objects/s |  21.55 ms/object |
  |  get small objects |    498.5 objects/s |  12.04 ms/object |
  |       list objects | 40977.06 objects/s |      14.64 ms/op |
  |       head objects |   1995.4 objects/s |   3.01 ms/object |
  |     delete objects |    312.1 objects/s |  19.22 ms/object |
  | change permissions |        not support |      not support |
  | change owner/group |        not support |      not support |
  |       update mtime |        not support |      not support |
  +--------------------+--------------------+------------------+
Currently have a project using OVH, which is slower, but than I guess there's currently less load on Hetzner.

  Benchmark finished! block-size: 4.0 MiB, big-object-size: 1.0 GiB, small-object-size: 128 KiB, small-objects: 100, NumThreads: 6
  +--------------------+-------------------+------------------+
  |        ITEM        |       VALUE       |       COST       |
  +--------------------+-------------------+------------------+
  |     upload objects |       80.82 MiB/s | 296.94 ms/object |
  |   download objects |      274.61 MiB/s |  87.40 ms/object |
  |  put small objects |    31.6 objects/s | 189.98 ms/object |
  |  get small objects |   145.1 objects/s |  41.36 ms/object |
  |       list objects | 6293.39 objects/s |      95.34 ms/op |
  |       head objects |   177.7 objects/s |  33.76 ms/object |
  |     delete objects |   136.6 objects/s |  43.93 ms/object |
  | change permissions |       not support |      not support |
  | change owner/group |       not support |      not support |
  |       update mtime |       not support |      not support |
  +--------------------+-------------------+------------------+


For comparison, here are the results for Scaleway Object Storage (https://www.scaleway.com/en/object-storage/), competing offer from another european S3 provider:

  +--------------------+-------------------+------------------+
  |        ITEM        |       VALUE       |       COST       |
  +--------------------+-------------------+------------------+
  |     upload objects |       16.72 MiB/s | 956.98 ms/object |
  |   download objects |      109.01 MiB/s | 146.78 ms/object |
  |  put small objects |    15.3 objects/s | 261.99 ms/object |
  |  get small objects |    88.8 objects/s |  45.05 ms/object |
  |       list objects | 6115.93 objects/s |      65.40 ms/op |
  |       head objects |   164.3 objects/s |  24.34 ms/object |
  |     delete objects |   157.9 objects/s |  25.33 ms/object |
  | change permissions |       not support |      not support |
  | change owner/group |       not support |      not support |
  |       update mtime |       not support |      not support |
  +--------------------+-------------------+------------------+


Scaleway Paris is famously slow, used it before and it easily became the bottleneck of an application. Try the Amsterdam buckets.


what tool are you using for this wonderful data?


Searched for "Benchmark finished! block-size" and seems to be https://github.com/juicedata/juicefs?tab=readme-ov-file#perf...


Looks like juicefs objbench. https://juicefs.com/docs/community/performance_evaluation_gu...


Yes, it's juicefs objbench.

Wonderful tool. Useful for figuring out where some of these cheaper S3 alternatives make their cuts.


missed opportunity to call it JuiceFS' OJBench


seriously, with an opportunity like that it ABSOLUTELY does not matter if your acronym matches. They must now suffer publicly, forever, for we know where their unpoetic hearts lie.


Which OVH storage class were you using? Theres a slow (io) and a fast (highperf) one.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: