Commit Graph

227 Commits (4ffcca8559ee3c68c110cc9d725abe3b1a0183de)

Author SHA1 Message Date
_ e8e733046c 📝 docs: trying to figure how I can keep the client stream open 2021-04-27 22:36:44 -05:00
_ 3240ad72b2 ♻️ refactor: error handling 2021-04-27 21:39:42 -05:00
_ 33d07c45a8 ♻️ refactor: use `tokio::time::timeout` 2021-04-27 20:15:21 -05:00
_ a661ce02ea ♻️ refactor: extract park_client function 2021-04-27 20:10:32 -05:00
_ 6990be48d6 add config for relay listen address
this will make it easier to run on Wireguard or LANs or whatever
2021-04-27 18:48:22 -05:00
_ 522cbc5991 add server count and current time to server list page 2021-04-27 18:12:37 -05:00
_ 5ebdbaa225 🚧 wip: machine-editable config 2021-04-27 17:22:07 -05:00
_ c361ecd806 ♻️ refactor: extract builder for Relay 2021-04-27 15:05:27 -05:00
_ cfc2228491 add relay builder 2021-04-27 14:55:08 -05:00
_ 7c9238527f tests: add test for serializing tripcodes 2021-04-27 14:36:05 -05:00
_ 8f334f57a3 add serialize for server config structs 2021-04-27 14:31:58 -05:00
_ 4a73f48c68 tests: fix tests 2021-04-27 14:31:32 -05:00
_ b659d6b74f add "news" URL to server list page 2021-04-27 14:10:11 -05:00
_ 9eb470963c make an error transparent so it's more meaningful 2021-04-18 13:51:27 -05:00
_ d001d9efe5 📝 docs: add README to `ptth_relay` before publishing 2021-04-18 13:06:01 -05:00
_ 2c4d46388a 📝 docs: update README before publishing to crates.io 2021-04-18 12:56:36 -05:00
_ c3858ec8bf 📝 docs: fix code highlighting in docs, patch bump 2021-04-18 12:41:16 -05:00
_ 27b75fe424 📝 docs: update README for bottom crates 2021-04-18 12:37:37 -05:00
_ 67975d9b11 📝 docs: done with ptth_relay for now 2021-04-18 08:51:36 -05:00
_ c75448fe2c ♻️ refactor: remove un-needed muts 2021-04-18 08:33:07 -05:00
_ 146c91f2be ♻️ refactor: rename `RelayState` to `Relay` and privatize `load_templates` 2021-04-18 08:28:07 -05:00
_ c6f651387e ♻️ refactor: make `load_templates` private 2021-04-17 20:50:48 -05:00
_ ae4f102bdf ♻️ refactor: make git_version module private 2021-04-17 19:26:05 -05:00
_ fd238d8c2b ♻️ refactor: rename file_server::State to file_server::FileServer 2021-04-17 19:10:52 -05:00
_ ae33337156 ♻️ refactor: clean up ptth_server
- Found I was passing the file server root twice
- Removed handlebars from the public API. The templates are fixed
when ptth_server ships, so I don't think users of the lib should
care what handlebars is.
- Making other stuff private where possible
2021-04-17 18:59:59 -05:00
_ 86af3194e5 💥 breaking: remove password_is_bad from ptth_server
The password checking is not necessary with the new process of generating
high-entropy Base64 passwords and then approving them on the relay.

The password file takes a lot of space and this doesn't need to be part
of ptth_server's public API, if there is one, anyway.
2021-04-17 17:47:01 -05:00
_ d457feb35f 📝 docs: document ptth_core 2021-04-17 17:47:01 -05:00
_ a911e53e48 📝 docs: finish some basic docs for always_equal 2021-04-17 17:47:01 -05:00
_ e02dbf6e31 ♻️ refactor: alphabetize 2021-04-17 17:47:01 -05:00
_ b975e463e8 📝 docs: start writing docs in `cargo doc` format 2021-04-17 14:57:30 -05:00
_ d16b0c4c61 🚨 `cargo check` pass 2021-04-10 09:41:21 -05:00
_ 6b71b32cf5 ♻️ refactor: extract routing module 2021-04-10 09:38:53 -05:00
_ 6a84d2dbd5 🚧 start moving routing to its own module 2021-04-10 09:17:52 -05:00
_ 29eafb3ce7 add placeholder for generating scraper keys 2021-04-09 20:00:08 -05:00
_ 3408feb619 ♻️ refactor: move gen_key up to ptth_core 2021-04-09 19:43:15 -05:00
_ 240cd8dff1 ♻️ refactor: extract gen_key pure function 2021-04-09 19:30:45 -05:00
_ d9669a7073 proof of concept for private browser cache based on etag and if-none-match 2021-04-03 17:26:53 +00:00
_ 1df0f0f677 ♻️ refactor: extract stream_file 2021-04-03 16:27:31 +00:00
_ ff73f501a4 🚧 2021-04-03 16:21:59 +00:00
_ 3389292457 placeholder for caching - Always returns a random ETag header.
So the browser-side cache will always miss, but I tested that Firefox will at
least send us If-None-Match with the last ETag it saw.
2021-04-03 15:53:59 +00:00
_ 6e24983ad7 🚨 refactor: cargo clippy 2021-04-03 15:30:32 +00:00
_ 5a6d9314cc 🚨 refactor: appease clippy 2021-04-03 15:23:03 +00:00
_ 0821ccaac6 ♻️ refactor: move Markdown support in ptth_server out to a feature.
It may be removed in the future.
2021-04-03 15:17:28 +00:00
_ e5bf5f7d1f ♻️ refactor: flatten out indentation 2021-04-03 14:27:17 +00:00
_ 832794f844 in-memory audit logging 2021-04-02 23:19:33 -05:00
_ 6927707501 ♻️ refactor: use BoundedVec for unregistered_servers 2021-04-02 22:30:22 -05:00
_ 2c4d3cf534 add BoundedVec generic struct 2021-04-02 22:14:23 -05:00
_ 6ee9b6e7c9 🐛 bug: ptth_server: add 30-second timeout for _only_ http_listen requests 2021-04-02 20:58:19 -05:00
_ 4dd08bdbb1 bump ptth_server to 1.2.1 for the Windows patch 2021-03-21 19:10:40 +00:00
Trisha 02d4362c3b 🏁 build: fix Windows build for ptth_server 2021-03-21 14:07:09 -05:00
_ 2253ae3391 🐛 bug: fix reqwest feature needed for ptth_server 2021-03-21 18:28:08 +00:00
_ d15f8539cb 🎉 ptth_server to 1.2.0 2021-03-21 18:25:02 +00:00
_ 3ff9c0f46c add license 2021-03-21 18:22:32 +00:00
_ 6f2c14670e 🎊 always_equal to 1.0.0 2021-03-21 18:21:48 +00:00
_ 02070e3660 🐛 bug: add metadata to ptth_relay 2021-03-21 18:16:29 +00:00
_ fc4893f2e8 🎉 ptth_relay to 1.2.0 2021-03-21 18:11:39 +00:00
_ 71a2b37fab 🎉 ptth_core to 1.2.0 2021-03-21 17:56:20 +00:00
_ f05257d833 🐛 bug fix requests timing out after 40 seconds.
This is such a stupid bug. I swear I checked this exact piece of code for
this exact bug and it wasn't there. But after I fixed it, I had no problem
running a download for 11 hours straight.

This fix won't affect a case where the firewall is actually closing long-
running connections (which is bad behavior, but it could happen) or a case
where the Internet is just flakey and the connection drops.

But it will fix the most common case where both client and server are on
robust connections and the download times out anyway.
2021-03-21 15:43:31 +00:00
_ c1118971b0 add --throttle-upload option 2021-03-21 15:43:15 +00:00
_ 235e134cb2 ♻️ refactor: more clippy lints, and make read_git_version simpler 2021-03-21 03:45:00 +00:00
_ c6b2418a49 ♻️ refactor: split up large function at clippy's behest 2021-03-21 03:40:45 +00:00
_ 50fc509c8b 🚨 fix a bunch of easy clippy warnings 2021-03-21 03:34:47 +00:00
_ f1f13d6e17 ⬆️ deps: new version of dashmap 2021-03-21 03:15:01 +00:00
_ 820099c2ca ⬆️ deps: replace ulid with rusty_ulid so I can drop rand 0.6.x 2021-03-21 03:09:44 +00:00
_ 4dddfb1768 ⬆️ update important crates to Tokio 1.4.0 2021-03-21 03:01:06 +00:00
_ ee1db02b08 ♻️ refactor: use constructor for ConfigFile 2021-03-21 02:49:44 +00:00
_ 453532e48e add listen ID to http_listen 2021-03-16 15:15:16 +00:00
_ 3302411daa ptth_relay: update tokio, trying to find this bug 2021-03-16 14:50:52 +00:00
_ 62821c546b log error for 500 internal server error during 'listen' 2021-03-16 14:39:15 +00:00
_ 456ab04f78 impl auto-gen-key 2021-03-15 20:34:32 +00:00
_ a356d981a8 add file_server_root CLI opt too 2021-03-15 20:02:37 +00:00
_ 56496bf97b add `--name` so caller program can provide name 2021-03-15 19:55:12 +00:00
_ 13c1ddc01a 🐛 bug: fix tests not compiling 2021-03-15 19:29:54 +00:00
_ 8a04481236 finish hooking up the unregistered servers page 2021-03-15 19:22:23 +00:00
_ 699cb671ec add unregistered servers page 2021-03-15 19:11:57 +00:00
_ 9648a9853c wip: debug proxy now owns a filter which can drop or modify request bodies 2021-03-06 22:58:23 +00:00
_ a980d151fc ⬆️ deps: upgrade everything to Tokio 1.2.0
And pretend I didn't completely goober the Docker build somehow
2021-03-06 21:46:35 +00:00
_ 4aa54c32d0 test: add a test that uses debug_proxy 2021-03-06 18:55:05 +00:00
_ 33746d9ace ♻️ refactor: debug_proxy into a lib 2021-03-05 04:03:40 +00:00
_ 27336d8571 add debug_proxy which I can probably use to inject network problems during tests 2021-03-05 03:17:56 +00:00
_ 6db94d3e4f update: add endless_sink debug tool 2021-02-20 20:25:14 +00:00
_ aec822ba5f ⬆️ deps: Update to Rust 1.50.0 2021-02-20 19:12:38 +00:00
_ 498d69eeb9 update: add throttled endless random garbage 2021-02-20 17:28:39 +00:00
_ 09464c548a update: add endless data source for debugging 2021-02-20 17:08:38 +00:00
_ f53973ddad 🐛 bug: make sure errors are sent to tracing 2021-02-20 16:36:45 +00:00
_ 9a984f5a4e ♻️ refactor: ptth_relay: clean up Handlebars file names 2021-02-20 16:25:30 +00:00
_ 0ffa129937 🚧 wip: add prefix for relay debugging tools 2021-02-20 16:23:12 +00:00
_ 89213ebf8a 📦 build: preparing to publish on crates.io 2021-01-20 21:22:37 -06:00
_ 031b03a13c 🎉 release: bump versions to 1.1.0 for everything in prod
I forgot to set the version in Cargo.toml files for 1.0.0.
I'm not gonna do 0.x versions because this is already live somewhere
and I don't like that 0.x adds complexity to versioning.
2021-01-20 20:49:32 -06:00
_ d7ed2ed931 test: fix tests 2021-01-19 23:27:33 +00:00
_ c40abb0fe6 🚧 wip: I was working on some port-forwarding idea.
It was going to be generic over TCP and use 2 HTTP streams, one each way.
The plan's written down somewhere.
2021-01-19 23:25:24 +00:00
_ f94b40b6b8 🚧 wip: further POC 2021-01-19 23:25:24 +00:00
_ 8d62b29319 update: both the downstream POCs work, with the bogus downstream. 2021-01-19 23:25:24 +00:00
_ 0cb24695d0 🚧 wip: idea for tunneling TCP over HTTP
There's a lot of missing pieces, but the big picture is like this:

- Use 2 completely separate HTTP streams, and try to keep them alive as long
as possible, each in basically half-duplex mode
- Each stream has a long-running PUT and GET, sort of like station307
- Each end has to be terminated by a native app that either connects to a local
TCP server, or acts as a local TCP server
- No clue how it would work for multiple connections on the same port. Poorly,
I guess?
- It's probably gonna run like garbage because we're splitting TCP into
2 TCP streams, and although backpressure might work, the ACKs will be less
efficient. And the congestion control might get confused

My only goal is to tunnel Tracy over it, so that I can have that remotely.
2021-01-19 23:25:24 +00:00
_ 574f660c1a 🚧 wip: can't remember what I was working on 2021-01-19 23:25:24 +00:00
_ 29a6ad20ee 🚧 wip: adding http service to ptth_kv 2021-01-19 23:25:24 +00:00
_ eb927ef80d test: ptth_kv is slower with async, but still fast enough 2021-01-19 23:25:24 +00:00
_ 27f31d0ef4 test: measure performance for KV store idea 2021-01-19 23:25:24 +00:00
_ 88e7839841 🚧 wip: outlining idea for Redis-like KV store in ptth_server 2021-01-03 18:09:00 +00:00
_ 0a46fc05dc 🐛 bug: fix 30-day scraper keys having 7 days of validity.
This won't affect anything, because I had manually written the not_after for
the testing keys. Even the automated tests weren't using the new_30_day
function
2020-12-21 14:26:51 +00:00