Commit Graph

321 Commits (e3ff600b51f1e5ee386d83888980a3795879ffe0)

Author SHA1 Message Date
_ f44613540e add the multi-call server
This exe can act as both a PTTH and PTTH_QUIC end server.
It's only 17 MB, which is a big improvement over the 15 + 15 for shipping both servers as their own exes
2021-10-02 18:13:14 +00:00
_ 30f8bbb0aa ♻️ refactor inject CLI args instead of reading them in main 2021-10-02 17:31:06 +00:00
_ 0b10737403 ♻️ refactor: move ptth_server's main into its library so I can make a busybox-style multi-use binary 2021-10-02 17:26:56 +00:00
_ 1abf1d194c 🚧 maybe HTTP Basic Auth? 2021-08-29 20:56:32 -05:00
_ 5376e8bba0 🚧 wip: add placeholder for client tokens 2021-08-29 20:17:25 -05:00
_ 324c1f7cd6 ♻️ refactor: remove pointless `Option <>` for file server root 2021-08-29 19:49:32 -05:00
_ 228a9b4262 🔊 scraper GETs have their own type of audit event now 2021-08-27 20:28:34 -05:00
_ a454585d9c 📝 document how scraper keys work 2021-08-27 20:17:59 -05:00
_ caaed8a5e1 remove 30-day limit on scraper keys 2021-08-27 18:34:38 -05:00
_ 918ea8c778 🔊 log error on URL routing failures 2021-07-27 03:17:26 +00:00
_ 9b60acf0e0 📝 remove Github repo from Cargo.tomls. PTTH is no longer on my Github 2021-07-18 17:44:07 +00:00
_ 3a2147d50f use `MissedTickBehavior::Skip` on all intervals 2021-07-18 17:43:58 +00:00
_ d8c6e1bd14 ⬆️ update to Tokio 1.8.x to get a feature I want 2021-07-18 17:33:34 +00:00
_ d292693856 ⬆️ update rmp-serde to 0.15.5 and add it to ptth_quic 2021-07-18 17:19:05 +00:00
_ 0fe8c64c4f remove old port forwarding prototypes
ptth_quic is simpler and better
2021-07-18 09:20:33 -05:00
_ 02b6955a50 🐛 bug: allow `auto-gen-key` to also recreate the file and fix permissions 2021-07-13 16:02:49 -05:00
_ e21ba78fa5 GUI is working well now 2021-07-12 01:01:47 +00:00
_ ef27c0443d ♻️ refactor: use FLTK's event loop to simplify 2021-07-11 23:57:18 +00:00
_ 04975ee6c0 just disable Ctrl+C graceful shutdown in the GUI for now 2021-07-11 23:33:47 +00:00
_ 41d5b896a9 🐛 bug: the GUI can now restart `ptth_server` properly 2021-07-11 18:56:23 +00:00
_ 0d3b402050 add prototype FLTK GUI for ptth_server
Right now it can only start and stop the server once, due to a known
bug. Eventually I'd like it to be a user-friendly GUI with all the
required config files and maybe a folder browser so you can pick
which folder(s) are served.
2021-07-11 10:59:48 -05:00
_ 2f2e4ef64d 📝 document how to run `ptth_server`
This commit also works well on Termux on Android.
2021-07-11 13:12:32 +00:00
_ 6f45f5105e remove `heim` dependency
It doesn't work on Android, and I can't fault it for that (Platform difference)
but it also drags in `uom` which has a bunch of template magic that takes
forever to compile, and I'm pretty sure it's dragging down my compile times.

I tried to build `ptth_server` on nightly to get compile timings, and heim
depends on `socket2` which failed to compile.

And I never ended up using the CPU monitoring. So heim is gone now.
2021-07-11 12:17:36 +00:00
_ 277c00b753 switch to rustls 2021-07-11 11:53:41 +00:00
_ bccc9bce53 set default-run key for ptth_server 2021-07-11 11:38:46 +00:00
_ 429d1cc957 🐛 bug: don't leak request IDs in the audit log 2021-07-11 10:56:40 +00:00
_ 5db72be1bc tell the relay our server name when we serve responses
This is needed for a future refactor of the relay.
2021-07-10 22:17:32 +00:00
_ 0f7c95f79f should be possible to POST to servers now 2021-05-15 17:50:43 +00:00
_ af958ac43d 🚧 compiles but probably doesn't work 2021-05-15 17:25:13 +00:00
_ 6c34a1ef37 ♻️ refactor: prepare to allow POSTing to servers 2021-05-15 17:14:12 +00:00
_ b018f16794 ♻️ refactor: custom servers won't create a file server module. 2021-05-09 19:54:09 +00:00
_ 6c826b0cc5 ptth_server v2.1.0 will allow custom servers with a user-supplied request handler 2021-05-09 19:40:19 +00:00
_ 08009de043 🚧 it works! 2021-05-09 18:32:24 +00:00
_ c663d126aa ♻️ refactor: moving things around to support third-party ptth_server modules 2021-05-09 17:54:29 +00:00
_ 93bf38ec03 🚨 clippy pass 2021-05-02 22:32:24 +00:00
_ ce82f7d6a3 one-click registration works 2021-05-02 22:23:12 +00:00
_ ebd1026903 🚧 working on one-click registration.
also removed many un-needed `Arc` wrappers
2021-05-02 21:59:04 +00:00
_ a4ec4878ea 🚧 one-click server registration 2021-05-02 21:18:07 +00:00
_ dc53aeed30 💄 sort unregistered servers by name 2021-05-02 18:30:03 +00:00
_ 62248aca53 💄 de-dupe unregistered servers list 2021-05-02 18:01:02 +00:00
_ 810a34463c ♻️ refactor: get rid of mod.rs 2021-04-29 23:03:01 +00:00
_ 90b6b6913e test persistent config 2021-04-28 21:52:43 -05:00
_ 4ec5d66d25 more audit logging 2021-04-28 20:18:53 -05:00
_ 8419871428 🚧 wip: testing a hypothesis about collecting metrics 2021-04-28 19:50:40 -05:00
_ e8e733046c 📝 docs: trying to figure how I can keep the client stream open 2021-04-27 22:36:44 -05:00
_ 3240ad72b2 ♻️ refactor: error handling 2021-04-27 21:39:42 -05:00
_ 33d07c45a8 ♻️ refactor: use `tokio::time::timeout` 2021-04-27 20:15:21 -05:00
_ a661ce02ea ♻️ refactor: extract park_client function 2021-04-27 20:10:32 -05:00
_ 6990be48d6 add config for relay listen address
this will make it easier to run on Wireguard or LANs or whatever
2021-04-27 18:48:22 -05:00
_ 522cbc5991 add server count and current time to server list page 2021-04-27 18:12:37 -05:00
_ 5ebdbaa225 🚧 wip: machine-editable config 2021-04-27 17:22:07 -05:00
_ c361ecd806 ♻️ refactor: extract builder for Relay 2021-04-27 15:05:27 -05:00
_ cfc2228491 add relay builder 2021-04-27 14:55:08 -05:00
_ 7c9238527f tests: add test for serializing tripcodes 2021-04-27 14:36:05 -05:00
_ 8f334f57a3 add serialize for server config structs 2021-04-27 14:31:58 -05:00
_ 4a73f48c68 tests: fix tests 2021-04-27 14:31:32 -05:00
_ b659d6b74f add "news" URL to server list page 2021-04-27 14:10:11 -05:00
_ 9eb470963c make an error transparent so it's more meaningful 2021-04-18 13:51:27 -05:00
_ d001d9efe5 📝 docs: add README to `ptth_relay` before publishing 2021-04-18 13:06:01 -05:00
_ 2c4d46388a 📝 docs: update README before publishing to crates.io 2021-04-18 12:56:36 -05:00
_ c3858ec8bf 📝 docs: fix code highlighting in docs, patch bump 2021-04-18 12:41:16 -05:00
_ 27b75fe424 📝 docs: update README for bottom crates 2021-04-18 12:37:37 -05:00
_ 67975d9b11 📝 docs: done with ptth_relay for now 2021-04-18 08:51:36 -05:00
_ c75448fe2c ♻️ refactor: remove un-needed muts 2021-04-18 08:33:07 -05:00
_ 146c91f2be ♻️ refactor: rename `RelayState` to `Relay` and privatize `load_templates` 2021-04-18 08:28:07 -05:00
_ c6f651387e ♻️ refactor: make `load_templates` private 2021-04-17 20:50:48 -05:00
_ ae4f102bdf ♻️ refactor: make git_version module private 2021-04-17 19:26:05 -05:00
_ fd238d8c2b ♻️ refactor: rename file_server::State to file_server::FileServer 2021-04-17 19:10:52 -05:00
_ ae33337156 ♻️ refactor: clean up ptth_server
- Found I was passing the file server root twice
- Removed handlebars from the public API. The templates are fixed
when ptth_server ships, so I don't think users of the lib should
care what handlebars is.
- Making other stuff private where possible
2021-04-17 18:59:59 -05:00
_ 86af3194e5 💥 breaking: remove password_is_bad from ptth_server
The password checking is not necessary with the new process of generating
high-entropy Base64 passwords and then approving them on the relay.

The password file takes a lot of space and this doesn't need to be part
of ptth_server's public API, if there is one, anyway.
2021-04-17 17:47:01 -05:00
_ d457feb35f 📝 docs: document ptth_core 2021-04-17 17:47:01 -05:00
_ a911e53e48 📝 docs: finish some basic docs for always_equal 2021-04-17 17:47:01 -05:00
_ e02dbf6e31 ♻️ refactor: alphabetize 2021-04-17 17:47:01 -05:00
_ b975e463e8 📝 docs: start writing docs in `cargo doc` format 2021-04-17 14:57:30 -05:00
_ d16b0c4c61 🚨 `cargo check` pass 2021-04-10 09:41:21 -05:00
_ 6b71b32cf5 ♻️ refactor: extract routing module 2021-04-10 09:38:53 -05:00
_ 6a84d2dbd5 🚧 start moving routing to its own module 2021-04-10 09:17:52 -05:00
_ 29eafb3ce7 add placeholder for generating scraper keys 2021-04-09 20:00:08 -05:00
_ 3408feb619 ♻️ refactor: move gen_key up to ptth_core 2021-04-09 19:43:15 -05:00
_ 240cd8dff1 ♻️ refactor: extract gen_key pure function 2021-04-09 19:30:45 -05:00
_ d9669a7073 proof of concept for private browser cache based on etag and if-none-match 2021-04-03 17:26:53 +00:00
_ 1df0f0f677 ♻️ refactor: extract stream_file 2021-04-03 16:27:31 +00:00
_ ff73f501a4 🚧 2021-04-03 16:21:59 +00:00
_ 3389292457 placeholder for caching - Always returns a random ETag header.
So the browser-side cache will always miss, but I tested that Firefox will at
least send us If-None-Match with the last ETag it saw.
2021-04-03 15:53:59 +00:00
_ 6e24983ad7 🚨 refactor: cargo clippy 2021-04-03 15:30:32 +00:00
_ 5a6d9314cc 🚨 refactor: appease clippy 2021-04-03 15:23:03 +00:00
_ 0821ccaac6 ♻️ refactor: move Markdown support in ptth_server out to a feature.
It may be removed in the future.
2021-04-03 15:17:28 +00:00
_ e5bf5f7d1f ♻️ refactor: flatten out indentation 2021-04-03 14:27:17 +00:00
_ 832794f844 in-memory audit logging 2021-04-02 23:19:33 -05:00
_ 6927707501 ♻️ refactor: use BoundedVec for unregistered_servers 2021-04-02 22:30:22 -05:00
_ 2c4d3cf534 add BoundedVec generic struct 2021-04-02 22:14:23 -05:00
_ 6ee9b6e7c9 🐛 bug: ptth_server: add 30-second timeout for _only_ http_listen requests 2021-04-02 20:58:19 -05:00
_ 4dd08bdbb1 bump ptth_server to 1.2.1 for the Windows patch 2021-03-21 19:10:40 +00:00
Trisha 02d4362c3b 🏁 build: fix Windows build for ptth_server 2021-03-21 14:07:09 -05:00
_ 2253ae3391 🐛 bug: fix reqwest feature needed for ptth_server 2021-03-21 18:28:08 +00:00
_ d15f8539cb 🎉 ptth_server to 1.2.0 2021-03-21 18:25:02 +00:00
_ 3ff9c0f46c add license 2021-03-21 18:22:32 +00:00
_ 6f2c14670e 🎊 always_equal to 1.0.0 2021-03-21 18:21:48 +00:00
_ 02070e3660 🐛 bug: add metadata to ptth_relay 2021-03-21 18:16:29 +00:00
_ fc4893f2e8 🎉 ptth_relay to 1.2.0 2021-03-21 18:11:39 +00:00
_ 71a2b37fab 🎉 ptth_core to 1.2.0 2021-03-21 17:56:20 +00:00
_ f05257d833 🐛 bug fix requests timing out after 40 seconds.
This is such a stupid bug. I swear I checked this exact piece of code for
this exact bug and it wasn't there. But after I fixed it, I had no problem
running a download for 11 hours straight.

This fix won't affect a case where the firewall is actually closing long-
running connections (which is bad behavior, but it could happen) or a case
where the Internet is just flakey and the connection drops.

But it will fix the most common case where both client and server are on
robust connections and the download times out anyway.
2021-03-21 15:43:31 +00:00
_ c1118971b0 add --throttle-upload option 2021-03-21 15:43:15 +00:00
_ 235e134cb2 ♻️ refactor: more clippy lints, and make read_git_version simpler 2021-03-21 03:45:00 +00:00
_ c6b2418a49 ♻️ refactor: split up large function at clippy's behest 2021-03-21 03:40:45 +00:00
_ 50fc509c8b 🚨 fix a bunch of easy clippy warnings 2021-03-21 03:34:47 +00:00
_ f1f13d6e17 ⬆️ deps: new version of dashmap 2021-03-21 03:15:01 +00:00
_ 820099c2ca ⬆️ deps: replace ulid with rusty_ulid so I can drop rand 0.6.x 2021-03-21 03:09:44 +00:00
_ 4dddfb1768 ⬆️ update important crates to Tokio 1.4.0 2021-03-21 03:01:06 +00:00
_ ee1db02b08 ♻️ refactor: use constructor for ConfigFile 2021-03-21 02:49:44 +00:00
_ 453532e48e add listen ID to http_listen 2021-03-16 15:15:16 +00:00
_ 3302411daa ptth_relay: update tokio, trying to find this bug 2021-03-16 14:50:52 +00:00
_ 62821c546b log error for 500 internal server error during 'listen' 2021-03-16 14:39:15 +00:00
_ 456ab04f78 impl auto-gen-key 2021-03-15 20:34:32 +00:00
_ a356d981a8 add file_server_root CLI opt too 2021-03-15 20:02:37 +00:00
_ 56496bf97b add `--name` so caller program can provide name 2021-03-15 19:55:12 +00:00
_ 13c1ddc01a 🐛 bug: fix tests not compiling 2021-03-15 19:29:54 +00:00
_ 8a04481236 finish hooking up the unregistered servers page 2021-03-15 19:22:23 +00:00
_ 699cb671ec add unregistered servers page 2021-03-15 19:11:57 +00:00
_ 9648a9853c wip: debug proxy now owns a filter which can drop or modify request bodies 2021-03-06 22:58:23 +00:00
_ a980d151fc ⬆️ deps: upgrade everything to Tokio 1.2.0
And pretend I didn't completely goober the Docker build somehow
2021-03-06 21:46:35 +00:00
_ 4aa54c32d0 test: add a test that uses debug_proxy 2021-03-06 18:55:05 +00:00
_ 33746d9ace ♻️ refactor: debug_proxy into a lib 2021-03-05 04:03:40 +00:00
_ 27336d8571 add debug_proxy which I can probably use to inject network problems during tests 2021-03-05 03:17:56 +00:00
_ 6db94d3e4f update: add endless_sink debug tool 2021-02-20 20:25:14 +00:00
_ aec822ba5f ⬆️ deps: Update to Rust 1.50.0 2021-02-20 19:12:38 +00:00
_ 498d69eeb9 update: add throttled endless random garbage 2021-02-20 17:28:39 +00:00
_ 09464c548a update: add endless data source for debugging 2021-02-20 17:08:38 +00:00
_ f53973ddad 🐛 bug: make sure errors are sent to tracing 2021-02-20 16:36:45 +00:00
_ 9a984f5a4e ♻️ refactor: ptth_relay: clean up Handlebars file names 2021-02-20 16:25:30 +00:00
_ 0ffa129937 🚧 wip: add prefix for relay debugging tools 2021-02-20 16:23:12 +00:00
_ 89213ebf8a 📦 build: preparing to publish on crates.io 2021-01-20 21:22:37 -06:00
_ 031b03a13c 🎉 release: bump versions to 1.1.0 for everything in prod
I forgot to set the version in Cargo.toml files for 1.0.0.
I'm not gonna do 0.x versions because this is already live somewhere
and I don't like that 0.x adds complexity to versioning.
2021-01-20 20:49:32 -06:00
_ d7ed2ed931 test: fix tests 2021-01-19 23:27:33 +00:00
_ c40abb0fe6 🚧 wip: I was working on some port-forwarding idea.
It was going to be generic over TCP and use 2 HTTP streams, one each way.
The plan's written down somewhere.
2021-01-19 23:25:24 +00:00
_ f94b40b6b8 🚧 wip: further POC 2021-01-19 23:25:24 +00:00
_ 8d62b29319 update: both the downstream POCs work, with the bogus downstream. 2021-01-19 23:25:24 +00:00
_ 0cb24695d0 🚧 wip: idea for tunneling TCP over HTTP
There's a lot of missing pieces, but the big picture is like this:

- Use 2 completely separate HTTP streams, and try to keep them alive as long
as possible, each in basically half-duplex mode
- Each stream has a long-running PUT and GET, sort of like station307
- Each end has to be terminated by a native app that either connects to a local
TCP server, or acts as a local TCP server
- No clue how it would work for multiple connections on the same port. Poorly,
I guess?
- It's probably gonna run like garbage because we're splitting TCP into
2 TCP streams, and although backpressure might work, the ACKs will be less
efficient. And the congestion control might get confused

My only goal is to tunnel Tracy over it, so that I can have that remotely.
2021-01-19 23:25:24 +00:00
_ 574f660c1a 🚧 wip: can't remember what I was working on 2021-01-19 23:25:24 +00:00
_ 29a6ad20ee 🚧 wip: adding http service to ptth_kv 2021-01-19 23:25:24 +00:00
_ eb927ef80d test: ptth_kv is slower with async, but still fast enough 2021-01-19 23:25:24 +00:00
_ 27f31d0ef4 test: measure performance for KV store idea 2021-01-19 23:25:24 +00:00
_ 88e7839841 🚧 wip: outlining idea for Redis-like KV store in ptth_server 2021-01-03 18:09:00 +00:00
_ 0a46fc05dc 🐛 bug: fix 30-day scraper keys having 7 days of validity.
This won't affect anything, because I had manually written the not_after for
the testing keys. Even the automated tests weren't using the new_30_day
function
2020-12-21 14:26:51 +00:00
_ cbf5583d06 update: tracing RSS MiB 2020-12-20 20:41:02 -06:00
_ 137e8e1bf8 update: add prototype for `tail -f` based on polling 2020-12-20 18:59:05 -06:00
_ e79925dc14 update: ptth_server metrics are at a stopping point for now 2020-12-20 18:09:24 -06:00
_ eec17b10a1 update: switch back to 60-second interval 2020-12-20 17:34:55 -06:00
_ bcc673b74b ♻️ refactor: extract metrics monitor function and add it to ptth_server 2020-12-20 17:32:13 -06:00
_ f335644b03 update: measuring CPU usage every minute 2020-12-20 17:17:31 -06:00