caaed8a5e1
remove 30-day limit on scraper keys
2021-08-27 18:34:38 -05:00
918ea8c778
🔊 log error on URL routing failures
2021-07-27 03:17:26 +00:00
9b60acf0e0
📝 remove Github repo from Cargo.tomls. PTTH is no longer on my Github
2021-07-18 17:44:07 +00:00
3a2147d50f
use `MissedTickBehavior::Skip` on all intervals
2021-07-18 17:43:58 +00:00
d8c6e1bd14
⬆️ update to Tokio 1.8.x to get a feature I want
2021-07-18 17:33:34 +00:00
d292693856
⬆️ update rmp-serde to 0.15.5 and add it to ptth_quic
2021-07-18 17:19:05 +00:00
0fe8c64c4f
➖ remove old port forwarding prototypes
...
ptth_quic is simpler and better
2021-07-18 09:20:33 -05:00
02b6955a50
🐛 bug: allow `auto-gen-key` to also recreate the file and fix permissions
2021-07-13 16:02:49 -05:00
e21ba78fa5
GUI is working well now
2021-07-12 01:01:47 +00:00
ef27c0443d
♻️ refactor: use FLTK's event loop to simplify
2021-07-11 23:57:18 +00:00
04975ee6c0
just disable Ctrl+C graceful shutdown in the GUI for now
2021-07-11 23:33:47 +00:00
41d5b896a9
🐛 bug: the GUI can now restart `ptth_server` properly
2021-07-11 18:56:23 +00:00
0d3b402050
➕ add prototype FLTK GUI for ptth_server
...
Right now it can only start and stop the server once, due to a known
bug. Eventually I'd like it to be a user-friendly GUI with all the
required config files and maybe a folder browser so you can pick
which folder(s) are served.
2021-07-11 10:59:48 -05:00
2f2e4ef64d
📝 document how to run `ptth_server`
...
This commit also works well on Termux on Android.
2021-07-11 13:12:32 +00:00
6f45f5105e
➖ remove `heim` dependency
...
It doesn't work on Android, and I can't fault it for that (Platform difference)
but it also drags in `uom` which has a bunch of template magic that takes
forever to compile, and I'm pretty sure it's dragging down my compile times.
I tried to build `ptth_server` on nightly to get compile timings, and heim
depends on `socket2` which failed to compile.
And I never ended up using the CPU monitoring. So heim is gone now.
2021-07-11 12:17:36 +00:00
277c00b753
switch to rustls
2021-07-11 11:53:41 +00:00
bccc9bce53
set default-run key for ptth_server
2021-07-11 11:38:46 +00:00
429d1cc957
🐛 bug: don't leak request IDs in the audit log
2021-07-11 10:56:40 +00:00
5db72be1bc
tell the relay our server name when we serve responses
...
This is needed for a future refactor of the relay.
2021-07-10 22:17:32 +00:00
0f7c95f79f
should be possible to POST to servers now
2021-05-15 17:50:43 +00:00
af958ac43d
🚧 compiles but probably doesn't work
2021-05-15 17:25:13 +00:00
6c34a1ef37
♻️ refactor: prepare to allow POSTing to servers
2021-05-15 17:14:12 +00:00
b018f16794
♻️ refactor: custom servers won't create a file server module.
2021-05-09 19:54:09 +00:00
6c826b0cc5
ptth_server v2.1.0 will allow custom servers with a user-supplied request handler
2021-05-09 19:40:19 +00:00
08009de043
🚧 it works!
2021-05-09 18:32:24 +00:00
c663d126aa
♻️ refactor: moving things around to support third-party ptth_server modules
2021-05-09 17:54:29 +00:00
93bf38ec03
🚨 clippy pass
2021-05-02 22:32:24 +00:00
ce82f7d6a3
one-click registration works
2021-05-02 22:23:12 +00:00
ebd1026903
🚧 working on one-click registration.
...
also removed many un-needed `Arc` wrappers
2021-05-02 21:59:04 +00:00
a4ec4878ea
🚧 one-click server registration
2021-05-02 21:18:07 +00:00
dc53aeed30
💄 sort unregistered servers by name
2021-05-02 18:30:03 +00:00
62248aca53
💄 de-dupe unregistered servers list
2021-05-02 18:01:02 +00:00
810a34463c
♻️ refactor: get rid of mod.rs
2021-04-29 23:03:01 +00:00
90b6b6913e
test persistent config
2021-04-28 21:52:43 -05:00
4ec5d66d25
more audit logging
2021-04-28 20:18:53 -05:00
8419871428
🚧 wip: testing a hypothesis about collecting metrics
2021-04-28 19:50:40 -05:00
e8e733046c
📝 docs: trying to figure how I can keep the client stream open
2021-04-27 22:36:44 -05:00
3240ad72b2
♻️ refactor: error handling
2021-04-27 21:39:42 -05:00
33d07c45a8
♻️ refactor: use `tokio::time::timeout`
2021-04-27 20:15:21 -05:00
a661ce02ea
♻️ refactor: extract park_client function
2021-04-27 20:10:32 -05:00
6990be48d6
add config for relay listen address
...
this will make it easier to run on Wireguard or LANs or whatever
2021-04-27 18:48:22 -05:00
522cbc5991
add server count and current time to server list page
2021-04-27 18:12:37 -05:00
5ebdbaa225
🚧 wip: machine-editable config
2021-04-27 17:22:07 -05:00
c361ecd806
♻️ refactor: extract builder for Relay
2021-04-27 15:05:27 -05:00
cfc2228491
add relay builder
2021-04-27 14:55:08 -05:00
7c9238527f
✅ tests: add test for serializing tripcodes
2021-04-27 14:36:05 -05:00
8f334f57a3
add serialize for server config structs
2021-04-27 14:31:58 -05:00
4a73f48c68
✅ tests: fix tests
2021-04-27 14:31:32 -05:00
b659d6b74f
➕ add "news" URL to server list page
2021-04-27 14:10:11 -05:00
9eb470963c
make an error transparent so it's more meaningful
2021-04-18 13:51:27 -05:00
d001d9efe5
📝 docs: add README to `ptth_relay` before publishing
2021-04-18 13:06:01 -05:00
2c4d46388a
📝 docs: update README before publishing to crates.io
2021-04-18 12:56:36 -05:00
c3858ec8bf
📝 docs: fix code highlighting in docs, patch bump
2021-04-18 12:41:16 -05:00
27b75fe424
📝 docs: update README for bottom crates
2021-04-18 12:37:37 -05:00
67975d9b11
📝 docs: done with ptth_relay for now
2021-04-18 08:51:36 -05:00
c75448fe2c
♻️ refactor: remove un-needed muts
2021-04-18 08:33:07 -05:00
146c91f2be
♻️ refactor: rename `RelayState` to `Relay` and privatize `load_templates`
2021-04-18 08:28:07 -05:00
c6f651387e
♻️ refactor: make `load_templates` private
2021-04-17 20:50:48 -05:00
ae4f102bdf
♻️ refactor: make git_version module private
2021-04-17 19:26:05 -05:00
fd238d8c2b
♻️ refactor: rename file_server::State to file_server::FileServer
2021-04-17 19:10:52 -05:00
ae33337156
♻️ refactor: clean up ptth_server
...
- Found I was passing the file server root twice
- Removed handlebars from the public API. The templates are fixed
when ptth_server ships, so I don't think users of the lib should
care what handlebars is.
- Making other stuff private where possible
2021-04-17 18:59:59 -05:00
86af3194e5
💥 breaking: remove password_is_bad from ptth_server
...
The password checking is not necessary with the new process of generating
high-entropy Base64 passwords and then approving them on the relay.
The password file takes a lot of space and this doesn't need to be part
of ptth_server's public API, if there is one, anyway.
2021-04-17 17:47:01 -05:00
d457feb35f
📝 docs: document ptth_core
2021-04-17 17:47:01 -05:00
a911e53e48
📝 docs: finish some basic docs for always_equal
2021-04-17 17:47:01 -05:00
e02dbf6e31
♻️ refactor: alphabetize
2021-04-17 17:47:01 -05:00
b975e463e8
📝 docs: start writing docs in `cargo doc` format
2021-04-17 14:57:30 -05:00
d16b0c4c61
🚨 `cargo check` pass
2021-04-10 09:41:21 -05:00
6b71b32cf5
♻️ refactor: extract routing module
2021-04-10 09:38:53 -05:00
6a84d2dbd5
🚧 start moving routing to its own module
2021-04-10 09:17:52 -05:00
29eafb3ce7
add placeholder for generating scraper keys
2021-04-09 20:00:08 -05:00
3408feb619
♻️ refactor: move gen_key up to ptth_core
2021-04-09 19:43:15 -05:00
240cd8dff1
♻️ refactor: extract gen_key pure function
2021-04-09 19:30:45 -05:00
d9669a7073
proof of concept for private browser cache based on etag and if-none-match
2021-04-03 17:26:53 +00:00
1df0f0f677
♻️ refactor: extract stream_file
2021-04-03 16:27:31 +00:00
ff73f501a4
🚧
2021-04-03 16:21:59 +00:00
3389292457
placeholder for caching - Always returns a random ETag header.
...
So the browser-side cache will always miss, but I tested that Firefox will at
least send us If-None-Match with the last ETag it saw.
2021-04-03 15:53:59 +00:00
6e24983ad7
🚨 refactor: cargo clippy
2021-04-03 15:30:32 +00:00
5a6d9314cc
🚨 refactor: appease clippy
2021-04-03 15:23:03 +00:00
0821ccaac6
♻️ refactor: move Markdown support in ptth_server out to a feature.
...
It may be removed in the future.
2021-04-03 15:17:28 +00:00
e5bf5f7d1f
♻️ refactor: flatten out indentation
2021-04-03 14:27:17 +00:00
832794f844
➕ in-memory audit logging
2021-04-02 23:19:33 -05:00
6927707501
♻️ refactor: use BoundedVec for unregistered_servers
2021-04-02 22:30:22 -05:00
2c4d3cf534
add BoundedVec generic struct
2021-04-02 22:14:23 -05:00
6ee9b6e7c9
🐛 bug: ptth_server: add 30-second timeout for _only_ http_listen requests
2021-04-02 20:58:19 -05:00
4dd08bdbb1
✨ bump ptth_server to 1.2.1 for the Windows patch
2021-03-21 19:10:40 +00:00
02d4362c3b
🏁 build: fix Windows build for ptth_server
2021-03-21 14:07:09 -05:00
2253ae3391
🐛 bug: fix reqwest feature needed for ptth_server
2021-03-21 18:28:08 +00:00
d15f8539cb
🎉 ptth_server to 1.2.0
2021-03-21 18:25:02 +00:00
3ff9c0f46c
add license
2021-03-21 18:22:32 +00:00
6f2c14670e
🎊 always_equal to 1.0.0
2021-03-21 18:21:48 +00:00
02070e3660
🐛 bug: add metadata to ptth_relay
2021-03-21 18:16:29 +00:00
fc4893f2e8
🎉 ptth_relay to 1.2.0
2021-03-21 18:11:39 +00:00
71a2b37fab
🎉 ptth_core to 1.2.0
2021-03-21 17:56:20 +00:00
f05257d833
🐛 bug fix requests timing out after 40 seconds.
...
This is such a stupid bug. I swear I checked this exact piece of code for
this exact bug and it wasn't there. But after I fixed it, I had no problem
running a download for 11 hours straight.
This fix won't affect a case where the firewall is actually closing long-
running connections (which is bad behavior, but it could happen) or a case
where the Internet is just flakey and the connection drops.
But it will fix the most common case where both client and server are on
robust connections and the download times out anyway.
2021-03-21 15:43:31 +00:00
c1118971b0
add --throttle-upload option
2021-03-21 15:43:15 +00:00
235e134cb2
♻️ refactor: more clippy lints, and make read_git_version simpler
2021-03-21 03:45:00 +00:00
c6b2418a49
♻️ refactor: split up large function at clippy's behest
2021-03-21 03:40:45 +00:00
50fc509c8b
🚨 fix a bunch of easy clippy warnings
2021-03-21 03:34:47 +00:00
f1f13d6e17
⬆️ deps: new version of dashmap
2021-03-21 03:15:01 +00:00
820099c2ca
⬆️ deps: replace ulid with rusty_ulid so I can drop rand 0.6.x
2021-03-21 03:09:44 +00:00
4dddfb1768
⬆️ update important crates to Tokio 1.4.0
2021-03-21 03:01:06 +00:00
ee1db02b08
♻️ refactor: use constructor for ConfigFile
2021-03-21 02:49:44 +00:00
453532e48e
add listen ID to http_listen
2021-03-16 15:15:16 +00:00
3302411daa
ptth_relay: update tokio, trying to find this bug
2021-03-16 14:50:52 +00:00
62821c546b
log error for 500 internal server error during 'listen'
2021-03-16 14:39:15 +00:00
456ab04f78
impl auto-gen-key
2021-03-15 20:34:32 +00:00
a356d981a8
add file_server_root CLI opt too
2021-03-15 20:02:37 +00:00
56496bf97b
add `--name` so caller program can provide name
2021-03-15 19:55:12 +00:00
13c1ddc01a
🐛 bug: fix tests not compiling
2021-03-15 19:29:54 +00:00
8a04481236
finish hooking up the unregistered servers page
2021-03-15 19:22:23 +00:00
699cb671ec
➕ add unregistered servers page
2021-03-15 19:11:57 +00:00
9648a9853c
wip: debug proxy now owns a filter which can drop or modify request bodies
2021-03-06 22:58:23 +00:00
a980d151fc
⬆️ deps: upgrade everything to Tokio 1.2.0
...
And pretend I didn't completely goober the Docker build somehow
2021-03-06 21:46:35 +00:00
4aa54c32d0
✅ test: add a test that uses debug_proxy
2021-03-06 18:55:05 +00:00
33746d9ace
♻️ refactor: debug_proxy into a lib
2021-03-05 04:03:40 +00:00
27336d8571
add debug_proxy which I can probably use to inject network problems during tests
2021-03-05 03:17:56 +00:00
6db94d3e4f
update: add endless_sink debug tool
2021-02-20 20:25:14 +00:00
aec822ba5f
⬆️ deps: Update to Rust 1.50.0
2021-02-20 19:12:38 +00:00
498d69eeb9
update: add throttled endless random garbage
2021-02-20 17:28:39 +00:00
09464c548a
update: add endless data source for debugging
2021-02-20 17:08:38 +00:00
f53973ddad
🐛 bug: make sure errors are sent to tracing
2021-02-20 16:36:45 +00:00
9a984f5a4e
♻️ refactor: ptth_relay: clean up Handlebars file names
2021-02-20 16:25:30 +00:00
0ffa129937
🚧 wip: add prefix for relay debugging tools
2021-02-20 16:23:12 +00:00
89213ebf8a
📦 build: preparing to publish on crates.io
2021-01-20 21:22:37 -06:00
031b03a13c
🎉 release: bump versions to 1.1.0 for everything in prod
...
I forgot to set the version in Cargo.toml files for 1.0.0.
I'm not gonna do 0.x versions because this is already live somewhere
and I don't like that 0.x adds complexity to versioning.
2021-01-20 20:49:32 -06:00
d7ed2ed931
✅ test: fix tests
2021-01-19 23:27:33 +00:00
c40abb0fe6
🚧 wip: I was working on some port-forwarding idea.
...
It was going to be generic over TCP and use 2 HTTP streams, one each way.
The plan's written down somewhere.
2021-01-19 23:25:24 +00:00
f94b40b6b8
🚧 wip: further POC
2021-01-19 23:25:24 +00:00
8d62b29319
update: both the downstream POCs work, with the bogus downstream.
2021-01-19 23:25:24 +00:00
0cb24695d0
🚧 wip: idea for tunneling TCP over HTTP
...
There's a lot of missing pieces, but the big picture is like this:
- Use 2 completely separate HTTP streams, and try to keep them alive as long
as possible, each in basically half-duplex mode
- Each stream has a long-running PUT and GET, sort of like station307
- Each end has to be terminated by a native app that either connects to a local
TCP server, or acts as a local TCP server
- No clue how it would work for multiple connections on the same port. Poorly,
I guess?
- It's probably gonna run like garbage because we're splitting TCP into
2 TCP streams, and although backpressure might work, the ACKs will be less
efficient. And the congestion control might get confused
My only goal is to tunnel Tracy over it, so that I can have that remotely.
2021-01-19 23:25:24 +00:00
574f660c1a
🚧 wip: can't remember what I was working on
2021-01-19 23:25:24 +00:00
29a6ad20ee
🚧 wip: adding http service to ptth_kv
2021-01-19 23:25:24 +00:00
eb927ef80d
✅ test: ptth_kv is slower with async, but still fast enough
2021-01-19 23:25:24 +00:00
27f31d0ef4
✅ test: measure performance for KV store idea
2021-01-19 23:25:24 +00:00
88e7839841
🚧 wip: outlining idea for Redis-like KV store in ptth_server
2021-01-03 18:09:00 +00:00
0a46fc05dc
🐛 bug: fix 30-day scraper keys having 7 days of validity.
...
This won't affect anything, because I had manually written the not_after for
the testing keys. Even the automated tests weren't using the new_30_day
function
2020-12-21 14:26:51 +00:00
cbf5583d06
update: tracing RSS MiB
2020-12-20 20:41:02 -06:00
137e8e1bf8
➕ update: add prototype for `tail -f` based on polling
2020-12-20 18:59:05 -06:00
e79925dc14
update: ptth_server metrics are at a stopping point for now
2020-12-20 18:09:24 -06:00
eec17b10a1
update: switch back to 60-second interval
2020-12-20 17:34:55 -06:00
bcc673b74b
♻️ refactor: extract metrics monitor function and add it to ptth_server
2020-12-20 17:32:13 -06:00
f335644b03
➕ update: measuring CPU usage every minute
2020-12-20 17:17:31 -06:00
1e5aa528c9
🚧 wip: collecting CPU time used.
2020-12-20 20:10:29 +00:00
96106e68fc
♻️ refactor: use file_server::State directly more
2020-12-20 19:55:20 +00:00
4cb0911b77
➕ update: add RSS MiB to server root page
2020-12-20 19:46:30 +00:00
e5103d48bd
➕ update: add ArcSwap to update gauges lock-free
2020-12-20 19:35:32 +00:00
b2b0bbc8fc
♻️ refactor: rename
2020-12-20 19:00:22 +00:00
64ac4baaa8
➕ update: print RSS in MiB at startup
2020-12-20 18:58:14 +00:00
bc361fa876
➕ update: add heim for measuring process RSS
2020-12-20 18:52:53 +00:00
47788f56e0
♻️ refactor: use `use X as Y`
2020-12-20 18:40:49 +00:00
_