[FL-3954, FL-3955] New CLI architecture (#4111)

* feat: FuriThread stdin

* ci: fix f18

* feat: stdio callback context

* feat: FuriPipe

* POTENTIALLY EXPLOSIVE pipe welding

* fix: non-explosive welding

* Revert welding

* docs: furi_pipe

* feat: pipe event loop integration

* update f18 sdk

* f18

* docs: make doxygen happy

* fix: event loop not triggering when pipe attached to stdio

* fix: partial stdout in pipe

* allow simultaneous in and out subscription in event loop

* feat: vcp i/o

* feat: cli ansi stuffs and history

* feat: more line editing

* working but slow cli rewrite

* restore previous speed after 4 days of debugging 🥲

* fix: cli_app_should_stop

* fix: cli and event_loop memory leaks

* style: remove commented out code

* ci: fix pvs warnings

* fix: unit tests, event_loop crash

* ci: fix build

* ci: silence pvs warning

* feat: cli gpio

* ci: fix formatting

* Fix memory leak during event loop unsubscription

* Event better memory leak fix

* feat: cli completions

* Merge remote-tracking branch 'origin/dev' into portasynthinca3/3928-cli-threads

* merge fixups

* temporarily exclude speaker_debug app

* pvs and unit tests fixups

* feat: commands in fals

* move commands out of flash, code cleanup

* ci: fix errors

* fix: run commands in buffer when stopping session

* speedup cli file transfer

* fix f18

* separate cli_shell into modules

* fix pvs warning

* fix qflipper refusing to connect

* remove temp debug logs

* remove erroneous conclusion

* Fix memory leak during event loop unsubscription

* Event better memory leak fix

* unit test for the fix

* improve thread stdio callback signatures

* pipe stdout timeout

* update api symbols

* fix f18, formatting

* fix pvs warnings

* increase stack size, hope to fix unit tests

* cli: revert flag changes

* cli: fix formatting

* cli, fbt: loopback perf benchmark

* thread, event_loop: subscribing to thread flags

* cli: signal internal events using thread flags, improve performance

* fix f18, formatting

* event_loop: fix crash

* storage_cli: increase write_chunk buffer size again

* cli: explanation for order=0

* thread, event_loop: thread flags callback refactor

* cli: increase stack size

* cli: rename cli_app_should_stop -> cli_is_pipe_broken_or_is_etx_next_char

* cli: use plain array instead of mlib for history

* cli: prepend file name to static fns

* cli: fix formatting

* cli_shell: increase stack size

* cli: fix rpc lockup

* cli: better lockup fix

* cli: fix f18

* fix merge

---------

Co-authored-by: Georgii Surkov <georgii.surkov@outlook.com>
Co-authored-by: あく <alleteam@gmail.com>

scripts/serial_cli_perf.py

@@ -0,0 +1,59 @@
+import argparse
+import logging
+from serial import Serial
+from random import randint
+from time import time
+
+from flipper.utils.cdc import resolve_port
+
+
+def main():
+    logger = logging.getLogger()
+    parser = argparse.ArgumentParser()
+    parser.add_argument("-p", "--port", help="CDC Port", default="auto")
+    parser.add_argument(
+        "-l", "--length", type=int, help="Number of bytes to send", default=1024**2
+    )
+    args = parser.parse_args()
+
+    if not (port := resolve_port(logger, args.port)):
+        logger.error("Is Flipper connected via USB and not in DFU mode?")
+        return 1
+    port = Serial(port, 230400)
+    port.timeout = 2
+
+    port.read_until(b">: ")
+    port.write(b"echo\r")
+    port.read_until(b">: ")
+
+    print(f"Transferring {args.length} bytes. Hang tight...")
+
+    start_time = time()
+
+    bytes_to_send = args.length
+    block_size = 1024
+    while bytes_to_send:
+        actual_size = min(block_size, bytes_to_send)
+        # can't use 0x03 because that's ASCII ETX, or Ctrl+C
+        block = bytes([randint(4, 255) for _ in range(actual_size)])
+
+        port.write(block)
+        return_block = port.read(actual_size)
+
+        if return_block != block:
+            logger.error("Incorrect block received")
+            break
+
+        bytes_to_send -= actual_size
+
+    end_time = time()
+    delta = end_time - start_time
+    speed = args.length / delta
+    print(f"Speed: {speed/1024:.2f} KiB/s")
+
+    port.write(b"\x03")  # Ctrl+C
+    port.close()
+
+
+if __name__ == "__main__":
+    main()

scripts/update.py

@@ -34,7 +34,7 @@ class Main(App):
 
     FLASH_BASE = 0x8000000
     FLASH_PAGE_SIZE = 4 * 1024
-    MIN_GAP_PAGES = 1
+    MIN_GAP_PAGES = 0
 
     # Update stage file larger than that is not loadable without fix
     # https://github.com/flipperdevices/flipperzero-firmware/pull/3676