GitLab

Until now '.go' files of all the dependencies would not be found,
and thus building would take a long time.

* env.in: Append to the user's $GUILE_LOAD_COMPILED_PATH.  Don't set
GUILE_WARN_DEPRECATED.

* configure.ac: Ensure we have the (gcrypt mac) module.
* jupyter/kernels.scm: Use (gcrypt mac) instead of (gcrypt hmac).
(generate-key): Call 'generate-signing-key'.
* jupyter/messages.scm: Use (gcrypt mac).
(get-signature): Use 'mac-algorithm' instead of a symbol.

* jupyter/json.scm <top level>: Remove workaround for Guile-JSON 3.1.0.

* guix-kernel/environ.scm: Rename to...
* guix/jupyter/environ.scm: ... this.
* guix-kernel/magic.scm: Rename to...
* guix/jupyter/magic.scm: ... this
* guix-jupyter-container.scm, guix-jupyter-kernel.scm,
tests/environ.scm, tests/magic.scm: Adjust accordingly.
* Makefile.am (SOURCES): Adjust accordingly.

* jupyter/messages.scm (%current-protocol-version): New variable.
(<language-info>, <kernel-info-reply>): New record types.
* guix/jupyter/kernel.scm: New file.
* Makefile.am (SOURCES): Add it.
* guix-jupyter-kernel.scm (KERNEL-INFO): Remove.
(reply-kernel-info-request): Use 'kernel-info-reply->json'.
* tests/kernels.scm ("kernel_info_request"): Use
'json->kernel-info-reply' and associated record types.

* jupyter/json.scm (json, <=>): New variables.
(define-json-reader): Adjust to the new syntax for SPEC.
(define-json-writer): Likewise.
(define-json-mapping): Rebase on top of 'define-record-type*'.  Move
JSON field spec under the 'json' keyword.
* jupyter/kernels.scm (<kernel-specs>, <connection>): Adjust
accordingly.
(find-kernel-specs, allocate-connection): Use new syntactic
constructors.

* guix-jupyter-container.scm (general-handler, dispatch): Remove.
<top level>: Use 'proxy-request-handler' instead.
* guix-jupyter-kernel.scm (general-handler, dispatch): Remove.
<top level>: Use 'proxy-request-handler' instead.
* guix/jupyter/proxy.scm (proxy-request-handler): New procedure.

* jupyter/kernels.scm (reply-html): Pass #:recipient only when SOCKET is
'kernel-shell'.

* guix/jupyter/proxy.scm: New file.
* Makefile.am (SOURCES): Add it.
* guix-jupyter-container.scm (%main-kernel, %main-kernel-id)
(register-kernel, kernel-by-name): Remove.
(local-eval): No longer return COUNTER.
(general-handler): Rewrite to expect a <proxy-state> and to pass a
<proxy-state> to all the message type handlers.
(ignore-request, reply-execute-request, shutdown): Adjust accordingly.
<top level>: Create a <proxy-state> and pass it to 'server-kernels'.
* guix-jupyter-kernel.scm (%main-kernel, %main-kernel-id)
(register-proxy, proxy-by-name): Remove.
(general-handler): Rewrite to expect a <proxy-state> and to pass a
<proxy-state> to all the message type handlers.
(ignore-request, reply-execute-request, shutdown): Adjust accordingly.
(kill-containers): Remove.
<top level>: Create a <proxy-state> and pass it to 'server-kernels'.

* jupyter/kernels.scm (reply-html): Pass #:recipient to 'send-message'.

* jupyter/kernels.scm (generate-key): New procedure.
(relay-message): Remove.
* jupyter/messages.scm (<message>): Use 'define-immutable-record-type'
and define 'set-message-content'.
* guix-jupyter-container.scm (local-eval): Rewrite in terms of
'send-message'.
(reply-html-to-kernel): Remove.
(general-handler): Copy from *-kernel.scm.
(execute-request-sans-magic): New procedure.
(ignore-request, reply-execute-request, shutdown): Adjust to new calling
convention.
(%main-kernel, %main-kernel-id): New variables.
<top level>: Use 'serve-kernels'.
* guix-jupyter-kernel.scm (%main-kernel, %main-kernel-id): New
variables.
(general-handler): Check whether we're talking to %MAIN-KERNEL.
(reply-kernel-info-request, reply-execute-request, shutdown): Add 'kind'
parameter.
(new-container-connect): Remove.
(start-container): Return a <kernel>.
<top level>: Pass both the "default" container kernel and our client to
'server-kernels'.  Set %MAIN-KERNEL.

* guix/jupyter/logging.scm: New file.
* Makefile.am (SOURCES): Add it.

* guix-jupyter-kernel.scm (heartbeat-handler, start-kernel): Remove.
(general-handler): Adjust prototype to match what 'serve-kernels'
expects.
<top level>: Use 'serve-kernels'.

* jupyter/kernels.scm (allocate-connection): #:first-port defaults to #f.
[allocate-port]: New procedure
[try-connect]: New procedure.
Use it in lieu of 'test-bind', and remove the extra 'zmq-connect'
calls.
(test-bind): Remove.

* jupyter/kernels.scm (kernel-socket-kind): New procedure.
(zmq-poll*, allocate-connection): Export.
* jupyter/servers.scm (%server-scheduler-prompt, %server-exit-prompt):
New variables.
* jupyter/servers.scm (monitor-client, leave-server-loop)
(serve-kernels): New procedures.
* tests/servers.scm: New file.

* jupyter/kernels.scm (EINTR-safe): New procedure.
(read-message): Use it.

* jupyter/kernels.scm (read-message): Remove call to non-existent
'zmq-get-msg-bytevector'.

* jupyter/servers.scm (connection-file->kernel): Rename to...
(connection->kernel): ... this, and take a CONNECTION instead of a
PORT.
(connection-file->kernel): Rewrite as a composition.

* jupyter/kernels.scm (<kernel>): Use 'define-immutable-record-type'.
Add 'set-kernel-name' and 'set-kernel-pid'.
(find-kernel-by-name): Rename to...
(find-kernel-specs-file): ... this.
(find-kernel-specs): New procedure.
(<connection>): New record type.
(new-connection-file, kernel-arguments, exec-kernel): Remove.
(allocate-connection, spawn-kernel): New procedure.
(run-kernel): Rewrite to take a <kernel-spec> and to use
'allocate-connection'.
* tests/kernels.scm (%python3-specs): New variable.
("run-kernel python3"): Adjust accordingly.
* guix-jupyter-container.scm (reply-execute-request): Likewise.

* guix-kernel/environ.scm (guile-current-version->path): Don't require a
specific Guile version.

* jupyter/json.scm <top level>: Override (@@ (json builder) json-build).

* jupyter/json.scm (define-json-writer): New macro.
(define-json-mapping): Add support for defining writers.

* tests/kernels.scm ("kernel_info_request"): Rewrite to remove assumptions
about ordering, and to account for all the replies.

* jupyter/kernels.scm (<kernel-specs>): New record type.
(kernel-arguments): Use 'json->kernel-specs' and 'kernel-specs-arguments'.

Code taken from (guix swh) as of Guix commit
81c3dc32244a17241d74eea9fa265edfcb326f6d.

* jupyter/json.scm: New file.
* Makefile.am (SOURCES): Add it.

* tests/kernels.scm ("execute_request"): Rewrite to remove assumptions
about ordering, and to account for all the replies.

* guix-kernel/jupyter-client.scm: Rename to...
* jupyter/servers.scm: ... this.
(KERNEL-INFO, guile-version): Remove.
(json->kernel): Rename to...
(connection-file->kernel): ... this.
* guix-jupyter-container.scm: Adjust accordingly.
* guix-jupyter-kernel.scm (KERNEL-INFO): New variable.
(kernel): Use new 'connection-file->kernel' name.
* Makefile.am (SOURCES): Adjust file list accordingly.

* jupyter/kernels.scm (read-message): Return heartbeat messages.

Guile-JSON 3.x is incompatible with Guile-JSON 1.x, which we relied on
until now: it maps JSON dictionaries to alists (instead of hash tables),
and JSON arrays to vectors (instead of lists).  This commit is about
adjusting all the existing code to this new mapping.

* jupyter/kernels.scm (kernel-arguments): Use 'assoc-ref' instead of
'hash-ref'; pass JSON array through 'vector->list'.
(relay-message, reply-html): Likewise.
* jupyter/messages.scm (string->header): Likewise.
* guix-jupyter-container.scm (local-eval, reply-execute-request): Likewise.
* guix-jupyter-kernel.scm (reply-execute-request): Likewise.
* guix-kernel/jupyter-client.scm (json->kernel): Likewise.
* tests/kernels.scm: Likewise.
* environment.scm (propagated-inputs): Replace GUILE-JSON with
GUILE-JSON-3.

* tests/kernels.scm ("run-kernel python3"): Try to get a "status"
message.
("kernel_info_request"): New test.

* jupyter/kernels.scm (read-message): Rewrite to use 'zmq-poll'.  Add
optional 'timeout' parameter.
* tests/kernels.scm ("execute_request"): Call 'read-message' thrice and
check all three replies.

* jupyter/kernels.scm (run-kernel): Remove 'uuid' parameter and add
 #:identity parameter.  Do not set ZMQ_IDENTITY on SOCKET-SHELL when
 #:identity is #f.
* guix-jupyter-container.scm (reply-execute-request): Pass #:identity to
'run-kernel'.
* tests/kernels.scm (%kernel-uuid): Remove.
("run-kernel python3"): Remove %KERNEL-UUID argument from 'run-kernel'
call.
("execute_request"): Remove #:recipient argument to 'send-message'.
Remove reference to %KERNEL-UUID.

* jupyter/messages.scm (message-parts): Allow #:recipients to be #f.

* jupyter/kernels.scm (kernel-sockets): New procedure.
(close-kernel): Use it.

* tests/kernels.scm: New file.
* Makefile.am (SCM_TESTS): Add it.
* environment.scm <native-inputs>: Add JUPYTER, PYTHON-IPYTHON, and
PYTHON-IPYKERNEL.

* jupyter/messages.scm (<header>): Rename contructor to '%header'.
(%protocol-version): New variable.
(current-date-string, header, make-header): New procedures.
(reply): Adjust to new 'header' API.
(string->header): Likewise.

* guix-kernel/jupyter-client.scm (read-message, send-message, pub)
(pub-busy, pub-idle, reply-html): Move to...
* jupyter/kernels.scm: ... here.

* guix-kernel/jupyter-server.scm: Rename to...
* jupyter/kernels.scm: ... this.
* guix-jupyter-container.scm, guix-jupyter-kernel.scm,
guix-kernel/jupyter-client.scm: Adjust accordingly.
* Makefile.am (SOURCES): Likewise.

* guix-kernel/jupyter-client.scm (<header>, <message>, message)
(make-message, message-parts, reply, message-type, message-sender)
(string->header, header->string, parts->message, DELIM): Move to...
* jupyter/messages.scm: ... here.  New file.
(get-signature, make-id): New procedures.
* guix-kernel/hmac.msc, guix-kernel/tools.scm, tests/tools.scm: Remove.
* Makefile.am (SOURCES, SCM_TESTS): Adjust accordingly.
* guix-jupyter-container.scm, guix-jupyter-kernel.scm,
guix-kernel/jupyter-client.scm: Adjust import list accordingly.
* tests/hmac.scm (get-signature): New variable.

* guix-jupyter-kernel.scm (<proxy>): Remove.
(register-proxy): Add docstring.
(new-container-connect): Return a <kernel> object.
(reply-execute-request, kill-containers): Adjust accordingly.