Simplify CI pipeline rules and adjust artifact handling. Also make a test for the doc builds.

Removed unnecessary 'allow_failure' rules and redundant pipeline instructions for 'hotfix' branches in .gitlab-ci.yml. Improved artifact logic by refining exclusion patterns and simplifying descriptions. Updated Sphinx-built docs configuration and clarified notebook handling in doc/conf.py.