Testing
Go to file
Jelle van der Waa db10dd5d2c
Remove torrent tracker from archweb
Arch no longer runs it's own torrent tracker as DHT and webseeds work
well enough for us.
2020-07-09 21:55:13 +02:00
.github rename funding to the correct filename 2019-11-04 22:27:02 +01:00
devel Only show bad packages in reports 2020-07-09 21:50:48 +02:00
main Add rebuilderd status import and reporting functionality 2020-06-29 16:28:27 +02:00
mirrors mirrors: test the MirrorRsync model 2020-02-14 22:47:27 +01:00
news news: Make the check for MAILMAN_PASSWORD backwards compatible 2019-10-25 14:58:33 -03:00
packages packages: only send a signoff once the requirements are met 2020-02-13 22:46:45 +01:00
planet planet: add tests for updating planet 2020-03-06 22:54:46 +01:00
public Introduce planet functionality in archweb 2020-02-03 21:25:31 +01:00
releng Remove torrent tracker from archweb 2020-07-09 21:55:13 +02:00
sitestatic Remove leftover PIA sponsor images 2020-04-08 22:05:31 +02:00
templates Add rebuilderd status import and reporting functionality 2020-06-29 16:28:27 +02:00
todolists Add created and last_modified to json 2020-03-27 22:04:29 +01:00
visualize Revert "visualize: remove unrequired list() calls added" 2019-04-27 21:49:30 +02:00
.coveragerc Misc fixes (#84) 2018-02-18 04:33:52 -05:00
.gitattributes Add gitattributes file 2010-09-30 12:51:36 -05:00
.gitignore add mypy_cache to gitignore 2019-02-01 21:27:57 +01:00
.gitlab-ci.yml Add gitlab CI integration 2020-06-06 16:27:47 +02:00
.pylintrc pylint: comment out warning without code changes 2019-02-24 17:59:33 +01:00
.pyup.yml create pyup.io config file 2018-05-31 20:35:29 +02:00
.travis.yml Test on 3.7 2019-07-30 20:53:42 +02:00
archweb.wsgi Fix hardcoded python version in archweb.wsgi 2019-01-21 21:19:58 +01:00
AUTHORS Add myself as maintainer 2018-06-08 19:02:11 +02:00
feeds.py Use Release models torrent data for feeds 2020-07-09 21:52:26 +02:00
HACKING update documentation 2008-10-10 18:38:08 -04:00
LICENSE Initial import for public release... 2007-11-03 03:45:10 -04:00
local_settings.py.example Developing locally needs CSRF_COOKIE_SECURE=False 2019-09-09 21:27:35 +08:00
manage.py Switch shebang for Python 3 support 2019-01-21 21:19:58 +01:00
README Move markdown formatted readme to README.md 2013-11-25 21:54:15 -06:00
README.md README: add note about iPXE testing 2019-12-23 16:19:05 +01:00
requirements_prod.txt remove psycopg2 from production requirements 2019-12-18 17:27:44 +01:00
requirements.txt Add rebuilderd status import and reporting functionality 2020-06-29 16:28:27 +02:00
settings.py Remove torrent tracker from archweb 2020-07-09 21:55:13 +02:00
sitemaps.py news: fix xml sitemap 2019-02-09 19:12:57 +01:00
urls.py urls.py: add planet.archlinux.org fallback urls 2020-02-20 22:06:00 +01:00

Archweb README

Actions Status Build Status Coverage Status

To get a pretty version of this document, run

$ markdown README > README.html

License

See LICENSE file.

Authors

See AUTHORS file.

Dependencies

  • python
  • rsync (optional for mirrorcheck with rsync mirrors)

Python dependencies

More detail in requirements.txt and requirements_prod.txt; it is best to use virtualenv and pip to handle these. But if you insist on (Arch Linux) packages, you will probably want the following:

  • python-django
  • python-psycopg2
  • python-markdown
  • python-memcached

Testing Installation

  1. Run python -m venv env.

     cd /path/to/archweb && python -m venv ./env/
    
  2. Activate the virtualenv.

     source ./env/bin/activate
    
  3. Install dependencies through pip.

     pip install -r requirements.txt
    
  4. Copy local_settings.py.example to local_settings.py and modify. Make sure to uncomment the appropriate database section (either sqlite or PostgreSQL).

  5. Migrate changes.

     ./manage.py migrate
    
  6. Load the fixtures to prepopulate some data. If you don't want some of the provided data, adjust the file glob accordingly.

     ./manage.py loaddata main/fixtures/*.json
     ./manage.py loaddata devel/fixtures/*.json
     ./manage.py loaddata mirrors/fixtures/*.json
     ./manage.py loaddata releng/fixtures/*.json
    
  7. Use the following commands to start a service instance

     ./manage.py runserver
    
  8. To optionally populate the database with real data:

     wget http://mirrors.kernel.org/archlinux/core/os/x86_64/core.db.tar.gz
     ./manage.py reporead x86_64 core.db.tar.gz
     # Package file listing
     wget http://mirrors.kernel.org/archlinux/core/os/x86_64/core.files.tar.gz
     ./manage.py reporead --filesonly x86_64 core.files.tar.gz
    

Alter architecture and repo to get x86_64 and packages from other repos if needed.

  1. Database Updates for Added/Removed packages

     sqlite3 archweb.db < packages/sql/update.sqlite3.sql
    

For PostgreSQL use packages/sql/update.postgresql_psycopg2.sql

Testing SMTP server

To be able to create an account on your test environment an SMTP server is required. A simple debugging SMTP server can be setup using Python.

    python -m smtpd -n -c DebuggingServer localhost:1025

In local_settings.py add entries to set EMAIL_HOST to 'localhost' and EMAIL_PORT to 1025.

Running tests and coverage

To the unittests execute the following commands:

    ./manage.py collectstatic --noinput
    ./manage.py test

Running coverage:

    pip install coverage
    coverage run --omit='env*' --source='.' manage.py test
    coverage report

Django Debug toolbar

To use the Django Debug toolbar install django-debug-toolbar and in local_settings.py set DEBUG_TOOLBAR to True.

Updating iPXE image

The netboot image can be updated by building the AUR package (note that it builds from git master) and copying the resulting ipxe.pxe, ipxe.lkrn and ipxe.efi to sitestatic/netboot. Then as Arch Linux Developer sign them with your PGP key gpg --output ipxe.efi.sig --detach-sig ipxe.efi.

Testing a build iPXE image requires the 'qemu' package and running the following command:

    qemu-system-x86_64 -kernel ipxe.lkrn -m 2G

Production Installation

Arch Linux has an Ansible role for Archweb in their infrastructure repo.

vim: set syntax=markdown et: