Differences between revisions 109 and 253 (spanning 144 versions)
Revision 109 as of 2020-05-27 01:24:53
Size: 13003
Editor: cpe-1-159-230-113
Comment: Ensure KVM nested enabled on all cluster machines
Revision 253 as of 2024-12-16 21:48:31
Size: 26917
Editor: porcupine
Comment:
Deletions are marked like this. Additions are marked like this.
Line 7: Line 7:
||Whom||When||What|| ||'''Whom'''||'''When'''||'''What'''||
||[TPG][MPT]||2024-12-16||Upgraded `murasoi` to Debian 12||
||[MTL]||2024-12-03||Fix tanna - restart sssd||
||[GPO]||2024-12-02||Gave salmon another 1GB of memory to prevent OOM issues, updated smallwing firmware||
||[333]||2024-11-04||Helped jasperg revive one of the ExtremeNetworks summit switches, by zeroing out partition 7. See "/services/iso/Summit Switch Firmware/CompactFlash Card Backups/README.md"||
||[333]||2024-11-04||Created new (currently untested) Group Policy object named "GPO-CU-Test-NoRoamingProfile" for testing disablement of roaming profiles - only affects computers in the aforementioned Test OU||
||[333]||2024-11-04||Created new OU in AD named "OU=Test,DC=ad,DC=ucc,DC=gu,DC=uwa,DC=edu,DC=au" for testing Group Policy changes||
||[TPG]||2024-10-28||Modified the webcam archive script to only keep images for ~60 days||
||[MPT]||2024-09-17--||Created doorsense/door-status.ucc.asn.au, the web interface to UCC's (and now Unisfa's as well) new door sensors.||
||[333]||2024-09-16||Changed suffix for Samson's PTR record from "ucc.asn.au" to "ad.ucc.gu.uwa.edu.au" to fix Kerberos SPN resolution issues.||
||[TPG]||2024-09-16||Completed setup of hedgedoc.ucc.asn.au (on uccmd VM), with AD login||
||[GPO]||2024-09-15||Remade the UCC door sensor using a RPi Pico and MQTT||
||[TPG]||2024-09-09||Found the UCC-CA, documented, and re-generated Samson's AD cert||
||[333][MTL][TPG]||2024-09-04||Added, reviewed, and merged (respectively) Zonemake functionality to specify - in ucc.machines - which DNS suffix should be applied for a machine's PTR records.||
||[ROY][GPO][NTU]||2024-09-02~04||Upgraded PVE Clusters from PVE6 to PVE8, Ceph 14 to 18. Also cleaned up and shut some VMs down.||
||[MPT]||2024-08-07~14||Wrote and deployed [[https://gitlab.ucc.asn.au/ucc-systems/ucc-wtf|ucc-wtf/proxymake.py]] for `aragog`, giving nicer HAProxy management||
||[ZPH][ROY][NTU][MPT]||2024-08-12||Introduced [[Network#Internal_VLANs|VLAN209]] for UWAES||
||[ROY][GPO]||2024-08-04||Installed Proxmox Backup Server on `wobbegong` cluster for PVE upgrading||
||[ROY][GPO]||2024-08-03||Upgraded `molmol`'s FreeBSD from 13.1-release to 13.3-release||
||[MPT]||2024-07-29||Fixed webdispense `dispense.ucc.asn.au` ((it had been broken for so long))||
||[ROY]||2024-07||Fixed his buggy `dispense door` patch, redeploying new binaries on `motsugo`,`merlo`||
||[ROY]||2024-07||Installed ZFS on root for DELL R710's "dell-ph1"&"dell-ph2" for backup base OS||
||[ROY][NTU]||2024-06-24||Replaced old KVM switch `octopus` with the Belkin KVM switch `bluering`||
||[333]||2024-05-27||Replaced dead 1TB Samsung 860 Pro in Magikarp (Ceph OSD.3) with not-dead brand-new 1.92TB Micron 5400 Pro||
||[GPO][NTU]||2024-05-06||Commit changes to uccpass/keys, docs, wiki, authroot||
||[BEN][NTU]||2024-04-03||Auth outage - `mussel` had an OOM event, debugging writeup to tech@ucc||
||[GPO]||2024-03-04||Created a member VM template on Proxmox||
||[GPO]||2024-02-26||Deleted most of the VMs marked for deletion||
||[MTL]||2024-01-26||gitlab security updates||
||[MTL]||2024-01-13||gitlab security updates||
||[NTU]||2024-01-12||`meersau` for [[HowToUCC/RemoteLogin]]: `apt upgrade`, install missing `qemu-guest-agent`, reboot||
||[MPT][MTL]||2023-12-19||Pruned ucc.machines of (some) old/unused records, in particular for `.gu.uwa.edu.au`||
||[TPG]||2023-12-11||Created a `murasoi` account on gitlab so commits from auto-pushes of ucc-fw aren't attributed to me||
||[TPG]||2023-11-27||Disabled `.forward` files for all locked users (by renaming to `.forward-LOCKED`). Aim is to improve reputation||
||[333][NTU]||2023-11-13||Brought the 2TB QVO in `medico` into the Ceph cluster as OSD.0||
||[GPO][CJN]||2023-11-07||Rebooting and troubleshooting `molmol` socket queue issues||
||[333][SEB][NTU]||2023-10-16||Installed two Samsung 870 QVO 2TB SSDs, one each in `medico` and `machop`||
||[NTU]||2023-09-09||Missing MX records on Cloudflare's `ucc.gu.uwa.edu.au` / `ucc.asn.au` , rerun `octosync` on `monnik`||
||[BRD]||2023-07-29||Complete Windows SOE on `porcupine` (Mint was failing to boot.) Will dualboot Mint on a later date||
||[CJN][MPT][GPO]||2023-07-21||Replaced failing webcam on north wall with new Reolink||
||[GPO][I2N]||2023-07-17||Installed opendmarc on `mailfish`||
||[GPO][I2N]||2023-07-17||Fixed spamassassin on forwardemail||
||[TPG]||2023-07-17||Deployed python3 version of vendserver!||
||[CJN][MPT]||2023-07-10||Made `curviceps` config more lean in preparation for making it just a mgmt switch.||
||[CJN][NTU][MPT]||2023-06-05||Added `monnik` to `push.sh`'s list of hosts||
||[GPO][MTL]||2023-06-05||Fixed DKIM, updated SPF, and added DMARC records for emails||
||[GPO][I2N][MPT]||2023-05-06--2023-05-07||Upgraded `molmol`'s storage from 16 RAID-10 1TB HDDs to 6 RAID-Z2 4TB SSDs and 4 RAID-0 1TB HDDs.||
||[GPO]||2023-04-21||Fixed ntp sync on gitlab||
||[I2N][GPO]||2023-04-17||Added the shiny new 64GB ram into `molmol`||
||[NTU]||2023-04-14||check `mailfish` delays/timesync? fix `maculatus`/flame live IP after 2023-02 change||
||[MTL][MPT]||2023-03-31|| Fix broken certs on `mailfish` and `mussel` for *.ucc ||
||[I2N]||2023-03-28|| Updated Rdiff-backup on `mollitz` to be compatible with `motsugo`'s version||
||[MPT][NTU][I2N]||2023-03-27||Fixed dovecot, which broke after upgrade||
||[I2N]||2023-03-27|| Upgraded `motsugo` to Debian 11||
||[I2N][NTU]||2023-03-23||Test manual backup run for Motsugo / home||
||[BRD][MPT][I2N]||2023-03-22||`pirahna` was having kernel panics on Linux kernel 5.15.0-67, fixed by upgrading to 5.19.0-35||
||[I2N]||2023-03-13--2023-03-16||Upgraded `mailfish`'s Debian Version and Spamassassin, and enabled Spamassassin's email subject modifier||
||[GPO][NTU][I2N]||2023-03-13 to 2023-03-14||Upgraded one of `molmol`'s mirrors with the new 4TB IronWolf SSDs||
||[MTL][MPT]||2023-02-06||Added VRFY checks to `ucc-adduser-ad` to avoid email address conflicts||
||[MTL][MPT]||2023-02-06||Renumbered old account UIDs to >= 10000||
||[I2N][NTU]||2023-02-06 || Set up `wobbegong`, the newest FreeBSD machine which will host Molmol backups.||
||[MPT]||2023-02-03||Fixed missing DNS entry for `carpsucker` causing NFS errors||
||[333]||2023-01-31||Fixed dual boot on `piranha` (was broken since someone reinstalled Windows using BIOS instead of UEFI, as they nuked the EFI system partition)||
||[MPT]||2023-01-25||Set dmarc_moderation_action = 1 on UCC lists to prevent bounces to DMARC-enforcing domains||
||[I2N]||2023-01-23 || Upgraded `molmol`'s zpool and finalized FreeBSD13.1 upgrades (bootloader) ||
||[MPT][MTL]||--2023-01-23||Configured postfix for per-domain relayhost sending, and switched some domains away from the IronPorts||
||[TPG]||2023-01-03||Staged (and first-pass installed) upgrade to FreeBSD13.1 on `molmol`||
||[TPG]||2022-11-07||Corrected NTP time config in Group Policy to point to `time.windows.com`||
||[NTU][GMB]||2022-11-11||diagnose+test https://gitlab.ucc.asn.au/UCC/tech-todo-list visibility+access ||
||[MSH]||2022-11-10||diagnosed+restarted `samba-ad-dc` on `samson`, for mail through `mailfish`||
||[NTU][GPO]||2022-10-25||Upgraded `discord-irc`, and got it working with #announcements||
||[NTU][GPO]||2022-10-17||restart `merlo`/`einstein` ttyS3 2022-10-05T20:57 systemd start-limit-hit ||
||[MTL]||2022-10-17||Fix DNS entries breaking roundcube mail sending||
||[NTU],[GPO],pcadmin,wings||2022-10-15||add+benchmark ceph drives||
||[GPO]||2022-09-23--2022-09-29||Installed Windows and Linux Mint onto `piranha`, configured then broke then fixed again AD on `piranha`, `carpsucker`, and `corvo`||
||[I2N] [MPT]||2022-09-21||Installed Windows and Linux Mint onto Carpsucker, configured Active Directory||
||Various UCC members||2022-09-20||Built Pirhana and Carpsucker. Chubsucker and Cichlid put out of commission.||
||[GPO][NTU]||2022-09-05||Fixed `discord-irc` bridge||
||[MTL][TPG]||2022-09-05||Fix gitlab certificate renewal issues (IP address on `gitlab-host`)||
||[TPG]||2022-09-05||Opened firewall for .30 and .31, ensured that IRCd was running on .30||
||[TPG]||2022-08-22||Added .30 and .31 to `mussel` and `motsugo` for outbound traffic||
||[GPO][BRD]||2022-08-01||Updated locking scripts||
||[MPT]||2022-07-25||Update Debian on `merlo`, `salmon` and Unifi versions||
||[MPT]||2022-07-25||Rebooted `smallwing` to fix 5 GHz wifi||
||[TPG]||2022-07-19||Updated `merlo` to Debian 10||
||[GPO][BRD]||2022-07-11||Fixed catfish||
||[MPT][MTL][NTU]||2022-07-04||Rebuild cloud-mooneye||
||[MTL][NTU]||2022-07-04||Update netboot.xyz on murasoi||
||[MTL]||2022-07-02||Upgrade to latest gitlab||
||[MPT][GPO][BRD]||2022-06-27||Fixed square payments on uccportal||
||[MTL]||2022-06-21||Fix mail on mollitz||
||[NTU][TPG][GPO]||2022-06-20||Cleared space on mollitz to allow for backups again||
||[MPT]||2022-06-13||Shut down most services on mooneye and migrate to more appropriate locations||
||[MTL][NTU]||2022-06-06||Rebuild mudkip||
||[NTU][MTL]||2022-03-14--2022-03-15||ucc-ansible-soe fully rebuild idle-mudkip, idle-magikarp, now Debian 11||
||[NTU][MTL]||2022-03-07||ucc-ansible-soe fully rebuild idle-maltair, idle-medico, now Debian 11||
||[MPT]||2022-03-03||Git-ify and modernise more of the club website||
||[MTL]||2022-02-28||Upgrade to latest gitlab||
||[MTL]||2022-02-28||Additional packages in UCC Ansible SOE for idlehosts||
||Chris+[DBA][MPT][NTU]||2022-01-24||reracking machop, DELL R710 x 2, ...||
||[NTU]||2022-01-24||motsugo:/tmp full||
||[MTL][NTU]||2022-01-10||quovadis.ucc.asn.au (self-serve letsencrypt) moved to using cloud-mooneye and RFC-2136||
||[MTL][NTU][TPG][333]||2022-01-10||mudkip dead fan 7, degraded fan 1: replaced, now boots happily||
||[MTL][NTU]||2021-12-09||uccmonitor cloud-alchemy grafana upgrade||
||[333]||2021-11-14||Implemented new Tech Todo List in [[https://gitlab.ucc.asn.au/UCC/tech-todo-list|GitLab]] to manage our tech/wheel action items better(er)*||
||[MTL][NTU][BOB]||2021-11-01||machop setup; start proxmox atlantic cluster upgrade v6.3 to v6.4; ansible-driven idle-machop SOE||
||[BRD][MTL][NTU][BOB][TPG] [TBB][333][pcadmin] [DTA][MDD][SJY][RME]||2021-10-05||power outage 03:18 - recovery!, machop setup||
||[MTL][NTU][BOB][TPG][333]||2021-10-04||proxmox docs, discord-irc restarts, uccmonitor, magikarp recovery||
||[MPT][NTU]||2021-09-27||uccportal renewals analysis; update and make agenda.default sourceable/executable||
||[TPG]||2021-09-27||SSL/TLS cert for eggman||
||[MTL][NTU]||2021-09-27||Test prometheus/grafana monitoring of SMART on mooneye, motsugo||
||[BOB]||2021-08-31||Fixed apt sources on samson (was waia) and updated||
||[BOB]||2021-07-28||Free up space on maaxen and (manually) upgrade to latest available windows updates. Disabled print spooler to prevent printnightmare vulnerabilities||
||[MPT]||2021-06-30||Create wheel-runner VM and configure Gitlab CD for ucc-fw||
||[MPT][NTU]||2021-05-17||ucc-announce subscription backlog from ucc-adduser-ad||
||[TRS]||2021-05-10||Fix BigBlueButton, including upgrading to 2.3.0 release||
||[MTL]||2021-05-07||Fix webdispense||
||[MTL]||2021-05-06||Fix full /var on uccportal, add logrotate||
||[BOB]||2021-04-30||Fixed radiusd config on samson to suit updated requirements for full hostname and IP||
||[BOB][TPG][NTU]||2021-04-22||Fixed our long-broken IPSec VPN: [[https://lists.ucc.gu.uwa.edu.au/pipermail/tech/2021-April/005460.html]]||
||[333]||2021-04-20||Fixed MariaDB on Mussel, and thus OCSInventory - which depends on it||
||[333]||2021-04-18||Completely rebuilt the idle-medico VM using only the Ansible playbook that [MTL] wrote||
||[TPG]||2021-03-08||Fixed gitlab certbot||
||[MTL]||2021-02-22||Implement age command in uccpass. Migrate uccpass repo to UCC gitlab||
||[MTL]||2021-02-20||Move octoDNS to dedicated venv for UCC Cloudflare DNS sync||
||[MTL]||2021-01-20||Poke certs for irc.ucc.asn.au||
||[MPT]||2021-01-18||Remove mollitz mock internal subnet from murasoi||
||[MPT][NTU]||2021-01-18||Tinker with mollitz config and update wiki page to match||
||[TRS][MPT]||2021-01-12||Return mollitz legacy backups, offsite||
||[TPG]||2021-01-11||molmol freebsd-update||
||[NTU]||2021-01-10||atlantic cluster magikarp extend ceph osd.3||
||[BOB]||2021-01-10||atlantic cluster apt updates, reboots||
||[TPG][NTU]||2020-12-28,30||mailfish:~spamass training||
||[333][NTU]||2020-12-21||Replace molmol mirror SSD: root:geom-mirror boot swap zfs-slog||
||[TPG]||2020-12-21||webcam archiving and retrieval optimisation||
||[NTU]||2020-12-11||Test Ceph WAL on vmstore-bigssd, add discord-irc to legacy backups||
||[NTU][MTL]||2020-12-10||mailfish: Bounce due to NFS problems||
||[MPT]||2020-12-02||Fix Abe configuration and rancid||
||[MPT]||2020-12-02||Troubleshoot UniSFA TV network connection||
||[MPT]||2020-11-30||Reshuffle UCC wifi channels||
||[NTU][MTL]||2020-11-29||mussel: fix MoinMoin wiki textcha again||
||[NTU][CJS][MPT]||2020-10-19||place mollitz (legacy backups) on UCC network||
||[MPT]||2020-10-19||Create user VM for [DIE] for SS13 server||
||[MTL][MPT][DAA]||2020-10-12||Make login.ucc.asn.au work||
||[MPT][333][NTU]||2020-10-09--2020-10-12||CEPH! (Fix latency issues, lots of tweaks to Ceph config...)||
||[MTL]||2020-10-06||Fix gitlab.ucc.asn.au LE certs||
||[MTL]||2020-10-06||Fix portal.ucc.asn.au LE certs on uccportal. Clear full /tmp and /var partitions||
||[MTL]||2020-08-31||Fix webmail.ucc.asn.au redirect. Curse mussel apache config||
||[TPG]||2020-08-29||Fixed the wheel group page||
||[MTL]||2020-08-21||Fix wildcard certs on mailfish, mussel and motsugo via ucc-ansible-soe and Cloudflare API key||
||[MTL]||2020-07-28||Fix mentions of mooneye in mailfish config vis headers and spam||
||[MTL]||2020-06-08||Fix HTTP redirect to HTTPS for the wiki||
||[MTL]||2020-06-02||Add LDAP configuration for UCC AD to uccmonitor||
Line 112: Line 264:
||[NTU] [MPT]||2019-04-01||Merge merlo:/var/log/dispense into ~coke/cokelog , restart rsyslogd on merlo, motsugo|| ||[NTU][MPT]||2019-04-01||Merge merlo:/var/log/dispense into ~coke/cokelog , restart rsyslogd on merlo, motsugo||
Line 118: Line 270:
||[NTU] [MPT]||2019-03-18||reset napoli passwd, add sudoers|| ||[NTU][MPT]||2019-03-18||reset napoli passwd, add sudoers||
Line 120: Line 272:
||[NTU] [TPG]||2019-03-16||merlo not remote logging and BAD PIN? reboot, remount home, restart rsyslogd on merlo, motsugo||
||[NTU] [FVP] [JGM]||2019-03-16||Server rack in corridor, temporary? switch to VT320 with a narrower keyboard until a narrow PS/2 keyboard is found for the VT510 https://lists.ucc.gu.uwa.edu.au/pipermail/tech/2019-March/005091.html ||
||[NTU][TPG]||2019-03-16||merlo not remote logging and BAD PIN? reboot, remount home, restart rsyslogd on merlo, motsugo||
||[NTU][FVP][JGM]||2019-03-16||Server rack in corridor, temporary? switch to VT320 with a narrower keyboard until a narrow PS/2 keyboard is found for the VT510 https://lists.ucc.gu.uwa.edu.au/pipermail/tech/2019-March/005091.html ||
Line 128: Line 280:
||[FVP] [CFE]||2018-11 to 2019-02||Created portal.ucc.asn.au based on [DAA]'s Member``DB for membership information|| ||[FVP][CFE]||2018-11--2019-02||Created portal.ucc.asn.au based on [DAA]'s Member``DB for membership information||

UCC Systems Change Log

Please enter a short description of any work performed on UCC systems here.

Whom

When

What

[TPG][MPT]

2024-12-16

Upgraded murasoi to Debian 12

[MTL]

2024-12-03

Fix tanna - restart sssd

[GPO]

2024-12-02

Gave salmon another 1GB of memory to prevent OOM issues, updated smallwing firmware

[333]

2024-11-04

Helped jasperg revive one of the ExtremeNetworks summit switches, by zeroing out partition 7. See "/services/iso/Summit Switch Firmware/CompactFlash Card Backups/README.md"

[333]

2024-11-04

Created new (currently untested) Group Policy object named "GPO-CU-Test-NoRoamingProfile" for testing disablement of roaming profiles - only affects computers in the aforementioned Test OU

[333]

2024-11-04

Created new OU in AD named "OU=Test,DC=ad,DC=ucc,DC=gu,DC=uwa,DC=edu,DC=au" for testing Group Policy changes

[TPG]

2024-10-28

Modified the webcam archive script to only keep images for ~60 days

[MPT]

2024-09-17--

Created doorsense/door-status.ucc.asn.au, the web interface to UCC's (and now Unisfa's as well) new door sensors.

[333]

2024-09-16

Changed suffix for Samson's PTR record from "ucc.asn.au" to "ad.ucc.gu.uwa.edu.au" to fix Kerberos SPN resolution issues.

[TPG]

2024-09-16

Completed setup of hedgedoc.ucc.asn.au (on uccmd VM), with AD login

[GPO]

2024-09-15

Remade the UCC door sensor using a RPi Pico and MQTT

[TPG]

2024-09-09

Found the UCC-CA, documented, and re-generated Samson's AD cert

[333][MTL][TPG]

2024-09-04

Added, reviewed, and merged (respectively) Zonemake functionality to specify - in ucc.machines - which DNS suffix should be applied for a machine's PTR records.

[ROY][GPO][NTU]

2024-09-02~04

Upgraded PVE Clusters from PVE6 to PVE8, Ceph 14 to 18. Also cleaned up and shut some VMs down.

[MPT]

2024-08-07~14

Wrote and deployed ucc-wtf/proxymake.py for aragog, giving nicer HAProxy management

[ZPH][ROY][NTU][MPT]

2024-08-12

Introduced VLAN209 for UWAES

[ROY][GPO]

2024-08-04

Installed Proxmox Backup Server on wobbegong cluster for PVE upgrading

[ROY][GPO]

2024-08-03

Upgraded molmol's FreeBSD from 13.1-release to 13.3-release

[MPT]

2024-07-29

Fixed webdispense dispense.ucc.asn.au ((it had been broken for so long))

[ROY]

2024-07

Fixed his buggy dispense door patch, redeploying new binaries on motsugo,merlo

[ROY]

2024-07

Installed ZFS on root for DELL R710's "dell-ph1"&"dell-ph2" for backup base OS

[ROY][NTU]

2024-06-24

Replaced old KVM switch octopus with the Belkin KVM switch bluering

[333]

2024-05-27

Replaced dead 1TB Samsung 860 Pro in Magikarp (Ceph OSD.3) with not-dead brand-new 1.92TB Micron 5400 Pro

[GPO][NTU]

2024-05-06

Commit changes to uccpass/keys, docs, wiki, authroot

[BEN][NTU]

2024-04-03

Auth outage - mussel had an OOM event, debugging writeup to tech@ucc

[GPO]

2024-03-04

Created a member VM template on Proxmox

[GPO]

2024-02-26

Deleted most of the VMs marked for deletion

[MTL]

2024-01-26

gitlab security updates

[MTL]

2024-01-13

gitlab security updates

[NTU]

2024-01-12

meersau for HowToUCC/RemoteLogin: apt upgrade, install missing qemu-guest-agent, reboot

[MPT][MTL]

2023-12-19

Pruned ucc.machines of (some) old/unused records, in particular for .gu.uwa.edu.au

[TPG]

2023-12-11

Created a murasoi account on gitlab so commits from auto-pushes of ucc-fw aren't attributed to me

[TPG]

2023-11-27

Disabled .forward files for all locked users (by renaming to .forward-LOCKED). Aim is to improve reputation

[333][NTU]

2023-11-13

Brought the 2TB QVO in medico into the Ceph cluster as OSD.0

[GPO][CJN]

2023-11-07

Rebooting and troubleshooting molmol socket queue issues

[333][SEB][NTU]

2023-10-16

Installed two Samsung 870 QVO 2TB SSDs, one each in medico and machop

[NTU]

2023-09-09

Missing MX records on Cloudflare's ucc.gu.uwa.edu.au / ucc.asn.au , rerun octosync on monnik

[BRD]

2023-07-29

Complete Windows SOE on porcupine (Mint was failing to boot.) Will dualboot Mint on a later date

[CJN][MPT][GPO]

2023-07-21

Replaced failing webcam on north wall with new Reolink

[GPO][I2N]

2023-07-17

Installed opendmarc on mailfish

[GPO][I2N]

2023-07-17

Fixed spamassassin on forwardemail

[TPG]

2023-07-17

Deployed python3 version of vendserver!

[CJN][MPT]

2023-07-10

Made curviceps config more lean in preparation for making it just a mgmt switch.

[CJN][NTU][MPT]

2023-06-05

Added monnik to push.sh's list of hosts

[GPO][MTL]

2023-06-05

Fixed DKIM, updated SPF, and added DMARC records for emails

[GPO][I2N][MPT]

2023-05-06--2023-05-07

Upgraded molmol's storage from 16 RAID-10 1TB HDDs to 6 RAID-Z2 4TB SSDs and 4 RAID-0 1TB HDDs.

[GPO]

2023-04-21

Fixed ntp sync on gitlab

[I2N][GPO]

2023-04-17

Added the shiny new 64GB ram into molmol

[NTU]

2023-04-14

check mailfish delays/timesync? fix maculatus/flame live IP after 2023-02 change

[MTL][MPT]

2023-03-31

Fix broken certs on mailfish and mussel for *.ucc

[I2N]

2023-03-28

Updated Rdiff-backup on mollitz to be compatible with motsugo's version

[MPT][NTU][I2N]

2023-03-27

Fixed dovecot, which broke after upgrade

[I2N]

2023-03-27

Upgraded motsugo to Debian 11

[I2N][NTU]

2023-03-23

Test manual backup run for Motsugo / home

[BRD][MPT][I2N]

2023-03-22

pirahna was having kernel panics on Linux kernel 5.15.0-67, fixed by upgrading to 5.19.0-35

[I2N]

2023-03-13--2023-03-16

Upgraded mailfish's Debian Version and Spamassassin, and enabled Spamassassin's email subject modifier

[GPO][NTU][I2N]

2023-03-13 to 2023-03-14

Upgraded one of molmol's mirrors with the new 4TB IronWolf SSDs

[MTL][MPT]

2023-02-06

Added VRFY checks to ucc-adduser-ad to avoid email address conflicts

[MTL][MPT]

2023-02-06

Renumbered old account UIDs to >= 10000

[I2N][NTU]

2023-02-06

Set up wobbegong, the newest FreeBSD machine which will host Molmol backups.

[MPT]

2023-02-03

Fixed missing DNS entry for carpsucker causing NFS errors

[333]

2023-01-31

Fixed dual boot on piranha (was broken since someone reinstalled Windows using BIOS instead of UEFI, as they nuked the EFI system partition)

[MPT]

2023-01-25

Set dmarc_moderation_action = 1 on UCC lists to prevent bounces to DMARC-enforcing domains

[I2N]

2023-01-23

Upgraded molmol's zpool and finalized FreeBSD13.1 upgrades (bootloader)

[MPT][MTL]

--2023-01-23

Configured postfix for per-domain relayhost sending, and switched some domains away from the IronPorts

[TPG]

2023-01-03

Staged (and first-pass installed) upgrade to FreeBSD13.1 on molmol

[TPG]

2022-11-07

Corrected NTP time config in Group Policy to point to time.windows.com

[NTU][GMB]

2022-11-11

diagnose+test https://gitlab.ucc.asn.au/UCC/tech-todo-list visibility+access

[MSH]

2022-11-10

diagnosed+restarted samba-ad-dc on samson, for mail through mailfish

[NTU][GPO]

2022-10-25

Upgraded discord-irc, and got it working with #announcements

[NTU][GPO]

2022-10-17

restart merlo/einstein ttyS3 2022-10-05T20:57 systemd start-limit-hit

[MTL]

2022-10-17

Fix DNS entries breaking roundcube mail sending

[NTU],[GPO],pcadmin,wings

2022-10-15

add+benchmark ceph drives

[GPO]

2022-09-23--2022-09-29

Installed Windows and Linux Mint onto piranha, configured then broke then fixed again AD on piranha, carpsucker, and corvo

[I2N] [MPT]

2022-09-21

Installed Windows and Linux Mint onto Carpsucker, configured Active Directory

Various UCC members

2022-09-20

Built Pirhana and Carpsucker. Chubsucker and Cichlid put out of commission.

[GPO][NTU]

2022-09-05

Fixed discord-irc bridge

[MTL][TPG]

2022-09-05

Fix gitlab certificate renewal issues (IP address on gitlab-host)

[TPG]

2022-09-05

Opened firewall for .30 and .31, ensured that IRCd was running on .30

[TPG]

2022-08-22

Added .30 and .31 to mussel and motsugo for outbound traffic

[GPO][BRD]

2022-08-01

Updated locking scripts

[MPT]

2022-07-25

Update Debian on merlo, salmon and Unifi versions

[MPT]

2022-07-25

Rebooted smallwing to fix 5 GHz wifi

[TPG]

2022-07-19

Updated merlo to Debian 10

[GPO][BRD]

2022-07-11

Fixed catfish

[MPT][MTL][NTU]

2022-07-04

Rebuild cloud-mooneye

[MTL][NTU]

2022-07-04

Update netboot.xyz on murasoi

[MTL]

2022-07-02

Upgrade to latest gitlab

[MPT][GPO][BRD]

2022-06-27

Fixed square payments on uccportal

[MTL]

2022-06-21

Fix mail on mollitz

[NTU][TPG][GPO]

2022-06-20

Cleared space on mollitz to allow for backups again

[MPT]

2022-06-13

Shut down most services on mooneye and migrate to more appropriate locations

[MTL][NTU]

2022-06-06

Rebuild mudkip

[NTU][MTL]

2022-03-14--2022-03-15

ucc-ansible-soe fully rebuild idle-mudkip, idle-magikarp, now Debian 11

[NTU][MTL]

2022-03-07

ucc-ansible-soe fully rebuild idle-maltair, idle-medico, now Debian 11

[MPT]

2022-03-03

Git-ify and modernise more of the club website

[MTL]

2022-02-28

Upgrade to latest gitlab

[MTL]

2022-02-28

Additional packages in UCC Ansible SOE for idlehosts

Chris+[DBA][MPT][NTU]

2022-01-24

reracking machop, DELL R710 x 2, ...

[NTU]

2022-01-24

motsugo:/tmp full

[MTL][NTU]

2022-01-10

quovadis.ucc.asn.au (self-serve letsencrypt) moved to using cloud-mooneye and RFC-2136

[MTL][NTU][TPG][333]

2022-01-10

mudkip dead fan 7, degraded fan 1: replaced, now boots happily

[MTL][NTU]

2021-12-09

uccmonitor cloud-alchemy grafana upgrade

[333]

2021-11-14

Implemented new Tech Todo List in GitLab to manage our tech/wheel action items better(er)*

[MTL][NTU][BOB]

2021-11-01

machop setup; start proxmox atlantic cluster upgrade v6.3 to v6.4; ansible-driven idle-machop SOE

[BRD][MTL][NTU][BOB][TPG] [TBB][333][pcadmin] [DTA][MDD][SJY][RME]

2021-10-05

power outage 03:18 - recovery!, machop setup

[MTL][NTU][BOB][TPG][333]

2021-10-04

proxmox docs, discord-irc restarts, uccmonitor, magikarp recovery

[MPT][NTU]

2021-09-27

uccportal renewals analysis; update and make agenda.default sourceable/executable

[TPG]

2021-09-27

SSL/TLS cert for eggman

[MTL][NTU]

2021-09-27

Test prometheus/grafana monitoring of SMART on mooneye, motsugo

[BOB]

2021-08-31

Fixed apt sources on samson (was waia) and updated

[BOB]

2021-07-28

Free up space on maaxen and (manually) upgrade to latest available windows updates. Disabled print spooler to prevent printnightmare vulnerabilities

[MPT]

2021-06-30

Create wheel-runner VM and configure Gitlab CD for ucc-fw

[MPT][NTU]

2021-05-17

ucc-announce subscription backlog from ucc-adduser-ad

[TRS]

2021-05-10

Fix BigBlueButton, including upgrading to 2.3.0 release

[MTL]

2021-05-07

Fix webdispense

[MTL]

2021-05-06

Fix full /var on uccportal, add logrotate

[BOB]

2021-04-30

Fixed radiusd config on samson to suit updated requirements for full hostname and IP

[BOB][TPG][NTU]

2021-04-22

Fixed our long-broken IPSec VPN: https://lists.ucc.gu.uwa.edu.au/pipermail/tech/2021-April/005460.html

[333]

2021-04-20

Fixed MariaDB on Mussel, and thus OCSInventory - which depends on it

[333]

2021-04-18

Completely rebuilt the idle-medico VM using only the Ansible playbook that [MTL] wrote

[TPG]

2021-03-08

Fixed gitlab certbot

[MTL]

2021-02-22

Implement age command in uccpass. Migrate uccpass repo to UCC gitlab

[MTL]

2021-02-20

Move octoDNS to dedicated venv for UCC Cloudflare DNS sync

[MTL]

2021-01-20

Poke certs for irc.ucc.asn.au

[MPT]

2021-01-18

Remove mollitz mock internal subnet from murasoi

[MPT][NTU]

2021-01-18

Tinker with mollitz config and update wiki page to match

[TRS][MPT]

2021-01-12

Return mollitz legacy backups, offsite

[TPG]

2021-01-11

molmol freebsd-update

[NTU]

2021-01-10

atlantic cluster magikarp extend ceph osd.3

[BOB]

2021-01-10

atlantic cluster apt updates, reboots

[TPG][NTU]

2020-12-28,30

mailfish:~spamass training

[333][NTU]

2020-12-21

Replace molmol mirror SSD: root:geom-mirror boot swap zfs-slog

[TPG]

2020-12-21

webcam archiving and retrieval optimisation

[NTU]

2020-12-11

Test Ceph WAL on vmstore-bigssd, add discord-irc to legacy backups

[NTU][MTL]

2020-12-10

mailfish: Bounce due to NFS problems

[MPT]

2020-12-02

Fix Abe configuration and rancid

[MPT]

2020-12-02

Troubleshoot UniSFA TV network connection

[MPT]

2020-11-30

Reshuffle UCC wifi channels

[NTU][MTL]

2020-11-29

mussel: fix MoinMoin wiki textcha again

[NTU][CJS][MPT]

2020-10-19

place mollitz (legacy backups) on UCC network

[MPT]

2020-10-19

Create user VM for [DIE] for SS13 server

[MTL][MPT][DAA]

2020-10-12

Make login.ucc.asn.au work

[MPT][333][NTU]

2020-10-09--2020-10-12

CEPH! (Fix latency issues, lots of tweaks to Ceph config...)

[MTL]

2020-10-06

Fix gitlab.ucc.asn.au LE certs

[MTL]

2020-10-06

Fix portal.ucc.asn.au LE certs on uccportal. Clear full /tmp and /var partitions

[MTL]

2020-08-31

Fix webmail.ucc.asn.au redirect. Curse mussel apache config

[TPG]

2020-08-29

Fixed the wheel group page

[MTL]

2020-08-21

Fix wildcard certs on mailfish, mussel and motsugo via ucc-ansible-soe and Cloudflare API key

[MTL]

2020-07-28

Fix mentions of mooneye in mailfish config vis headers and spam

[MTL]

2020-06-08

Fix HTTP redirect to HTTPS for the wiki

[MTL]

2020-06-02

Add LDAP configuration for UCC AD to uccmonitor

[MPT]

2020-05-27

Enable nested KVM virtualisation on mudkip, check enabled on others

[NTU]

2020-05-24

lvextend -r murasoi:/var, add /etc/logrotate.d/ucc-ssh-auth

[BOB]

2020-04-25

dist-upgrade motsugo to buster

[BOB]

2020-04-25

Renewed letsencrypt certs on murasoi to fix ipsec vpn

[BOB]

2020-04-25

Changed main NS record with DNS registrar from mooneye.ucc.gu.uwa.edu.au to mooneye.ucc.asn.au, updated zone records to suit, and changed _acme-challenge.secure.ucc.asn.au zone to use mooneye.ucc.asn.au

[BOB]

2020-04-24

Fix rancid issues introduced by upgrade

[BOB]

2020-04-21

dist-upgrade mussel to buster

[BOB]

2020-04-21

dist-upgrade gitlab to buster

[MTL]

2020-04-21

dist-upgrade meersau to buster; rejoin AD and fix Xrdp logins - see https://github.com/neutrinolabs/xrdp/issues/906

[MPT]

2020-04-18

L3 setup of 4G modem, enabled policy-based routing for murasoi

[MPT]

2020-04-17

Physical and L2 setup of 4G modem in machine room

[MPT]

2020-04-17

Install replacement fans and recommission mudkip

[NTU][MTL]

2020-04-15

Surgical update of mussel's DebianPkg:libapache2-mod-wsgi to 4.5.17-1_i386.deb to fix moinmoin 866180

[MTL]

2020-04-13

Deploy FoldingAtHome to UCC clubroom machines to keep them busy during the COVID19 pandemic

[MTL]

2020-04-11

Migrate UCC wiki from mooneye to mussel

[NTU][TRS]

2020-04-09

Add mollitz (offsite backups) to monitoring

[MTL]

2020-04-06

Set up Mailauesi with haproxy for IMAPS, POP3S and SMTP submission frontend load balancer

[TRS]

2020-03-21

Fixed the VPN by pointing it at the current let's encrypt cert

[TRS]

2020-03-21

Installed BigBlueButton

[MSH]

2020-03-21

Make motsugo logrotate btmp (failed auth attempts) weekly so disk doesn't fill up

[DAS][MPT]

2020-02-26

Troubleshooting Unigames webcams, replugged loose patch cable, moved VLAN1 to new Lard trunk

[MPT][CFE]

2020-02-25

Increase 5G channel width to 40MHz into free space

[MPT][NTU]

2020-02-24

Shutdown Magikarp and diagnose fan issue

[MSH]

2020-02-15

Set mooneye:/etc/opendkim.conf "MaximumHeaders 0" to handle >64KB headers from looping mail to/from(?) [email protected]

[MPT]

2020-02-10

Convert all PVEVMUser permissions to newer UCC_VM_User, update documentation

[BOB]

2020-02-10

Audited user VM's

[BOB]

2020-01-28

Change ocsinventory to ssl only and roll out to all machines

[MPT]

2020-01-27

Resize /dev/md0 and /var on murasoi, with room to grow

[MPT]

2020-01-27

Fix uccpass regression preventing new keys being added

[TEC][NTU][MTL]

2020-01-13

Install Prometheus/Grafana monitoring, with Ansible, on uccmonitor, resize /var, add custom metric

[TEC]

2019-12-24

Install Prometheus/Grafana monitoring, with Ansible, on uccmonitor

[MPT][NTU]

2019-12-{16,17}

Provision new RPi 4 as user server titan, install SOE and useful programs

[MPT]

2019-12-12

Migrate UCC mail to new IronPort cloud appliances with UWA

[MPT][NTU]

2019-12-09

Outbound mail relayhost hostname {antivirus -> smtp}.uwa.edu.au per UniIT request

[NTU][TBB]

2019-12-07

merlo /usr/local/bin/serial-connect fixme resets VTxxx terminal

[MPT]

2019-12-02

Improved network documentation somewhat

[MPT][NTU][MTL]

2019-12-02

Provisioned new "IoT devices" network, including L2, L3 and PSK wifi

[NTU][MPT]

2019-12-02

Created an AWS account for UCC

[MPT][NTU]

2019-11-25

Fix cobra networking (broken small switch), /away automounting

[TEC][333]

2019-11-25

add magikarp and mudkip to Atlantic proxmox cluster

[TEC][MDD]

2019-11-25

update minecraft2017 -> minecraft2019

[333]

2019-11-21

Diagnose and fix smallwing's failing UniFi firmware updates

[MPT][TPG]

2019-11-16

Unborking a user account, restrict usernames to 3 or more characters

[MPT]

2019-11-05

Redirected fresher@ to rest of committee-only@ (successfully this time)

[MSH]

2019-10-22

Set kernel.dmesg_restrict=0 on motsugo and mussel

[MPT][THA][TPG][MSH][NTU]

2019-10-18

Service troubleshooting and restarts, after 0430--0521 power outage: proxmox/samba/ssd/zonemake?

[FVP]

2019-09-20--2019-10-11

username change?

[MTL]

2019-08-22

dpkg --add-architecture i386; apt update; apt install libpcre2-dev:i386 libncurses5-dev:i386 on motsugo for [DAA]. Also, free up space on full /var

[MPT]

2019-08-14

Implemented soft-blacklist for possibly-broken account names in ucc-adduser-ad

[FVP]

2019-08-13

Replaced faulty Microtik router sharpchin with spare OpenWRT device coromandel (in UniSFA)

[MPT]

2019-08-09

Changed ucc-adduser-ad to make new users' index.html readable by the webserver

[MPT]

2019-07-31

Updated MOTD to reflect [DBA]'s resignation from committee

[MPT]

2019-07-29

Removed ex-group members from their old groups on UCC systems (following group review)

[DAA]

2019-07-29

Tried and failed to upgrade Guacamole to 1.0.0 (using Postgres + RADIUS and then Postgres + LDAP), rolled back to 0.9.14

[333][NTU][TPG]

2019-07-22

Wifi - fix smallwing/nanoHD VLAN connectivity to kerosene, was curviceps

[MPT]

2019-07-20

Enabled daily updates of Linux desktops

[MPT]

2019-07-20

Created 90-ucc-desktops.conf for PolKit and deployed to all desktops, enabled unattended upgrades on all desktops

[MPT]

2019-07-18

Joined Catfish's Linux install to the domain, fixed network logins

[TPG][NTU]

2019-07-15

Switch complications?

[TRS][NTU]

2019-07-14

UWA DNS outage, check bind+dd/discord-irc, disable/enable mooneye DNS forwarders

[FVP][MPT][DAS]

2019-07-12

Replaced machine room switch with new chassis and supervisor with 10GE capability

[DAA]

2019-07-11

Enlarged /backups array, partition, logical volume and filesystem on Mollitz

[DAA]

2019-07-09

Installed FreeBSD updates to 11.2-RELEASE-p11 on Molmol & upgraded pkg set

[MPT]

2019-06-28

Reinstalled clownfish with updated Mint 19.1 on the new NVMe SSD

[BOB]

2019-06-25

Changed door mailing list settings to discard spam emails

[BOB][MPT][FVP][AJT][TRS]

2019-06-21--2019-06-22

Recovered murasoi from dual system disk failure

[MSH]

2019-06-18

Filtered SACK on murasoi ucc-fw to avoid SACK Panic

[MPT]

2019-06-10

Fixed /etc/fstab on pinball to boot new NVMe SSD

[MPT]

2019-06-10

Swapped in new fans to pinball and clownfish (with [AJT])

[MPT]

2019-06-09

Fixed network issues on upgraded clownfish

[AJT]

2019-06-07

Upgraded pinball, clownfish and porcupine with new components (with [MPT])

[DAA]

2019-05-27

Upgraded Samba on Samson from 4.9.2 to 4.9.5

[MTL]

2019-05-20

Some housekeeping done on mooneye /etc/aliases. All mailman mailing lists moved to bottom of file in prep for later mailman upgrade

[DAA]

2019-05-18

Removed a stack of obsolete Python packages that were breaking things

[DAA]

2019-05-18

Gitlab maintenance - fixed UCC user accounts to be internal, not external, and removed heaps of spam accounts

[DAA]

2019-05-15

Converted Apache on Mussel to Certbot and wildcard SSL; removed the acme-members scripts from crontab and zonemake; converted Dovecot on Motsugo to Certbot and wildcard SSL; converted IPsec on Murasoi to use DNS challenges; dropped acmetool on Mussel, Mooneye, Motsugo, Murasoi and Gitlab; wrote SSLCertificates page

[DAA]

2019-05-15

Security patches installed for Molmol, Meersau and Maaxen

[DAA]

2019-05-13

Converted inspircd on Mussel to Certbot

[DAA]

2019-05-13

Converted postfix and apache on Mooneye to Certbot and wildcard SSL

[DAA]

2019-05-12

Set up infrastructure for wildcard SSL certificates

[BOB][DBA]

2019-05-03

Installed replacement system/slog disk SSD in molmol

[DAA]

2019-05-03

Removed a large number of obsolete packages (mostly libraries and old development tools) from Mussel

[DAA]

2019-05-02

Upgraded Molmol to FreeBSD 11.2-RELEASE
Upgraded Samba to 4.8 (supported version) on molmol

[FVP]

2019-05-01

Refactored uccpass to put user keys in separate files, with committee and wheel directories

[MPT]

2019-04-30

Removed elliotnunn from local sudo /etc/group on clownfish to stop Polkit from asking everyone for his password

[MPT]

2019-04-30

Added [MLG] to committee user group, and updated motd

[DAA]

2019-04-29

Upgraded to Debian 9.9 on Mussel, Motsugo, Murasoi, Mooneye, Merlo, Samson, Mollitz, Gitlab, idle-Maltair, idle-Medico, Heathred, Medico, Maltair and Loveday; ceph restarted and checked for status

[BOB]

2019-04-27

Updated salmon and installed unattended upgrades. Sorted through VM cluster and tagged a heap of VM's for deletion

[BOB]

2019-04-26

Specced and purchased replacement+upgrade disks for molmol

[MSH]

2019-04-23

Made DNS notifies/AXFR from secondaries work

[MSH]

2019-04-23

Fixed member web subdomains and ssl

[DAA]

2019-04-20

Removed a bunch of obsolete packages from motsugo (gcc-4.6 ruby1.8 ruby1.9.1 php5-cli postgresql-client-9.4 python2.6-minimal zlib-bin libjasper1 hardening-includes python-reportbug python-support sysvinit)
upgraded the backport of lepton
upgraded Docker to a supported version

[BEN]

2019-04-18

Setup unisfa-freshers mailing list

[NTU][TEC]

2019-04-15

ocsinventory-agent deployed to corvo, napoli

[BOB]

2019-04-13

Set up ocsinventory.ucc.asn.au and deployed to most machines

[DAA]

2019-04-12

Upgraded idle-{medico,maltair} to Debian 9; installed Docker and Gitlab Runner on idle-medico

[DAA]

2019-04-10

Installed rust and cargo from testing on Motsugo

[SJH][MSH]

2019-04-09

Fixed user php7

[DAA]

2019-04-09

Updated Roundcube to the version in Debian

[BOB]

2019-04-09

Disabled php5 and enabled php7 on mussel

[DAA]

2019-04-09

Attempted to fix eggman mounting /mp3s on boot by enabling systemd-networkd-wait-online.service

[DAA]

2019-04-09

Removed motsugo pip packages for Pygments, Six, and youtube-dl as they were old and newer Debian packages were installed

[MTL]

2019-04-03

mussel package upgrades

[MSH]

2019-04-02

Removed and readded motsugo sdc and sde. Got rid of current-pending-sectors by overwriting them

[NTU][MPT]

2019-04-01

Merge merlo:/var/log/dispense into ~coke/cokelog , restart rsyslogd on merlo, motsugo

[MPT]

2019-03-27

Remounted /home and /away on merlo to fix BAD PIN message

[BOB]

2019-03-26

Re-synced time on Loveday - clock drift was causing ceph to be unhealthy

[BOB]

2019-03-26

Installed LSI SAS card in new HP DL380 (maltair), updated assorted firmwares, fixed network interfaces and re-added to VM cluster

[DTA]

2019-03-26

Set passwords for flame users id, dos, linux - it might stop the problem with aserver.err filling up after a portscan

[MSH]

2019-03-23

put semrushbot in secure.ucc, wiki.ucc robots.txt (not sure if wiki worked

[NTU][MPT]

2019-03-18

reset napoli passwd, add sudoers

[MSH]

2019-03-18

Got arpwatch running again on murasoi, had to put br0.* in /etc/arpwatch.conf

[NTU][TPG]

2019-03-16

merlo not remote logging and BAD PIN? reboot, remount home, restart rsyslogd on merlo, motsugo

[NTU][FVP][JGM]

2019-03-16

Server rack in corridor, temporary? switch to VT320 with a narrower keyboard until a narrow PS/2 keyboard is found for the VT510 https://lists.ucc.gu.uwa.edu.au/pipermail/tech/2019-March/005091.html

[MSH]

2019-03-16

Created mooneye:/var/log/journal so logs will persist across reboots

[RME]

2019-03-15

Created this page. Let's see if it sticks.

[BOB]

2019-03-14

Removed root keys of wheel members who are not current members

[BOB]

2019-03-05

Attended Ross's auctions to inspect HP DL380 Gen 8 server for maltair replacement. Bid and won in auction. Delivered to UCC and installed

[TRS]

2019-02-05

Pointed SOGo to AD (was still LDAP.)

[TRS]

2018-12-01

Upgraded SOGo on mussel to 4.0.4.

[FVP][CFE]

2018-11--2019-02

Created portal.ucc.asn.au based on [DAA]'s MemberDB for membership information