There seems to be a DNS issue on our vendor's side that breaks sending mails to the openSUSE mailing lists. Our vendor is contacted, we will update this announcement as soon as we get any further info

]]>2018-10-29T18:00:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/170/UPDATE: download.opensuse.org is now working again

download.opensuse.org has an unexpected outage.
As a workaround, we redirect all traffic to provo-mirror. Unfortunately the mirror database there is outdated, which means you'll probably get slower downloads than usual.

]]>2018-10-02T22:35:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/168/software.opensuse.org is currently down

UPDATE: it works again

]]>2018-09-24T21:06:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/166/UPDATE 2: The service is up and running again

UPDATE: The server is facing HW issues. We are working on the replacement, but unfortunately it will take some time. We don't have any ETA yet either, but we'll let you know here as soon as we have news

The server that hosts rsync.opensuse.org has unexpectedly gone offline. It is a physical server, hosted on a sponsor's datacenter. We are in communication with the sponsor, but unfortunately there is no ETA yet on when it will be back

Updated from "Partial Outage" to "Performance Issues" as we are back to a mainly stable state which we have under control with a reduced set of active workers.

We will shutdown the machine o3 and bring it up with more cores in the next minutes. o3 is back, picked up jobs, continuing the monitoring.

All problems resolved. Risk mitigation improvements have been implemented or are planned to be implemented in the future.

See https://progress.opensuse.org/issues/39743 for details.

]]>2018-08-15T13:35:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/54/UPDATE: A fix has been applied on the paste.opensuse.org side

paste.opensuse.org currently gets broken by cookies from other *.opensuse.org subdomains and only prints a Disallowed Key Characters. error message.

Workarounds:

open paste.opensuse.org in a private browser window or

use susepaste.org. For existing links to paste.opensuse.org, replacing the domain with susepaste.org will work and give you the pasted content

UPDATE:

It turned out that news.opensuse.org and lizards.opensuse.org send out cookies with a cookie domain of "*.opensuse.org", and one of these cookies breaks paste.opensuse.org.

We'll restrict the cookie domain, but until this is done, you can delete your news.opensuse.org cookies to "fix" paste.opensuse.org. Note that this will only last until you visit news.opensuse.org again (until we have fixed the cookie domain there).

UPDATE:

These cookies get sent by more services - we are aware of www.opensuse.org, news.o.o, lizards.o.o, bugzilla and forums.o.o. Follow https://progress.opensuse.org/issues/40025 for more technical details.

UPDATE:

This was fixed on paste.opensuse.org

]]>2018-08-04T13:38:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/52/The dev team of software.o.o found the bug and in the mean time did a "hot fix" for this to let software.o.o run smoothly again.

More information here:

https://github.com/openSUSE/software-o-o/pull/359

We are facing trouble with the performance of software.o.o atm - we are investigating this issue and inform you here if it's solved.
Thanks to everybody for reporting this.

The network card in rsync.opensuse.org (one of the public rsync mirrors of the openSUSE distribution) seems to be broken - the kernel reports hardware unit hangs and resets the adapter more and more often. We recommend everyone to check our webpage https://mirrors.opensuse.org/ for the closest rsync mirror nearby and use that one for downloading while we try to solve the issue.

]]>2017-11-09T19:43:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/27/UPDATE: all machines are back online.

Servers/Services hosted in the Nuremberg data center are going down one by one now to be prepared for the planned power outage over the weekend.

We will keep you updated in various IRC channels and here on https://status.opensuse.org/

The login system used by the wiki and progress.opensuse.org is currently broken. You'll always get "invalid username/password" when trying to login.

]]>2017-09-10T20:18:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/18/UPDATE: download.opensuse.org is online again - all repositories where checked and re-published if needed.

The data partition showed major issues - resulting in a shutdown of the file system. We are currently analyzing the problem and trying to bring the service up again.

Please use http://mirrors.opensuse.org/ meanwhile to get a list of other openSUSE mirrors.

]]>2017-09-06T09:20:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/17/UPDATE: identified wrong group permissions after package upgrade to be the root cause. This is fixed now.

keyserver.opensuse.org is facing non-planned outage. The issue is being investigated, no ETA can be provided though

]]>2017-08-04T15:56:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/16/UPDATE: we moved and updated all 18 localized openSUSE wikis in the last 6 hours. All wikis should be back to normal. Also, they now support the new features announced for en.opensuse.org last week. If you notice any issues in one of the wikis, please tell us by mail to admin@opensuse.org

We are working on moving and updating the localized wikis, starting in alphabetical order (cn is the first).

During the move, the currently-moved wiki will be set to read-only.

We'll update this page after finishing this round of wiki moves.

]]>2017-07-17T17:25:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/15/UPDATE: hardware is exchanged and everything is back to normal.

SUSE-IT together with the openSUSE Heroes routinely performs service to Services on an ongoing basis to ensure that everything is up to date and running smoothly.

In preparation of a planned bandwidth upgrade in the Nuremberg data center, a core switch has to be replaced. This might result in short unattainability of all openSUSE services hosted in Nuremberg, namely (just to name the most important ones) the openSUSE Build Service, Connect and the English wiki pages.

We apologise for the trouble caused.

]]>2017-07-13T04:30:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/14/UPDATE: The english openSUSE wiki has been moved and updated successfully. If you encounter any issue, please let us know by mail to admin@opensuse.org.

The english wiki (en.opensuse.org) is set to read only, with slight possible downtimes.

The reason for the downtime is the move of the wiki from the old Provo cluster to the new Nuremberg opensuse network.

We'll update this page when the move and update is finished.

]]>2017-07-11T17:42:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/12/UPDATE: This issue is fixed! System working in normal operation again.

After a partial outage, the OBS API is currently under heavy load. The backend part is available and working on the current queue. The issue is solved, but as OBS is working on backlog, the service has performance issues at least until 2017-08-29.
software.o.o package search is as well affected by this and is very slow at the moment.

]]>2017-06-28T14:30:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/11/UPDATE: This issue is fixed! System working in normal operation again.

While download.opensuse.org is still up and running, our rsync.opensuse.org mirror is currently down (reason: lost network connection completely after trying to re-establish IPv6 connectivity - might be a configuration problem).

We are currently trying to reach out to the data center folks to get remote access to the machine - if this fails, we need to travel to the location, which will take some time.

We need to travel to the external data center to bring the machine up again. This will happen on Monday, 2017-06-26. Stay tuned. (happened)

]]>2017-06-23T11:00:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/10/Major upgrade of the Weblate server is planned. It will require database migration, and servers being read-only or off. We expect that Weblate migration outage is planned between Jun 19 and Jun 21. During the migration, openSUSE Weblate will be read-only or off. Please follow https://lists.opensuse.org/opensuse-translation/2017-06/msg00002.html
]]>2017-06-19T10:00:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/9/The OBS API is currently under heavy load and can not process further requests. The backend part is still available and working on the current queue - but new requests can not go in. The issue is currently investigated, no further information available.
]]>2017-05-18T14:30:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/8/The software portal is currently not functional. While at a first view it looks like a problem with a port of the Ruby on Rails application driving the page, we need to further investigate what causes the problem. A rouge guess points to one of the latest installed package updates - but this is just a suspicion.
]]>2017-05-16T19:00:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/7/A major issue with the authentication system results in downtime or read-only mode of many openSUSE services. They are marked either as 'partial outage' (read-only mode) or 'major outage' (down) here.

We expect the issue to persist until Monday, 2017-05-15.

]]>2017-05-12T13:00:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/6/keyserver.opensuse.org is currently down by intention. As reported by https://progress.opensuse.org/issues/17978 we are currently trying to identify the "out of sync" problem with other keyservers. This includes a few restarts and configuration changes. As such, we can not declare the system to have only partial outages.
]]>2017-04-08T19:00:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/5/progress.opensuse.org is trowing a 503 error at the moment, while the application is running fine. Checking what happened.
]]>2017-04-06T06:00:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/4/On Wednesday 2017-03-08 from 13:00 UTC till 15:00 UTC, the VM that hosts the openSUSE Mailing lists [1] will be offline. During that time, sending or receiving mails to the openSUSE mailing lists, or viewing their archives will
not be possible. All the mails that will be sent during the downtime will be delayed.

The reason for the downtime is to apply major upgrades to both the operating system and the mailing list software.

]]>2017-03-08T12:00:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/3/IT services provided out of the Provo Data Center experienced an interruption for 30 minutes. This was an emergency outage to restore full service to a severely degraded core network infrastructure.
]]>2017-03-01T00:30:00+00:00openSUSE status pagehttps://status.opensuse.org/incidents/1/A race condition between a ticket system and our mailing list software is currently generating a lot of "SPAM" Emails for some mailing lists. These mails end up in the moderators queue - so the normal traffic is not affected. If you are affected by getting a lot of moderator requests for the mailing lists you are maintaining, please contact the Heroes to get the list on a black list.
]]>2017-02-28T14:15:00+00:00