Home Home > Infrastructure
Sign up | Login

Archive for the ‘Infrastructure’ Category

Hardware problem: rsync.opensuse.org down

January 11th, 2016 by

rsync-logoWhat a start in the new year: the server running rsync.opensuse.org died with two broken hard disks at 2016-01-10.

As the hardware is located in the data center of our sponsor IP Exchange, we apologize for the delay it will take to fix the problem: we need not only the correct replacement hard drives, but also a field worker at the location who has the appropriate permissions and skills.

During the downtime (and maybe also a good tip afterward), please check on http://mirrors.opensuse.org/ for the closest mirror nearby your location that also offers rsync for you.

Weekend Wikithon to refresh content

October 19th, 2015 by

hatLeap comes out in 16 days, but before it does, openSUSE will have a Weekend Wikithon Oct. 24 and Oct. 25 to update, delete and refresh content on the openSUSE wiki.

Contributions will be gauged and four contributors will receive an openSUSE Leap hat that have the most contributions between  Oct. 24 and Oct. 25 in the following four categories:

  1. Contributor who updates the most content on the features page for the upcoming release of Leap 42.1
  2. Contributor who updates the most screenshots on the screenshots page to Leap 42.1
  3. Contributor who makes the most contributions to the 42.1 portal
  4. Contributor who deletes the most irrelevant content on the openSUSE wiki.

Communication for the event will take place on the Freenode IRC opensuse-marketing channel.

Testing Leap milestone in openQA

July 15th, 2015 by

Screenshot from 2015-07-15 15:11:21Developing Leap 42.1 is happening quickly and it was announced yesterday that the milestone was being built.The first milestone will hopefully be released this week. Leap is going through its testing and the importance of openQA (Quality Assurance) in this development process can not be understated.

openQA is used for testing an operating system, finding and files bugs and provides fully automated testing to ensure a distribution work correctly with clean functionality.

The wonders of openQA determine if a build is good and triggered errors allow testers and developers to see errors quickly and determine a cause.

Feel free to look at the test of the Leap milestone and use the hints below to navigate through openQA.

See what Richard Brown, openSUSE chairman, had to say about Leap and openQA on Reddit.

How To: Use openQA to find and file bugs (more…)

Planned downtime 2015-06-09: Mailing Lists

June 5th, 2015 by

Update: The migration of the openSUSE Mailing Lists has been finished successfully. If you encounter any issues, please let us know by mail to admin@opensuse.org.

On Tuesday 2015-06-09, from 09:00 to 11:00 UTC, the machine that hosts the
openSUSE Mailing Lists will be offline. During that
time, sending or receiving mails to the  openSUSE mailing lists, or viewing
their archives will not be possible.  All the mails that will be sent during
the downtime will be  delayed.
Failgeeko
The  reason is that the old machine is on an old distribution, and running  out
of resources. We will migrate the service to a new virtual machine,  that will
integrate it to a new configuration management infrastructure.

We’ll send a followup announcement with the final status as soon as we finish
the migration.

On behalf of the openSUSE Administration team

OSEM in 10.1 simple steps

April 23rd, 2015 by
osemnewsby Alex Vennos

What is OSEM?

OSEM is an event management web application, tailored to the needs of FOSS conferences. You can visit http://osem.io/ to find out more about it.

You can contribute too!

The guide is based & tested on openSUSE 13.2 and it will help you get started with your development right away!

How to install OSEM

Step 1. Install Ruby & Bundler (version >= ruby 2.1.2)

sudo zypper in ruby rubygem-bundler

Step 2. Install git to your system

sudo zypper in git

Step 3. Clone the repository locally to your machine (more…)

Sometimes you need some luck (was: build.opensuse.org downtime)

April 24th, 2014 by

A morning you love as admin: starting with one single disk in your storage array failing, ending up in a whole array crashing. (more…)

News from your openSUSE admins

April 12th, 2014 by

Heartbleed and openSUSE infrastructureHeartbleed Logo

As people started to ask, we checked all openSUSE servers and can confirm that none of them is affected by the heartbleed bug.

For those users running openSUSE 12.2 and 13.1, we can just repeat what we always pray: please install the latest official updates provided by our glorious maintenance team.

RSYNC and rsync.opensuse.org

The server behind rsync.opensuse.org is re-installed now and already providing packages via HTTP again.

But we faced an issue with the automation that creates the content of the “hotstuff” rsync modules: normally a script analyzes the log files of download.opensuse.org and arranges the content of these special rsync modules to provide always the most requested files, so our users have a good chance to find a very close mirror for their packages. But currently the script is not producing what we expect: it empties all those hotstuff modules. As the core developer behind this script comes back from vacation on Monday, we hope he can quickly fix the problem. For now we disabled the “hotstuff” modules (means on rsync.opensuse.org: we disabled rsync completely for now) to avoid problems.

If you want to sync packages to your local machine(s) via rsync: please pick a mirror from our page at mirrors.opensuse.org providing public rsync.

New hardware

All the racks of the OBS reference server

All the racks of the OBS reference server

You may have noticed already that the openSUSE team installed a new version of openQA on the production server. An additional news item might be that this new version has seen also new hardware to run faster than ever.

But not only openQA, also the database cluster behind download.opensuse.org has seen a hardware upgrade. The new servers allow to run the database servers as virtual machines, able to have the whole database structure stored in RAM (you hopefully benefit from the faster response times on download.opensuse.org already). And the servers still have enough capacity left, so we can now also visualize the web servers providing the download.opensuse.org interface. We are currently thinking about the detailed setup of the new download.opensuse.org system (maybe using ha-proxy here again? maybe running mirrorbrain in the “no local storage” mode? …) – so this migration might take some more time, but we want to provide the best possible solution to you.

Admins on openSUSE Conference

These year, three of our main European openSUSE administrators are able to attend to the openSUSE Conference in Dubrovnik:Geekocamp

  • Markus Rückert
  • Martin Caj
  • Robert Wawrig

And they will not only participate: instead they are providing talks and help with the infrastructure and video recording of the venue. So whenever you see them: time to spend them a drink or two :-)

 

 

 

 

The new generation of openQA hits the production server

April 4th, 2014 by

Bad news for the bugs: the new version of openQA is ready for prime time. Everybody following the blog of the openSUSE Team @ SUSE or the Factory mailing list during the last months, should be aware of the ongoing work to improve openQA and to promote it into a key component of the openSUSE integration process. Finally the new openQA is ready for public production environments, so thanks to the collaboration between the openSUSE Team and the original developers of openQA –Bernhard M. Wiedemann and Dominik Heidler– it’s finally deployed and accessible at openqa.opensuse.org

This new version brings a lot of changes at many levels, but probably the most relevant difference is the approach for tests execution: instead of running every step sequentially and comparing the needles at the end, the new version evaluates the status several times per test, deciding what to do next based on that status or aborting the whole tests as soon as a critical error is found. This approach enables both a better usage of the resources and more precise results.

This enhanced control of the execution and the results, alongside other improvements, makes possible to extend the scope of openQA. Tests of Factory isos are still there and running. But apart from them, you can see test results for the so called "staging projects", used to merge potentially dangerous packages. Generally speaking, you can just browse the test results and see what state is Factory in and how dramatic changes are about to happen.

Fuzzy matching in action: ignoring the floppy icon

Another main new feature is the use of fuzzy area matching for interpreting test results. That means much less false positives. Tests do not break that often and that easily. There is also a nice interface to figure out what failed. Try going to some failed test, selecting a needle and dragging the vertical yellow line. Pretty neat, isn’t it? You can also check how the test is written and what is it looking for. Feel free to play with it, enhance the current tests and needles and submit them via GitHub ;-)

There are even more changes, not directed towards users, but improvements in the interface that service operators use to set things up, including users management, job control or a new REST-like API. These will not affect most of you directly, just indirectly by making operators job easier.

So go ahead, play with it and if you want to help, sources are on github and we even have some easy hacks in progress.o.o to ease you into the development ;-)

Bodega, app stores and the Open Build Service

April 3rd, 2014 by

Welcome to the Bodega store!

Bodega is a project making use of the Open Build Service. Aside from that, there are many other connections between the Bodega team and openSUSE – time to find out more! We spoke with Aaron Seigo, and discussed Bodega, Appstream, zypper, ymp and the beauty of Free Software.

What is Bodega?

First off, let’s find out what Bodega is all about. Aaron explains:

Bodega is a store for digital stuff. In fancy words: it creates a catalog of metadata which represents digital assets.

The most important thing is of course the ‘digital asset’ term. That can be anything. For example, applications. Applications can be self contained – think how android does its APK files. Of course, things on Linux are often more complicated. Apache isn’t exactly a self-contained thing. And look further – perl, php, ruby, they all have their own addons like gems that need managing. Generalizing further, there are manuals. And books in general. Music, movies, pictures, you can go on.


Setting up a Bodega account

Of course, the competition has these too – look at Apple or Google.

And how about Linux…

Linux does not have a store where you can get such a wide variety of things. For a game, you can use Appstream, get it from Apper or GNOME’s software center. They all give a view on applications. Unfortunately, that is only useful for desktops and can handle things barely above the level of Angry Birds. If you want a python module as developers – these fancy tools won’t help you. Nor are they useful on servers. For those you have to rely on command line tools or even do things completely by hand. And it is all different between distributions.

Going further, where do you get documentation? For openSUSE, that’s activedoc or the forums or our support database on the wiki. Not from zypper. Music – you can get that from Magnatune and so on.

What if you can have one place where you can get a book, game, applications, isn’t that nice? That is what Bodega is.


The main screen of the store

How is Bodega different?

So, Bodega offers a digital store which can handle a wider variety of things than our current solutions. But what sets it apart from proprietary technologies like the Playstore and of course Canonical’s store solution? Aaron:

Most Linux solutions like Appstream assume their audience are users who play Angry Birds and use spreadsheets. Fair enough. Bodega takes a different approach and is far more ambitious.

Bodega has all the meta data in one place and offers ‘stores’ which are views on that data. That means you can have a software developer store, for example listing all languages and their addons separate; and a server section etc. And a separate UI for the angry-bird-and-spreadsheet crowd. All from the same bodega system, filtered by tags (not static categories!).

Talking about Appstream, Bodega can of course benefit from the metadata gathered for Appstream. And GNOME’s Software Center could be reworked to be a front-end to Bodega, adding books, music and lots of other digital data to its store. This is not meant to be a rewrite of what is there, or an isolated effort!


An application in the store

And why would you build on Bodega?

Bodega is open: everybody can quite easily add their own stores; or their own data sources; and add content and even sell it through their channels. It is not a closed system, on the contrary.

Open is a must, especially for Linux:

Take the 440.000 users of openSUSE. That would be a minimal amount of sales… The top-10 of paid apps in ubuntu makes less than a $100 per month of sales. Not really worth the effort. But if we could aggregate the sales between distributions, it would become relevant for third-party developers. Bodega as a cross-distribution is important!

And Bodega is useful for people outside of Linux. You can have your store on your own website so it is realistically possible for a independent author to sell their books in a bodega instance on their own website and never even SEE Linux. Yet the openSUSE users can get the books and benefit from the larger ecosystem…

The beauty of it is that it is all Free and Open Source Software, front and back. You can self-host all you want.

How do Bodega and OBS relate?


Preview of a wallpaper

Bodega and openSUSE have something in common: the Open Build Service. Not only is OBS used by the Bodega developers and do they run openSUSE on their servers, Bodega supports ymp files!

Bodega is well integrated with the Open Build Service. If you create an app from OBS in Bodega, you just have to take the yaml file and fill in the missing details, adding screen shots for example. Bodega will not pull the package from OBS and store it somewhere. Instead it simply uses the one-click-install and when a user clicks on the install button, it sends the one-click-install file through. It thus does not interfere with updates, but it can show users that a new version is available and let them update from Bodega if they want.

Packagers still have to add their apps to the store but we could kickstart Bodega with the apps already shipped in openSUSE, using the Appstream metadata. Non-official repos can then be added and so on. It would be quite easy to import all of the openSUSE packages. Same with the and documentation and drivers (it can show “developer: nvidia” so users know to trust it). And if there is a new revision of the documentation, Bodega can take care of that, just like it handles software updates (through zypper of course).

This is where you can come in: the team is looking for help in this area and if you are interested in making this happen, come talk to the Bodega folks! You can find them on the active mailing list or the #plasma active channel on Freenode.

Done


Famous books included!

You might be eager to find out what is there, today. Well, if you’ve seen the screenshots to the side, you know there is an app to access the store. It is build for touch screens but works just fine and you can get it in openSUSE through software.opensuse.org. Once installed, you can fire it up typing “active-addons” in a run command dialog.

Shawn Dunn (of cloverleaf fame) is putting together a more traditional desktop UI, while maintaining these packages as well. You will be able to have a conversation with him as he’s going to be at the openSUSE Conference in Dubrovnik this month where he will present a session about Bodega! He is known as SFaulken online and pretty much always hangs in the #opensuse-kde channel on Freenode where you can ask how to get things running or how to help him break stuff anytime. He’s also yelling at the world on google plus.

Bodega now contains the entire book set of Project Gutenberg (thousands of awesome, free books) as well as a number of wallpapers and applications. Aaron:

There is work to be done to include all openSUSE Software in Bodega. The store can use a little work too, but is based on QML which makes it very easy to improve. If you’re interested in helping out, let us know!

You can contact Aaron on IRC as aseigo in the #plasma active channel on Freenode, ping him on Google+ or shoot him a mail on aseigo on the KDE.org servers.

rsync.opensuse.org down, take two

March 17th, 2014 by

After the outage 1 month ago, it seems rsync.opensuse.org has similar hardware problems again.

Server
Again we did not see any output on the serial console any more and even a power cycle did not reanimate the system.

As the hardware is located in the data center of our sponsor IP Exchange, we apologize for the delay it will take to fix the problem: we just need a field worker at the location who has the appropriate permissions and skills.

During the downtime (and maybe also a good tip afterward), please check on http://mirrors.opensuse.org/ for the closest mirror nearby your location that also offers rsync for you.