Here you can find all kinds of wonderful information about Infra projects and infrastructure updates
Posted on: 2026-07-23 00:00:00+00:00
Welcome to Inside Infra for July, 2026
The July Roundtable featured a presentation by Clay Johnson of Gradle Technologies on Predictive Test Selection, which can propose a subset of a project's test to cover only those modules and functions that the most recent commit may affect. This can dramatically …
Posted on: 2026-06-20 00:00:00+00:00
Welcome to Inside Infra for June, 2025
The June Roundtable focused on release automation, with Piotr Karwasz presenting, using the Apache Log4j release process as an example. A PDF of his slide deck is attached to the minutes page at Infra Roundtable 2026-06-03.
The coming roundtables will be
Posted on: 2026-05-22 00:00:00+00:00
The May 6 Roundtable focused on AI coding and its implications for ASF infrastructure.
To start, Andrew Musselman of the Tooling team described a tool he has developed to do a security scan of software in development. The tool inspects a potential …
Posted on: 2026-04-24 00:00:00+00:00
The April 1 Roundtable focused on the migration of the ASF's Confluence Wiki and Jira services from local instances to the cloud. This move is necessary because our use of both services far outstrips what the local instances were designed to handle …
Posted on: 2026-03-20 00:00:00+00:00
The presenter for the March roundtable was unavailable at the last moment, so Drew Foulks took the chair with a series of questions under the heading: "How can Infra present itself even better than it is doing now?"
People made suggestions and …
Posted on: 2026-03-20 00:00:00+00:00
Trivy, Agua Security's open-source vulnerability scanner, appears to have experienced a security incident March 19, 2026, based on the details available here: stepsecurity.io/blog/trivy-compromised-a-second-time---malicious-v0-69-4-release
ASF Infrastructure and ASF Security have provided the following summary based on what we believe to be true:
Posted on: 2026-02-23 00:00:00+00:00
Welcome to Inside Infra for February, 2026
At the February Roundtable, Jarek Potiuk talked about the dependency tracker he developed for Apache Airflow, and how he used AI to help with developing the tool.
Airflow builds multiple versions of its product from one common repository. Each version has a …
Posted on: 2026-02-03 00:00:00+00:00
Note March 12, 2026: the issue described below is resolved in Apache Maven version 3.9.13. The workarounds are still valid for those who have not yet updated to 3.9.13.
Apache Maven 3.9.12 has a change that causes a problem in repository.apache.org (the …
Posted on: 2026-01-22 00:00:00+00:00
Welcome to Inside Infra for January, 2026
There was no January Roundtable.
The next Roundtable will be Wednesday, February 11, 2026, 1800 UTC (moved one week because so many people will be involved in FOSDEM at the start of the month). Jarek Potiuk will be presenting on the software …
Posted on: 2026-01-21 02:23:56+00:00
At the end of 2023, Infra conducted a survey, looking for feedback on how the team and the ASF infrastructure are working. It was good to see that, for instance, 95% of respondents felt that Infra offers adequate technical services for their project. The full report on responses is at …
Posted on: 2025-12-30 00:00:00+00:00
Welcome to Inside Infra for December, 2025
The December roundtable was about the massive DDOS (distributed denial of service) attack the ASF experienced starting November 10. There was a massive increase in access attempts to Jira, Confluence and other services. For example, The ASF's Jira instance normally has 1000 connections …
Posted on: 2025-11-24 00:00:00+00:00
*Welcome to Inside Infra for November, 2025
The November Roundtable featured a demonstration of the current state of a new multi-factor authentication (MFA) system which Infra hopes to bring live soon The system is working from end to end, but a lot of automation needs to be completed before …
Posted on: 2025-10-23 00:00:00+00:00
Welcome to Inside Infra for October, 2025
The October Roundtable featured Drew Foulks presenting on "Infra 101", a presentation he also gave at Community Over Code.
The general discussion included questions and speculation about using AI to simplify build processes, and in other project tasks.
The full summary, including …
Posted on: 2025-10-09 00:00:00+00:00
Danny Angus became VP-Infra in 2025, succeeding Myrle Krantz
I have no relevant qualification. I'm basically self taught; From books initially, then the internet. Participating in ASF projects has been a very important part of my learning, and that continues today.
I have been a …
Posted on: 2025-10-07 00:00:00+00:00
The ASF Infrastructure team returned to full strength on September 22, 2025 when Bob Thomson joined the team as a systems administrator.
Where do you live?
The Dordogne, southwest France. I am a Scot, though, from Glasgow, and lived in and around the city for my first 50 years, before …
Posted on: 2025-09-30 00:00:00+00:00
Welcome to Inside Infra for September, 2025
The Infrastructure team was busy at Community over Code in Minneapolis this month. The team gave a track of presentations, had a host of valuable hallway conversations, and even hosted the first-ever Games Night at an ASF convention …
Posted on: 2025-08-26 00:00:00+00:00
The August Roundtable discussed the impact of AI scraping on The ASF, and what responses to it might be useful.
The main impacts on ASF infrastructure are:
Posted on: 2025-07-23 00:00:00+00:00
Welcome to Inside Infra for July, 2025
Roundtable
At the July Roundtable, Daniel Gruno presented on the catalog server, now in development: catalog-test.apache.org/lookup/project. The plan is to move all metadata that the Foundation and projects use into one place for reference and research:
Posted on: 2025-06-23 00:00:00+00:00
Welcome to Inside Infra for June, 2025
Discussions at the June Roundtable covered, among other things:
Posted on: 2025-05-23 00:00:00+00:00
There was no roundtable in May. The next roundtable will be Wednesday, June 4, 2025, 1700 UTC. The main topic will be a presentation on JFrog and Artifactory, a universal binary repository manager that enables teams to store, manage, and organize software …
Posted on: 2025-04-23 00:00:00+00:00
The April roundtable was an 'open mic' session, to which people were encouraged to bring their fascinating or festering issues. Topics included:
Posted on: 2025-03-27 00:00:00+00:00
Welcome to Inside Infra for March, 2025
The next Infra roundtable will be Wednesday, April 2, 2025, 1700 UTC. This will be an "ask us anything" day, so feel free to bring any infrastructure issue that you find interesting/puzzling/scary.
For details about how to join a roundtable, and …
Posted on: 2025-02-25 00:00:00+00:00
There is now a management …
Posted on: 2025-01-21 00:00:00+00:00
Welcome to Inside Infra for January, 2025
The January roundtable took place Wednesday, January 8, 2025. The main topic was a deep dive into asf.yaml, the Swiss Army Knife of ASF build utilities.
The next version of .asf.yaml addresses a number of headaches with the first version, such …
Posted on: 2024-12-21 00:00:00+00:00
Welcome to Inside Infra for December, 2024
The December roundtable did not take place due to presenter illness. We have pushed its topic to next month. That roundtable will be Wednesday, January 8, 2025, 1700 UTC. The main topic will be a deep dive into asf.yaml, the Swiss Army …
Posted on: 2024-11-28 00:00:00+00:00
Welcome to Inside Infra for November, 2024
Infra held two Roundtables this month. The November 6 meeting was at 1700 UTC (more convenient for folks in Europe and North America) and the meeting on the 13th was at 1000 UTC in hopes that ASF folks in Asia …
Posted on: 2024-10-27 00:00:00+00:00
Welcome to Inside Infra for October, 2024
We are seeing a sharp increase in 'phishing attempts', fake emails pretending to come from various ASF groups and committees. Infra has some anti-phishing advice to help you avoid falling for these fake messages.
Posted on: 2024-09-20 00:00:00+00:00
Welcome to Inside Infra for September, 2024
Chis Thistlethwaite, who has been an important part of the Infrastructure team for almost nine years, is moving on to another project. His last day of work at The ASF is October 11, 2024.
Chris will be at Community over …
Posted on: 2024-08-23 00:00:00+00:00
Welcome to Inside Infra for August, 2024
The Qbot assistant in the ASF Slack workspace is continuing to evolve. The latest addition is Lauren, a member of the imaginary ASF Human Resources department. Lauren occasionally appears in Infra team conversations, and we thought it would be fair …
Posted on: 2024-08-13 00:00:00+00:00
25 years ago, it was somewhat difficult for people to put personal content onto the web, so the ASF provided that feature for our committers. It was first known as people.apache.org and later as home.apache.org. Many ASF committers have made use of the service, and it …
Posted on: 2024-07-22 00:00:00+00:00
Welcome to Inside Infra for July, 2024.
The Infrastructure team's Qbot is a Slack assistant that can simplify both important and frivolous tasks on Slack channels in the the-asf workspace. It can support requests in channels for PMCs, ASF committees, the ASF Board and …
Posted on: 2024-06-24 00:00:00+00:00
Welcome to Inside Infra for June, 2024.
A change to website creation and builds for projects
Many ASF projects, and the Infrastructure team, have been using the ASF-pelican template and service to build and deploy their websites. Infra has decided to deprecate its customized buildsite offerings in favor of those …
Posted on: 2024-05-24 00:00:00+00:00
Welcome to Inside Infra for May, 2024.
The May 2024 Roundtable took place on May 8. The topic of the day was "STeVe for projects: how PMCs can use the STeVe voting tool".
Infra member Chris Wells reviewed what Apache STeVe is for, and the many voting situations it …
Posted on: 2024-04-25 00:00:00+00:00
Welcome to Inside Infra for April, 2024.
The dashboard, at infra-reports.apache.org, provides a collection of reports on the overall health and activity of the infrastructure at the ASF. These reports can be helpful in understanding the status of all the ASF 'under the hood' resources …
Posted on: 2024-03-23 00:00:00+00:00
Welcome to Inside Infra for March, 2024.
Due to misconfigurations in their builds, some projects have been using unsupportable numbers of GitHub Actions. As part of fixing this situation, Infra has added a 'resource use' section to the policy on GitHub Actions. This …
Posted on: 2024-02-20 00:00:00+00:00
Hello, all!
Our very unscientific poll showed that "Inside Infra" has the most support as a name for this newsletter, so that is what we shall be.
Note: in 2020 the main ASF blog published a series of interviews with Infra team members also called "Inside Infra". Links …
Posted on: 2024-02-13 00:00:00+00:00
More than 50 people posted responses to our 2023 'year in review' survey. Here is a summary of the responses to questions and the comments added in each section.
We're grateful to those who took the time to fill out the survey. Without feedback like this, the Infra team can …
Posted on: 2024-01-20 00:00:00+00:00
Hi, all!
Someone who responded to our annual survey (see below) suggested that we start a newsletter to share developments and other news. The suggester thought we should send it to the dev@ list of every PMC and PPMC, but we are going to start with a more limited distribution …
Posted on: 2023-11-17 01:55:55+00:00
Committers, contributors, and ASF Members have a wealth of information about every aspect of software and community development. When we share our knowledge, its reach multiplies and our effectiveness increases.
For the infrastructure that supports all our efforts at the ASF, here are some ways to share what you know …
Posted on: 2023-09-29 00:00:00+00:00
Gradle, a longtime leader in developer productivity and build analytics, has become a platinum-level sponsor of the ASF. The ASF instance of Develocity, formerly Gradle Enterprise, is at https://develocity.apache.org.
Develocity is a suite of acceleration and analytics …
Posted on: 2023-03-01 00:00:00+00:00
Greetings all!
We're announcing a new look for selfserve.apache.org today! It's a completely updated site, featuring a new layout which we hope will suit everyone better. The new update also cleans up a some tech debt we've had with the old site, so adding new features or integrations …
Posted on: 2023-01-11 00:00:00+00:00
I'd like to thank everyone who took time to take the survey. This is the first time that I know of that we've tried something like this, and feedback is very important. I'd also like to take a second to clarify my tone for this article. I'm presenting as …
Posted on: 2022-12-01 00:00:00+00:00
In discussions at ApacheCon in New Orleans, we learned that the three standard methods of communicating with Infra:
#asfinfra Slack channelare not ideal for many conversations folks would like to have about The ASF's infrastructure.
Posted on: 2022-11-21 00:00:00+00:00
This afternoon, we rolled out two new Shared Jenkins Nodes, jenkins-win-azr-7 and 8. They are both in rotation, using the labels Windows and Windows-Docker. The second label was put in place as the older nodes can't run Docker Desktop. I've also tried setting these up by cloning disks instead of …
Posted on: 2022-11-11 16:48:00+00:00
Today, the Infrastructure Team took the step to disable public signups to ASF Jira
This was not done lightly. The main reason for this is the amount of spam and spam accounts that are created every day, it has made managing Jira a big effort. In addition, Infra are planning …
Posted on: 2022-10-24 12:54:00+00:00
Just moved posts over from blogs.apache.org/infra. New posts all go through the infrastructure-website repo and it should be as easy as posting some markdown.
Posted on: 2022-07-13 16:41:38+00:00
July 13, 2022
At around 09:11 UTC on Tuesday, July 12th 2022, the primary mailing list server (colloquially known as Hermes) at The Apache Software Foundation suffered a fatal breakdown and became unresponsive.
The Infrastructure team (Infra) was immediately notified and, in cooperation with our data center provider, attempted …
Posted on: 2022-06-27 12:51:54+00:00
Since before the start of COVID-19, the Infrastructure team had one open staff position. We have been able to fill it this year with a strong addition to the team, Chris Wells.
Where do you live?
Birch Run, Michigan, USA. I was born in Flint, Michigan, but I have moved …
Posted on: 2022-04-04 07:48:50+00:00
As we head into April and the middle of the spring of 2022, we are pleased to announce that we have migrated our writable git repository service, gitbox.apache.org, to a new location, a new cluster of hardware bits, and a new platform. The migration took around 35 minutes …
Posted on: 2020-10-21 13:35:19+00:00
Available as of yesterday, more self serve features were added to the .asf.yaml toolset, based around GitHub Branch Protection.
You can now add the following features :-
Posted on: 2020-07-15 13:29:54+00:00
The Infrastructure team is constantly looking for ways to do its work more quickly while maintaining the ASF standards of reliability, security, and almost-continuous availability. The more the team can speed up and improve standard processes that almost every project goes through, the better it is for the whole community …
Posted on: 2020-04-19 22:50:14+00:00
Today, ASF Infra launched new features for projects wishing to update their notification schemes for git/github activity on their own.
Via the .asf.yaml file, projects can now define notification schemes for their repositories, including targets for commit emails, GitHub events, and Jira notification options.
Along with this notification …
Posted on: 2020-03-04 15:43:06+00:00
Infra member Daniel Gruno writes:
To better provide our millions of users with downloads, the Apache Infrastructure Team has been restructuring the way downloads work for our main distribution channels over the past few weeks. For users, this will largely go unnoticed, and for projects likely the same; but we …
Posted on: 2020-02-25 22:16:59+00:00
After some bumpy DNS issues, Roller 6.0 is live!
Posted on: 2020-01-05 18:54:30+00:00
The Infrastructure team (Infra) works behind the scenes to make it possible for Apache's galaxy of committers to do the cool stuff they do, and for the open-source world to get, use, and rely on applications Apache projects produce. Infra supports additions to code repositories, a constant stream of conversation …
Posted on: 2019-09-10 21:36:35+00:00
On August 31st 2019, the machine hosting our subversion-to-git mirrors and synchronization process for GitHub suffered a catastrophic drive error due to a power failure at our data center in Virginia. The power failure was, unfortunately, of such a nature, that recovering the disk data was not possible …
Posted on: 2019-04-30 01:08:58+00:00
With the news of the Apache Software Foundation teaming up more closely with GitHub, we feel it natural to elaborate a bit on what has been going on and what this means for you as a committer and/or user of Apache software.
Posted on: 2019-01-27 18:20:54+00:00
Over the past few days we have implemented rate limiting on selected services across the ASF.
As our foundation grows, so do the number of users and robots utilizing our services. In order to accommodate as many as possible with what resources we have, we have opted to implement rate-limiting …
Posted on: 2019-01-10 05:08:48+00:00
We've updated blogs.a.o to the latest version of Roller, 5.2.2!!
Posted on: 2018-12-07 17:33:33+00:00
[IF YOUR PROJECT DOES NOT HAVE GIT REPOSITORIES ON GIT-WIP-US PLEASE DISREGARD THIS POST]
Hello Apache projects,
I am writing to you because you may have git repositories on the git-wip-us server, which is slated to be decommissioned in the coming months. All repositories will be moved to the new …
Posted on: 2018-09-17 07:55:22+00:00
The Apache Software Foundation (ASF) seeks to fill an Infrastructure Systems Administrator position. You will be responsible for working with the existing technical infrastructure team. The ASF manages a world-wide network of open source software …
Posted on: 2017-03-26 01:07:08+00:00
When it comes to [Jenkins], it has long been known that [polling must die].
While we could go and create post commit hooks in all the ASF hosted Git repositories, that is something that realistically is just creating an added maintenance burden.
In any case, we have [GitPubSub].
The question …
Posted on: 2017-01-01 08:06:46+00:00
Hi All,
blogs.apache.org - the site you are reading now! has had a bit of an update.
1. We moved it from an aged VM Host to the Cloud (thanks LeaseWeb!)
2. We puppetised the entire service, from install to deploy (see our GitHub Mirror )
3. We upgraded the …
Posted on: 2016-07-25 20:07:36+00:00
UPDATE: We have received enough applicants at this time. Thank you all for your interest.
The Apache Software Foundation (ASF) seeks to fill an Infrastructure Systems Administrator/Architect position. You will be responsible for working with the existing technical infrastructure team, and VP of Infrastructure at the Apache Software Foundation …
Posted on: 2016-06-30 16:25:30+00:00
As people have noticed, our JIRA instance (arguably the largest public instance in the world) has been suffering from a yet unknown issue as of late. We are reasonably sure that this is related to specific queries being made against the instance (possibly automated queries from scrapers), but have yet …
Posted on: 2016-02-12 19:45:06+00:00
The ASF Infrastructure team is happy to announce that projects can how have AppVeyor CI setup on their GitHub mirrors.
The only thing you need to do is create an INFRA ticket at issues.apache.org with the following information:
Posted on: 2015-10-19 18:30:41+00:00
My name is Daniel Takamori and I'm so happy to be joining the Infra team here at Apache. I'm from Oregon in the United States and really enjoy the rain. While at Oregon State University I studied mathematics and physics with a lean towards error correcting codes and mathematical modelling …
Posted on: 2015-08-19 19:19:38+00:00
Posted on: 2015-08-03 23:07:37+00:00
There will be a planned reboot of Jira on Friday 7th August at 00:00 UTC.
This is 72 hours notice as recommended in our Core Services planned downtime SLA.
Currently, Jira requires a reboot when adding new projects to it. There is an outstanding
ticket with Atlassian about this …
Posted on: 2015-07-14 16:05:02+00:00
As some of you are aware, there have been some issues syncing changes from repositories on https://git-wip-us.apache.org to the mirrors on GitHub.
The issues we are seeing:
Posted on: 2015-06-29 21:17:45+00:00
Update (2015-06-30 ~12.00 UTC):
The replacement buildbot master is now live. The CMS service and the ci.apache.org website have been restored. The project CI builds are mostly working but builds that upload docs, snapshots etc. to the buildmaster for publishing are likely to fail at the upload …
Posted on: 2015-06-10 08:32:13+00:00
Hi All,
There will be a planned reboot of Confluence on Friday 12th June at 18:00 UTC+1
This is a blog post notice as recommended in our Core Services planned downtime SLA.
The Confluence wiki service configuration is stored in our Puppet configuration.
We have made some modifications …
Posted on: 2015-05-18 15:28:11+00:00
Hi All,
There will be a planned reboot of Jira on Thursday 21st May at 16:00 UTC+1
This is 72 hours notice as recommended in our Core Services planned downtime SLA.
Currently, Jira requires a reboot when adding new projects to it. There is an outstanding
ticket with …
Posted on: 2015-05-08 21:12:11+00:00
For the past few months the Infrastructure team have been working extremely hard to re-design, implement and manage changes to the email service architecture. Today we are proud to announce that phase 1 of this has been completed, and has been running for several days now.
Phase 1 covers all …
Posted on: 2015-04-29 23:02:29+00:00
As some of you may have already encountered, certain services within Apache appear to have broken SSL support. While the cert is still valid, there is a part of the cert that both Microsoft and Google have stopped accepting as valid. We are working on fixing this and will use …
Posted on: 2015-04-29 21:29:31+00:00
If you have worked on a web site for an Apache project, you've probably come across the fact that everything has to be in Subversion for web sites. The reason for this has been the desire to have a unified standard for publishing web site contents across all projects. The …
Posted on: 2015-04-15 20:32:10+00:00
Travis-CI is a distributed continuous integration platform that integrates well with projects on GitHub. As many of our projects are taking advantage of our GitHub integration, they're also making use of Travis-CI for testing of inbound patches.
Travis CI offers a free account for open source projects, with a built …
Posted on: 2015-04-13 20:21:14+00:00
As part of our ongoing efforts to streamline our service offerings, and to make it easier to interact with the Infrastructure team we are launching an instance of JIRA Service …
Posted on: 2015-02-27 13:08:05+00:00
Things change, even within the ASF.
One of these changes is to our infrastructure, and is a move from manually managed and maintained web servers towards re-deployable, configuration managed servers that tend to themselves and rarely, if ever, require manual intervention. As such, we have started moving towards no longer …
Posted on: 2015-01-12 15:02:12+00:00
Folks,
Please note than on Thursday 15th at 20:00 UTC the Infrastructure team
will be taking the read/write git repositories offline. We expect
that this migration to last about 4 hours.
During the outage the service will be migrated from an old host to a
new one. We …
Posted on: 2014-12-09 09:58:37+00:00
Summary
On Wednesday December 3rd the main US host for the ASF subversion service fails resulting in loss of service. This loss of subversion service prevent committers from submitting any changes, and whilst we have an EU mirror it is read-only and does not allow for any changes to be …
Posted on: 2014-12-03 17:52:32+00:00
The primary master machine that hosts the Apache Software Foundation's subversion repositories is currently undergoing some emergency maintenance due to disk errors.
We do not currently have an ETA on when this will be fixed.
In the meantime, there will be no access to commit to SVN.
The read-only mirror …
Posted on: 2014-11-21 12:17:17+00:00
In recent months we have become increasingly aware of a slowing down of our MoinMoin wiki service. We have attributed this, at least in part, due to the way MoinMoin stores some …
Posted on: 2014-10-06 16:36:09+00:00
The ASF Infrastructure team is pleased to announce the availability of a new code signing service for Java, Windows and Android applications. This service is available to any Apache project to use to sign their releases. Traditionally, Apache projects have shipped source code. The code tarballs are signed with a …
Posted on: 2014-10-02 13:00:00+00:00
The ASF Infrastructure team is happy to announce that you can now set up jobs on builds.apache.org to listen for pull requests to github.com/apache repositories, build that pull request’s changes, and then comment on the pull request with the build’s results. This is done …
Posted on: 2014-09-25 23:38:41+00:00
Apache committers are granted shell access to a host known as either people.apache.org or minotaur. As you may know, there has been a two year grace period in which we have advertised the upcoming change away from password logins to SSH key only.
Due to a significant recent …
Posted on: 2014-09-25 22:57:44+00:00
For a very long time now we have allowed committers to send email from their @apache.org email address from any host. 10 years ago this was less of an issue than it is today. In the current world of mass spam and junk flying around, mail server providers are …
Posted on: 2014-09-11 09:19:46+00:00
HI All,
So Tuesday morning we got a report in IRC that a committer was trying to get a release out
and could not deploy. Shortly after a Nexus issue was reported in Jira INFRA-8321. A few
hours later another issue INFRA-8322 related to Nexus was opened. So far, nothing …
Posted on: 2014-09-04 13:00:00+00:00
Posted on: 2014-08-18 13:00:00+00:00
As the Apache Software Foundation (ASF) has grown, the infrastructure required to support its diverse set of projects has grown as well. To care for the infrastructure that the ASF depends on, the foundation has hired several contractors to supplement the dedicated cadre of volunteers who help maintain the ASFs …
Posted on: 2014-08-14 13:45:53+00:00
We are pleased to announce that we have a new status page for our infrastructure and the ASF as a whole.
Where we have previously been focused on reporting the up/down status of our services, we have now begun to look a bit more at the broader picture of …
Posted on: 2014-06-15 02:29:06+00:00
Good news! We've finally laid the necessary groundwork to extend the bypassing of committer emails sent from their apache.org addresses, from commit lists to now all Apache mailing lists. This feature was activated earlier today and represents a significant benefit for cross-collaboration between Apache mailing lists for committers, relieving …
Posted on: 2014-06-03 21:57:08+00:00
Note: This page, including the update note, were correct when written, but are now out of date. A description of the situation related to DMARC and DKIM as of November, 2025 is available on this wiki page: cwiki.apache.org/confluence/display/INFRA/DMARC+and+DKIM+for+ASF+mail.
Note …
Posted on: 2014-05-28 05:16:39+00:00
Overview:
During the afternoon of May 6th we began experiencing delays in mail delivery of 1-2 hours. Initial efforts at remediation seemed to clear this up but on the morning of May 7th the problem worsened and we proactively disabled mail service to deal with the failure. This outage affected …
Posted on: 2014-05-23 22:29:12+00:00
23 may 2014 the old monitoring system "nagios" was put to sleep, and "circonus" was given production status.
The new monitoring system is sponsored by circonus and most of the monitoring as well as the central database runs on www.circonus.com. The infrastructure team have built and deployed logic …
Posted on: 2014-05-07 14:48:16+00:00
During the afternoon of May 6th we began experiencing delays in mail delivery of 1-2 hours. Initial efforts at remediation seemed to clear this up but on the morning of May 7th the problem worsened and we proactively disabled mail service to deal with the failure. The underlying hardware suffered …
Posted on: 2014-04-11 20:25:44+00:00
Remain calm.
What we've learned about the heartbleed incident is that it is hard, in the sense of perhaps only viable to a well-funded blackhat operation, to steal a private certificate and key from a vulnerable service. Nevertheless, the central role Apache projects play in the modern software development world …
Posted on: 2014-03-25 18:23:50+00:00
Links to suggestions for setting up a project website, and website guidelines, are available under "PMC resources" in the general Infrastructure documentation page.
The original focus of the CMS …
Posted on: 2014-02-12 01:16:30+00:00
After a few weeks of hard work and mind-boggling debugging, we are pleased to announce tighter and smarter integration between GitHub and the Apache Software Foundation's infrastructure.
These new features mean a much higher level of replication and retention of what goes on on GitHub, which in turns both help …
Posted on: 2013-03-06 18:37:42+00:00
Note: As of May, 2024, Apache Paste is no longer available.
Today, the Apache Infrastructure team launched http://paste.apache.org, a new ASF-driven site for posting snippets, scripts, logging output, configurations and much more and sharing them with the world.
Why yet another paste bin, you ask?
Well, for …
Posted on: 2012-07-26 02:35:47+00:00
Since out last update over a year ago, the Infra Team has expanded by another NINE (9) members!
Congrats and our warmest thanks go to:
Niklas Gustavsson - (ngn)
Jeremy Thomerson - (jrthomerson)
Mark Struberg - (struberg)
Eric Evans - (eevans)
Brandon Williams - (brandonwilliams)
Mohammad Nour El-Din - (mnour)
David Nalley - (ke4qqq)
Yang Shih-Ching - (imacat …
Posted on: 2012-07-09 16:49:30+00:00
Daniel Gruno has recently developed a comments system for Apache projects to use. The purpose of the system is to enable public commentary on project webpages and is already in production use in the httpd and trafficserver projects. This new system …
Posted on: 2012-06-24 13:37:50+00:00
Links to suggestions for setting up a project website, and website guidelines, are available under "PMC resources" in the general Infrastructure documentation page.
Two new features have recently been …
Posted on: 2012-06-09 21:45:27+00:00
Consider the following snippet taken from a live CGI script running on the host that serves www.apache.org:
#!/usr/bin/perluse strict; use warnings;
print "Content-Type: text/html\n\n"; my $artifact = "/apache-tomee/1.0.1-SNAPSHOT/"; $artifact = $ENV{PATH_INFO} if $ENV{PATH_INFO};
$artifact = "/$artifact/"; $artifact =~ s,/+,/,g; $artifact …
Posted on: 2012-05-29 16:59:09+00:00
Last week, internal audit activity discovered that the access logs of some committer-only Apache services contained passwords but had been available to every Apache committer.
The httpd logs of several ASF services are aggregated and archived on minotaur.apache.org. Minotaur is also people.apache.org, the shell …
Posted on: 2012-03-10 17:28:05+00:00
Links to suggestions for setting up a project website, and website guidelines, are available under "PMC resources" in the general Infrastructure documentation page.
Recently we've been working with the …
Posted on: 2012-02-26 02:23:56+00:00
Links to suggestions for setting up a project website, and website guidelines, are available under "PMC resources" in the general Infrastructure documentation page.
Over the past few months the …
Posted on: 2011-12-11 20:30:33+00:00
A few projects have requested it, now it is here! Check out https://translate.apache.org and get your project added.
See also https://cwiki.apache.org/confluence/display/INFRA/translate+pootle+service+auth+levels for more information - you will see that general public non-logged in users can submit translate …
Posted on: 2011-04-15 05:32:23+00:00
Any projects in the position of being able to release via PEAR packages can now do so hosted officially on ASF servers.
http://pear.apache.org is now up and running and ready to serve!
Posted on: 2011-03-22 10:09:45+00:00
Well, some are not exactly new faces, but since our last blog update of new infra members in 2009 , we have conned with promises of fame, fortune and beer the following new additions to the infra team:
Posted on: 2011-02-24 21:13:18+00:00
In the near future the Infrastructure team will be implementing a change to the way we handle emails for all committers.
Historically we have allowed users to choose how to handle their apache.org email. However we will be making the following changes:
Posted on: 2011-01-27 15:37:21+00:00
Committers,
The Infrastructure Team has just enabled a new feature to control your SpamAssassin Threshold for your apache.org account. The default score for user delivery has always remained at 10, but with this new feature you can lower that score to anything you want. Many people with older accounts …
Posted on: 2011-01-14 16:36:42+00:00
Folks,
The infrastructure team are pleased to announce the availability of id.apache.org the new password management tool for all ASF committers and members. This new service will allow users to:
Posted on: 2010-12-17 06:38:50+00:00
As of approximately 03:00 (UTC) today the infrastructure team have enabled a password policy for all LDAP accounts.
This policy has been implemented at the LDAP infrastructure level and will affect all users. It has been deployed using OpenLDAP's password policy schema, and overlay.
At the time of launch …
Posted on: 2010-12-02 04:25:43+00:00
Links to suggestions for setting up a project website, and website guidelines, are available under "PMC resources" in the general Infrastructure documentation page.
Over the past 3 months, the …
Posted on: 2010-10-26 03:25:49+00:00
Note The ASF ReviewBoard instance is unavailable after 31 March, 2026.
We know we have projects that use reviewboard externally to the ASF; we also have some projects using codereview.appspot.com and we also have some projects using Fisheye/Clover externally.
Well, due to popular request, we now have …
Posted on: 2010-09-23 11:55:55+00:00
Yesterday, the main ASF SVN code repository passed the 1 million commit mark. Shortly thereafter one of the ASF members enquired as to how he could best grab the SVN log entries for all of these commits. As always, there were a bunch of useful replies, but they were all …
Posted on: 2010-07-19 04:01:07+00:00
This weekend we rolled out a new server, a Dell Power Edge R410, named Eos, to host the Apache.org websites and MoinMoin wiki:
Posted on: 2010-06-11 17:17:46+00:00
Today we've brought s.apache.org online. It's a URL shortening service that's limited to Apache committers- the people who write all that Apache software! One of the main reasons we're providing this service is to allow committers to use shortened links whose provenance is known to be a trusted …
Posted on: 2010-04-13 05:04:50+00:00
Apache.org services recently suffered a direct, targeted attack against our infrastructure, specifically the server hosting our issue-tracking software.
The Apache Software Foundation uses a donated instance of Atlassian JIRA as an issue tracker for our projects. Among other projects, the ASF Infrastructure Team uses it to track issues and …
Posted on: 2010-03-29 10:25:59+00:00
Here at the ASF we have a subversion setup with all our projects code in one repository, with each of those projects having their own style of trunk/branches/tags/site etc.. This works well for us, but did present us with some initial problems when setting up our Buildbot …
Posted on: 2010-03-04 22:03:23+00:00
The ASF Buildbot CI instance has just launched two more secondary servers, expanding the range of platforms it can build and test on.
Added are servers on the FreeBSD 8 platform (a VM on the Nyx VMware host) and a Solaris Zone.
Projects are welcome to create an Infra issue …
Posted on: 2010-02-22 22:17:39+00:00
When we decided some time ago to start using LDAP for auth{n,z} we had to come up with a sane structure. This is what we have thus far:
dc=apache,dc=org
| ou=people,dc=apache,dc=org
| ou=groups,dc=apache,dc=org
| ou=people,ou=groups …
Posted on: 2010-02-22 22:03:20+00:00
The infrastructure team have now completed the next stage of the planned LDAP migration.
We have migrated our old SVN authorisation file, and POSIX groups into LDAP data. SVN access control is now managed using these groups.
This means to change access the Subversion repositories is now as simple as …
Posted on: 2010-02-17 00:41:04+00:00
Tonight we enabled a pair of Intel X25-M's to serve as l2arc cache for the zfs array which contains all of our svn repositories. Over the next few hours as these SSD's start serving files from cache, the responsiveness and overall performance of svn on eris (our master US-based server …
Posted on: 2009-11-09 13:01:12+00:00
The below information has just been published to the main ASF Buildbot URI ci.apache.org/buildbot.html.
A summary of just some of the things the ASF Buildbot can do for your project:
Posted on: 2009-10-12 01:53:03+00:00
In the first week of October we started getting reports of performance issues, mainly connection timeouts, on all of our services hosted at https://issues.apache.org/. On further inspection we noticed a huge amount of "Browser disconnect" errors in the error log right at the beginning of the ssl …
Posted on: 2009-09-02 08:56:09+00:00
Last week we posted about the security breach that caused us to temporarily suspend some services. All services
have now been restored. We have analyzed the events that led to the breach, and continued to work on improving the security of our systems.
NOTE: At no time were any Apache …
Posted on: 2009-08-28 12:33:19+00:00
This is a short overview of what happened on Friday August 28 2009 to the apache.org services. A more detailed post will come at a later time after we complete the audit of all machines involved.
On August 27th, starting at about 18:00 UTC an account used for …
Posted on: 2009-08-01 12:24:57+00:00
One of the more common issues committers face at Apache is in trying to send mail from their apache.org account. We've just made that process a whole lot easier by setting up an SSL-enabled, smtp-auth based mail submission service on people.apache.org port 465; which is compatible with …
Posted on: 2009-07-15 06:59:48+00:00
Previously, to be able to preview a draft post by any Roller Blog, one had to be a member user of that …
Posted on: 2009-07-07 07:04:25+00:00
The ASF Infrastructure Team will be upgrading the Confluence instance powering http://cwiki.apache.org from Confluence 2.2.9 to Confluence 2.10.3 on July 11 at 0400 UTC, or July 10 at 2100 PST. The migration is expected to take several hours.
If you haven't already, this …
Posted on: 2009-05-21 16:01:19+00:00
Earlier this week the Infrastructure team rolled out phase one of the planned LDAP services.
We are using LDAP for authentication of shell accounts. For now this is the extent of the implementation, however the next phase should follow this quite quickly.
The next phase will involve moving to LDAP …
Posted on: 2009-05-03 22:22:57+00:00
Git is a new version control system that has been getting increasingly popular during the past few years. Many Apache contributors have also expressed interested in using Git for working with Apache codebases. While the canonical location of all Apache source code is our Subversion repository, we also want to …
Posted on: 2009-04-06 09:14:11+00:00
Established today, we now have a dedicated mailing list to talk about and work out all things to do with our build services. Currently infrastructure provides projects with use of Hudson, Continuum, Gump and now we have another option in Buildbot. Buildbot is a new service here at Apache Infrastructure …
Posted on: 2009-04-02 20:47:41+00:00
This week the ASF Infrastructure Team deployed one of the first major changes to how svn.apache.org works since it was launched, 6 years ago.
We now distribute Subversion traffic to our servers based on the geographic region of a client.
We are using pgeodns, the same software that …
Posted on: 2009-04-02 17:47:53+00:00
Last week (at ApacheCon 2009 EU) I gave a session talk about "Subversion on-the-fly Replication" and how we (ASF) deployed such an setup last year with in the Apache Software Foundation. So check out the slides if you are interested in how it works, why you should do it, what …
Posted on: 2009-03-26 16:56:58+00:00
As of this afternoon whilst at ApacheCon Europe 2009, we have gotten our initial LDAP platform in place ready for testing. This will allow us to move to a centralized AAA system.
Posted on: 2009-03-25 18:39:01+00:00
In preparation for upgrading Subversion to the latest version (1.6.0), we are running an svn dump on svn.apache.org. This will chew up enough disk IO to be noticeable to svn users. We expect the dump to finish sometime during this weekend.
Posted on: 2009-03-25 02:28:20+00:00
Over the past year the Infrastructure Team has grown to meet new challenges. Here is a list of the new folks on the team:
Congratulate these people on …
Posted on: 2009-03-23 00:29:41+00:00
Roller was installed today for the use of ASF Projects. Those committers with personal blogs should instead add their feed to planet …
Copyright 2026, The Apache Software Foundation, Licensed under the Apache License, Version 2.0.
Apache® and the Apache logo are trademarks of The Apache Software Foundation.