Home index (edit)

Welcome to the Infra Blog!

Here you can find all kinds of wonderful information about Infra projects and infrastructure updates

The Joy of Feedback (2022 Infra Survey)

Posted on: 2022-12-01 00:00:00+00:00

In discussions at ApacheCon in New Orleans, we learned that the three standard methods of communicating with Infra: 

  • opening a Jira ticket 
  • sending an email 
  • posting a message on the #asfinfra Slack channel    are not ideal for many conversations folks would like to have about The ASF's infrastructure.

Roundtable Discussions …

New Jenkins Nodes running Windows

Posted on: 2022-11-21 00:00:00+00:00

This afternoon, we rolled out two new Shared Jenkins Nodes, jenkins-win-azr-7 and 8. They are both in rotation, using the labels Windows and Windows-Docker. The second label was put in place as the older nodes can't run Docker Desktop. I've also tried setting these up by cloning disks instead of …

Jira Public Signup Disabled

Posted on: 2022-11-11 16:48:00+00:00

Today, the Infrastructure Team took the step to disable public signups to ASF Jira

This was not done lightly. The main reason for this is the amount of spam and spam accounts that are created every day, it has made managing Jira a big effort. In addition, Infra are planning …

Infra blogs has a new home

Posted on: 2022-10-24 12:54:00+00:00

Just moved posts over from blogs.apache.org/infra. New posts all go through the infrastructure-website repo and it should be as easy as posting some markdown.

Email service interruption and restoration July 12, 2022

Posted on: 2022-07-13 16:41:38+00:00

July 13, 2022

At around 09:11 UTC on Tuesday, July 12th 2022, the primary mailing list server (colloquially known as Hermes) at The Apache Software Foundation suffered a fatal breakdown and became unresponsive.

The Infrastructure team (Infra) was immediately notified and, in cooperation with our data center provider, attempted …

Strengthening the Infra team

Posted on: 2022-06-27 12:51:54+00:00

Since before the start of COVID-19, the Infrastructure team had one open staff position. We have been able to fill it this year with a strong addition to the team, Chris Wells.

Where do you live?

Birch Run, Michigan, USA. I was born in Flint, Michigan, but I have moved …

New and enhanced GitBox platform sees the light of day

Posted on: 2022-04-04 07:48:50+00:00

As we head into April and the middle of the spring of 2022, we are pleased to announce that we have migrated our writable git repository service, gitbox.apache.org, to a new location, a new cluster of hardware bits, and a new platform. The migration took around 35 minutes …

Even more Github features added to .asf.yaml

Posted on: 2020-10-21 13:35:19+00:00

Available as of yesterday, more self serve features were added to the .asf.yaml toolset, based around Github Branch Protection.

You can now add the following features :-

  • Github Branch Protection Enable/Disable
  • Require Status Checks to pass before merging
  • Require Branches to be up to date before merging
  • Context Status …

Promoting Podlings

Posted on: 2020-07-15 13:29:54+00:00

The Infrastructure team is constantly looking for ways to do its work more quickly while maintaining the ASF standards of reliability, security, and almost-continuous availability. The more the team can speed up and improve standard processes that almost every project goes through, the better it is for the whole community …

New notification scheme features for git repositories

Posted on: 2020-04-19 22:50:14+00:00

Today, ASF Infra launched new features for projects wishing to update their notification schemes for git/github activity on their own.

Via the .asf.yaml file, projects can now define notification schemes for their repositories, including targets for commit emails, github events, as well as JIRA notification options.

To utilize …

More secure and robust downloads

Posted on: 2020-03-04 15:43:06+00:00

Infra member Daniel Gruno writes:

To better provide our millions of users with downloads, the Apache Infrastructure Team has been restructuring the way downloads work for our main distribution channels over the past few weeks. For users, this will largely go unnoticed, and for projects likely the same; but we …

Another oar in the water

Posted on: 2020-01-05 18:54:30+00:00

The Infrastructure team (Infra) works behind the scenes to make it possible for Apache's galaxy of committers to do the cool stuff they do, and for the open-source world to get, use, and rely on applications Apache projects produce. Infra supports additions to code repositories, a constant stream of conversation …

Rate-limiting on Apache services

Posted on: 2019-01-27 18:20:54+00:00

Over the past few days we have implemented rate limiting on selected services across the ASF.

As our foundation grows, so do the number of users and robots utilizing our services. In order to accommodate as many as possible with what resources we have, we have opted to implement rate-limiting …

Position Available: Infrastructure Systems Administrator

Posted on: 2018-09-17 07:55:22+00:00

UPDATE:  We have received enough applicants at this time. Thank you all for your interest. 

The Apache Software Foundation (ASF) seeks to fill an Infrastructure Systems Administrator position. You will be responsible for working with the existing technical infrastructure team.  The ASF manages a world-wide network of open source software …

Bringing GitPubSub to the Apache Jenkins build server

Posted on: 2017-03-26 01:07:08+00:00

When it comes to [Jenkins], it has long been known that [polling must die].

While we could go and create post commit hooks in all the ASF hosted Git repositories, that is something that realistically is just creating an added maintenance burden.

In any case, we have [GitPubSub].

The question …

Position Available: Infrastructure Systems Administrator Architect

Posted on: 2016-07-25 20:07:36+00:00

UPDATE:  We have received enough applicants at this time. Thank you all for your interest. 

The Apache Software Foundation (ASF) seeks to fill an Infrastructure Systems Administrator/Architect position. You will be responsible for working with the existing technical infrastructure team, and VP of Infrastructure at the Apache Software Foundation …

ASF JIRA Outages and Troubleshooting

Posted on: 2016-06-30 16:25:30+00:00

As people have noticed, our JIRA instance (arguably the largest public instance in the world) has been suffering from a yet unknown issue as of late. We are reasonably sure that this is related to specific queries being made against the instance (possibly automated queries from scrapers), but have yet …

AppVeyor CI now available for GitHub Mirrors

Posted on: 2016-02-12 19:45:06+00:00

The ASF Infrastructure team is happy to announce that projects can how have AppVeyor CI setup on their GitHub mirrors.

 The only thing you need to do is create an INFRA ticket at issues.apache.org with the following information:

  • Repo Name
  • Mailing list to send build notifications to (optional …

Dear Apache

Posted on: 2015-10-19 18:30:41+00:00

My name is Daniel Takamori and I'm so happy to be joining the Infra team here at Apache.  I'm from Oregon in the United States and really enjoy the rain.  While at Oregon State University I studied mathematics and physics with a lean towards error correcting codes and mathematical modelling …

Planned downtime for ReviewBoard

Posted on: 2015-08-19 19:19:38+00:00

The ReviewBoard vm ran out of space and despite our best efforts to fix the space issue without restarting the service, that is the only option left.

The plan is to restart the vm on Thursday August 20th at 21:00 UTC (14:00 PDT), but if it fills up …

Planned downtime for Jira1

Posted on: 2015-08-03 23:07:37+00:00

There will be a planned reboot of Jira on Friday 7th August at 00:00 UTC.

This is 72 hours notice as recommended in our Core Services planned downtime SLA.

Currently, Jira requires a reboot when adding new projects to it. There is an outstanding
ticket with Atlassian about this …

Mirroring to GitHub issues

Posted on: 2015-07-14 16:05:02+00:00

As some of you are aware, there have been some issues syncing changes from repositories on https://git-wip-us.apache.org to the mirrors on GitHub.

The issues we are seeing:

  • Pull requests not being closed when they should be
  • Changes not being synced to the GitHub mirrors
  • Bots other than …

Buildbot master currently off-line

Posted on: 2015-06-29 21:17:45+00:00

Update (2015-06-30 ~12.00 UTC):

The replacement buildbot master is now live. The CMS service and the ci.apache.org  website have been restored. The project CI builds are mostly working but builds that upload docs, snapshots etc. to the buildmaster for publishing are likely to fail at the upload …

Confluence Wiki service to be restarted

Posted on: 2015-06-10 08:32:13+00:00

Hi All,

There will be a planned reboot of Confluence on Friday 12th June at 18:00 UTC+1

This is a blog post notice as recommended in our Core Services planned downtime SLA.

The Confluence wiki service configuration is stored in our Puppet configuration.

We have made some modifications …

Planned downtime for Jira

Posted on: 2015-05-18 15:28:11+00:00

Hi All,

There will be a planned reboot of Jira on Thursday 21st May at 16:00 UTC+1

This is 72 hours notice as recommended in our Core Services planned downtime SLA.

Currently, Jira requires a reboot when adding new projects to it. There is an outstanding
ticket with …

Mail Service Architecture Changes

Posted on: 2015-05-08 21:12:11+00:00

For the past few months the Infrastructure team have been working extremely hard to re-design, implement and manage changes to the email service architecture.  Today we are proud to announce that phase 1 of this has been completed, and has been running for several days now.

Phase 1 covers all …

Apache Services and SHA-1 SSL Cert deperecation

Posted on: 2015-04-29 23:02:29+00:00

As some of you may have already encountered, certain services within Apache appear to have broken SSL support. While the cert is still valid, there is a part of the cert that both Microsoft and Google have stopped accepting as valid. We are working on fixing this and will use …

Git based websites available

Posted on: 2015-04-29 21:29:31+00:00

If you have worked on a web site for an Apache project, you've probably come across the fact that everything has to be in Subversion for web sites. The reason for this has been the desire to have a unified standard for publishing web site contents across all projects. The …

Introducing JIRA Service Desk

Posted on: 2015-04-13 20:21:14+00:00

As part of our ongoing efforts to streamline our service offerings, and to make it easier to interact with the Infrastructure team we are launching an instance of JIRA Service Desk. 

This should make it much simpler to submit common JIRA issues, such as SVN->GIT migration, New wiki, New …

Downtime notice for the RW git repositoies

Posted on: 2015-01-12 15:02:12+00:00

Folks,

Please note than on Thursday 15th at 20:00 UTC the Infrastructure team
will be taking the read/write git repositories offline.  We expect
that this migration to last about 4 hours.

During the outage the service will be migrated from an old host to a
new one.   We …

SVN Service Outage - PostMortem

Posted on: 2014-12-09 09:58:37+00:00

Summary

On Wednesday December 3rd the main US host for the ASF subversion service fails resulting in loss of service.  This loss of subversion service prevent committers from submitting any changes, and whilst we have an EU mirror it is read-only and does not allow for any changes to be …

Subversion master undergoing emergency maintenance

Posted on: 2014-12-03 17:52:32+00:00

The primary master machine that hosts the Apache Software Foundation's subversion repositories is currently undergoing some emergency maintenance due to disk errors.
We do not currently have an ETA on when this will be fixed.

In the meantime, there will be no access to commit to SVN.
The read-only mirror …

MoinMoin Service - User Account Tidy Up

Posted on: 2014-11-21 12:17:17+00:00

In recent months we have become increasingly aware of a slowing down of our MoinMoin wiki service.  We have attributed this, at least in part, due to the way MoinMoin stores some data about user accounts.  

Across all of our wiki instances (in the farm) we had a little over …

Code signing service now available

Posted on: 2014-10-06 16:36:09+00:00

The ASF Infrastructure team is pleased to announce the availability of a new code signing service for Java, Windows and Android applications. This service is available to any Apache project to use to sign their releases. Traditionally, Apache projects have shipped source code. The code tarballs are signed with a …

Committer shell access to people.apache.org

Posted on: 2014-09-25 23:38:41+00:00

Apache committers are granted shell access to a host know as either people.apache.org or minotaur. As you may know, there has been a two year grace period in which we have advertised the upcoming change away from password logins to SSH key only.

Due to a recent significant …

Committers mail relay service

Posted on: 2014-09-25 22:57:44+00:00

For a very long time now we have allowed committers to send email from their @apache.org email address from any host.  10 years ago this was less of an issue than it is today.  In the current world of mass spam and junk flying around, mail server providers are …

Nexus reduced performance issues resolved.

Posted on: 2014-09-11 09:19:46+00:00

    HI All,

So Tuesday morning we got a report in IRC that a committer was trying to get a release out
and could not deploy. Shortly after a Nexus issue was reported in Jira INFRA-8321. A few
hours later another issue INFRA-8322 related to Nexus was opened. So far, nothing …

Infrastructure Team Adopting an On-Call Rotation

Posted on: 2014-08-18 13:00:00+00:00

As the Apache Software Foundation (ASF) has grown, the infrastructure required to support its diverse set of projects has grown as well. To care for the infrastructure that the ASF depends on, the foundation has hired several contractors to supplement the dedicated cadre of volunteers who help maintain the ASFs …

New status page for the ASF

Posted on: 2014-08-14 13:45:53+00:00

We are pleased to announce that we have a new status page for our infrastructure and the ASF as a whole.

Where we have previously been focused on reporting the up/down status of our services, we have now begun to look a bit more at the broader picture of …

Email from apache.org committer accounts bypasses moderation!

Posted on: 2014-06-15 02:29:06+00:00

Good news!   We've finally laid the necessary groundwork to extend the bypassing of committer emails sent from their apache.org addresses, from commit lists to now all Apache mailing lists.  This feature was activated earlier today and represents a significant benefit for cross-collaboration between Apache mailing lists for committers, relieving …

DMARC filtering on lists that munge messages

Posted on: 2014-06-03 21:57:08+00:00

Since Yahoo! switched their DMARC policy in mid-April, we've seen an increase in undeliverable messages sent from our mail server for Yahoo! accounts subscribed to our lists.   Roughly half of Apache's mailing lists do some form of message munging, whether it be Subject header prefixes, appended message trailers, or removed …

Mail outage post-mortem

Posted on: 2014-05-28 05:16:39+00:00

Overview:
During the afternoon of May 6th we began experiencing delays in mail delivery of 1-2 hours. Initial efforts at remediation seemed to clear this up but on the morning of May 7th the problem worsened and we proactively disabled mail service to deal with the failure. This outage affected …

Mail outage

Posted on: 2014-05-07 14:48:16+00:00

During the afternoon of May 6th we began experiencing delays in mail delivery of 1-2 hours. Initial efforts at remediation seemed to clear this up but on the morning of May 7th the problem worsened and we proactively disabled mail service to deal with the failure. The underlying hardware suffered …

heartbleed fallout for apache

Posted on: 2014-04-11 20:25:44+00:00

Remain calm.

What we've learned about the heartbleed incident is that it is hard, in the sense of perhaps only viable to a well-funded blackhat operation, to steal a private certificate and key from a vulnerable service.  Nevertheless, the central role Apache projects play in the modern software development world …

Improved integration between Apache and GitHub

Posted on: 2014-02-12 01:16:30+00:00

After a few weeks of hard work and mind-boggling debugging, we are pleased to announce tighter and smarter integration between GitHub and the Apache Software Foundation's infrastructure.

These new features mean a much higher level of replication and retention of what goes on on GitHub, which in turns both help …

paste.apache.org sees the light of day

Posted on: 2013-03-06 18:37:42+00:00

Today, the Apache Infrastructure team launched http://paste.apache.org, a new ASF-driven site for posting snippets, scripts, logging output, configurations and much more and sharing them with the world.


 Why yet another paste bin, you ask?

Well, for starters, this site is different in that is it run by …

New Infra Team Members

Posted on: 2012-07-26 02:35:47+00:00

Since out last update over a year ago, the Infra Team has expanded by another NINE (9) members!

Congrats and our warmest thanks go to:


Niklas Gustavsson - (ngn)
Jeremy Thomerson - (jrthomerson)
Mark Struberg - (struberg)
Eric Evans - (eevans)
Brandon Williams - (brandonwilliams)
Mohammad Nour El-Din - (mnour)
David Nalley - (ke4qqq)
Yang Shih-Ching - (imacat …

ASF Comments System Live!

Posted on: 2012-07-09 16:49:30+00:00

Daniel Gruno has recently developed a comments system for Apache projects to use.  The purpose of the system is to enable public commentary on project webpages and is already in production use in the httpd and trafficserver projects.  This new system nicely complements the ASF CMS system and trivially integrates …

Apache CMS: New features for anonymous users

Posted on: 2012-06-24 13:37:50+00:00

Two new features have recently been added to the CMS, courtesy of David Blevins.  These features are geared towards streamlining the user experience for anonymous users.  The first feature is "Quick Mail", which is the analog of "Quick Commit" but for anonymous users who cannot otherwise commit their changes directly …

The value of taint checks in CGI scripts

Posted on: 2012-06-09 21:45:27+00:00

Consider the following snippet taken from a live CGI script running on the host that serves www.apache.org:

#!/usr/bin/perl

use strict; use warnings;

print "Content-Type: text/html\n\n"; my $artifact = "/apache-tomee/1.0.1-SNAPSHOT/"; $artifact = $ENV{PATH_INFO} if $ENV{PATH_INFO};

$artifact = "/$artifact/"; $artifact =~ s,/+,/,g; $artifact …

apache.org incident report for 05292012

Posted on: 2012-05-29 16:59:09+00:00

Last week, internal audit activity discovered that the access logs of some committer-only Apache services contained passwords but had been available to every Apache committer.

The problem

The httpd logs of several ASF services are aggregated and archived on minotaur.apache.org.  Minotaur is also people.apache.org, the shell …

Welcome new members of the infra team

Posted on: 2011-03-22 10:09:45+00:00

Well, some are not exactly new faces, but since our last blog update of new infra members in 2009 , we have conned with promises of fame, fortune and beer the following new additions to the infra team:

  • Chris Rhodes: (arreyder)
  • Brian Fox: (brianf)
  • Matt Benson: (mbenson)
  • David Blevins: (dblevins)
  • Rudiger …

Changes to email service for all committers

Posted on: 2011-02-24 21:13:18+00:00

In the near future the Infrastructure team will be implementing a change to the way we handle emails for all committers.

Historically we have allowed users to choose how to handle their apache.org email. However we will be making the following changes:

  1. Making LDAP authoritative for all mail forwarding …

Controlling your SpamAssassin threshold

Posted on: 2011-01-27 15:37:21+00:00

Committers,

The Infrastructure Team has just enabled a new feature to control your SpamAssassin Threshold for your apache.org account. The default score for user delivery has always remained at 10, but with this new feature you can lower that score to anything you want. Many people with older accounts …

id.apache.org -- New Password Service

Posted on: 2011-01-14 16:36:42+00:00

Folks,

The infrastructure team are pleased to announce the availability of id.apache.org the new password management tool for all ASF committers and members. This new service will allow users to:

  1. Reset forgotten LDAP passwords themselves, no need to contact the Infra team anymore.
  2. The ability to change their …

LDAP and password policy

Posted on: 2010-12-17 06:38:50+00:00

As of approximately 03:00 (UTC) today the infrastructure team have enabled a password policy for all LDAP accounts.
This policy has been implemented at the LDAP infrastructure level and will affect all users. It has been deployed using OpenLDAP's password policy schema, and overlay.

At the time of launch …

The ASF CMS

Posted on: 2010-12-02 04:25:43+00:00

Over the past 3 months, the Infrastructure Team has developed and deployed a custom CMS for Apache projects to use to manage their websites. There is a document available which explains the rationale, role, and future plans for the CMS. We have opened up the ACLs for the www.apache …

1 million commits and still going strong.

Posted on: 2010-09-23 11:55:55+00:00

Yesterday, the main ASF SVN code repository passed the 1 million commit mark. Shortly thereafter one of the ASF members enquired as to how he could best grab the svn log entries for all of these commits. As always there were a bunch of useful replies, but they were all …

new hardware for apache.org

Posted on: 2010-07-19 04:01:07+00:00

This weekend we rolled out a new server, a Dell Power Edge R410, named Eos, to host the Apache.org websites and MoinMoin wiki:

  • OS: FreeBSD 8.1-RC2
  • CPU: 2x Intel(R) Xeon(R) CPU X5550 @ 2.67GHz (2 package(s) x 4 core(s) x 2 SMT threads = 16 …

s.apache.org - uri shortening service

Posted on: 2010-06-11 17:17:46+00:00

Today we've brought s.apache.org online. It's a url shortening service that's limited to Apache committers- the people who write all that Apache software! One of the main reasons we're providing this service is to allow committers to use shortened links whose provenance is known to be a trusted …

apache.org incident report for 04092010

Posted on: 2010-04-13 05:04:50+00:00

Apache.org services recently suffered a direct, targeted attack against our infrastructure, specifically the server hosting our issue-tracking software.

The Apache Software Foundation uses a donated instance of Atlassian JIRA as an issue tracker for our projects. Among other projects, the ASF Infrastructure Team uses it to track issues and …

ASF Buildbot svn setup

Posted on: 2010-03-29 10:25:59+00:00

Here at the ASF we have a subversion setup with all our projects code in one repository, with each of those projects having their own style of trunk/branches/tags/site etc.. This works well for us, but did present us with some initial problems when setting up our Buildbot …

New slaves for ASF Buildbot

Posted on: 2010-03-04 22:03:23+00:00

The ASF Buildbot CI instance has just launched two more slaves, expanding the range of platforms it can build and test on.

Added are slaves on the FreeBSD 8 platform (a VM on the Nyx VMware host) and a Solaris Zone.

Projects are welcome to create an Infra issue or …

The ASF LDAP system

Posted on: 2010-02-22 22:17:39+00:00

When we decided some time ago to start using LDAP for auth{n,z} we had to come up with a sane structure, this is what we have thus far. 

 dc=apache,dc=org
      |   ou=people,dc=apache,dc=org
      |   ou=groups,dc=apache,dc=org
           |   ou=people,ou=groups …

LDAP, groups and SVN - Coupled together

Posted on: 2010-02-22 22:03:20+00:00

The infrastructure team have now completed the next stage of the planned LDAP migration.
We have migrated our old SVN authorisation file, and POSIX groups into LDAP data.  SVN access control is now managed using these groups.

This means to change access the Subversion repositories is now as simple as …

SVN performance enhancements

Posted on: 2010-02-17 00:41:04+00:00

Tonight we enabled a pair of Intel X25-M's to serve as l2arc cache for the zfs array which contains all of our svn repositories.  Over the next few hours as these SSD's start serving files from cache, the responsiveness and overall performance of svn on eris (our master US-based server …

apache.org downtime - initial report

Posted on: 2009-08-28 12:33:19+00:00

This is a short overview of what happened on Friday August 28 2009 to the apache.org services.  A more detailed post will come at a later time after we complete the audit of all machines involved.

On August 27th, starting at about 18:00 UTC an account used for …

Relaying mail from apache.org.

Posted on: 2009-08-01 12:24:57+00:00

One of the more common issues committers face at Apache is in trying to send mail from their apache.org account.  We've just made that process a whole lot easier by setting up an SSL-enabled, smtp-auth based mail submission service on people.apache.org port 465; which is compatible with …

It's official, we now have LDAP running!

Posted on: 2009-05-21 16:01:19+00:00

Earlier this week the Infrastructure team rolled out phase one of the planned LDAP services.  

We are using LDAP for authentication of shell accounts.  For now this is the extent of the implementation, however the next phase should follow this quite quickly.

The next phase will involve moving to LDAP …

Git support at Apache

Posted on: 2009-05-03 22:22:57+00:00

Git is a new version control system that has been getting increasingly popular during the past few years. Many Apache contributors have also expressed interested in using Git for working with Apache codebases. While the canonical location of all Apache source code is our Subversion repository, we also want to …

New mailing list for CI Build Services

Posted on: 2009-04-06 09:14:11+00:00

Established today, we now have a dedicated mailing list to talk about and work out all things to do with our build services. Currently infrastructure provides projects with use of Hudson, Continuum, Gump and now we have another option in Buildbot. Buildbot is a new service here at Apache Infrastructure …

Subversion on-the-fly Replication Talk

Posted on: 2009-04-02 17:47:53+00:00

Last week (at ApacheCon 2009 EU) I gave a session talk about "Subversion on-the-fly Replication" and how we (ASF) deployed such an setup last year with in the Apache Software Foundation.  So check out the slides if you are interested in how it works, why you should do it, what …

Slow SVN Service This Week

Posted on: 2009-03-25 18:39:01+00:00

In preparation for upgrading Subversion to the latest version (1.6.0), we are running an svn dump on svn.apache.org.  This will chew up enough disk IO to be noticeable to svn users.  We expect the dump to finish sometime during this weekend.
 

New faces in Infrastructure

Posted on: 2009-03-25 02:28:20+00:00

Over the past year the Infrastructure Team has grown to meet new challenges.  Here is a list of the new folks on the team:

  • Gavin McDonald (gmcdonald)
  • Norman Maurer (norman)
  • Tony Stevenson (pctony)
  • Wendy Smoak (wsmoak)
  • Mark Thomas (markt)
  • Chris J. Davis (chrisjdavis)
  • Jukka Zitting (jukka)

Congratulate these people on …

Roller installed for use by Apache Projects

Posted on: 2009-03-23 00:29:41+00:00

Roller was installed today for the use of ASF Projects. Those committers with personal blogs should instead add their feed to planet.apache.org.

Still a few things to sort out, but blogs.apache.org is mostly ready.

Any project that wants a blog, please can a PMC member email …

Copyright 2022, The Apache Software Foundation, Licensed under the Apache License, Version 2.0.
Apache® and the Apache feather logo are trademarks of The Apache Software Foundation...