MAMA: HTTP Headers

MAMA: HTTP Headers - Opera Developer Community: "In the beginning, there were only a few HTTP Headers that MAMA was concerned with (like the 'Content-Type' and 'Server' fields). As feature requests for HTTP Header data accumulated over time, managing the results became more difficult. MAMA generally wasn't as concerned with what the HTTP Headers contained as with what the rest of the HTTP response had to say. At a certain point, the various checks that MAMA was doing on the HTTP Headers became too numerous, so the decision was made to store the entire HTTP Header in the database. This way, any new requests could be quickly completed locally without having to do an entirely fresh re-crawl of the entire MAMA URL set."