Saving a new article into a category with thousands of articles that are mostly archived

[GCLW]

Steps to reproduce the issue

Created a new article and selected a category that contains around 20K articles, around 15K are given the status of "Archived". The save process takes a full minute.

Expected result

The ordering field in the content database table should have only updated those articles that are in that category and have the status as "published"

Actual result

Every article in that category had its ordering field updated +1 regardless of its status. That means ALL 20K records were updated when I added a single article. I even viewed the ordering field of one of the "Archived" articles before and after I added the new article, and indeed it was updated.

System information (as much as possible)

Joomla 3.6.4

Additional comments

I feel that at the very least "Archived" articles should not be included and updated when updating the ordering field.

[brianteeman]

Can I ask why you are archiving those articles?

[GCLW]

I am currently working on a website for a News Station. I have about 20K articles in a news category. I did not want the Joomla CMS itself to deal with the load of those articles that were over a year old. So anything prior to 2016 I gave those articles the status of “Archived”. It might be my misunderstanding of what archiving does, but I just wanted to point out that the ordering is updating articles that are not going to be displayed (unless you specifically want to view the Archives) which in that case, I would think they would be displayed in chronological order, not a man made one. Brian, thanks for your time, I personally enjoy using this CMS and proudly suggest it to all my clients. It is just in this case I can’t go to my client and expect them to wait a full minute to save a new article. From: Brian Teeman [mailto:notifications@github.com] Sent: Friday, April 07, 2017 4:04 PM To: joomla/joomla-cms <joomla-cms@noreply.github.com> Cc: Willingham, Carl <CWillingham@corp.ptd.net>; Author <author@noreply.github.com> Subject: Re: [joomla/joomla-cms] Saving a new article into a category with thousands of articles that are mostly archived (#15158) Can I ask why you are archiving those articles? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<#15158 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AWBAFKTNg_cOyWBhFL35JD_JtPZVoZj8ks5rtpaugaJpZM4M3UDi>.

[brianteeman]

I am trying to see why you are not deleting them

[GCLW]

Sorry wasting your time Brian. Could you please delete what I had posted. From: Brian Teeman [mailto:notifications@github.com] Sent: Friday, April 07, 2017 4:27 PM To: joomla/joomla-cms <joomla-cms@noreply.github.com> Cc: Willingham, Carl <CWillingham@corp.ptd.net>; Author <author@noreply.github.com> Subject: Re: [joomla/joomla-cms] Saving a new article into a category with thousands of articles that are mostly archived (#15158) I am trying to see why you are not deleting them — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<#15158 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AWBAFHtJ6HyuhiLNOeXJJOABjKosPxvfks5rtpwmgaJpZM4M3UDi>.

[brianteeman]

Your not wasting time at all. We are currently discussing and evaluating how people are using archive so it would be useful to know why you are using archive. Even if that means you have decided you should be deleting them that is useful to know as that means we have an issue explaining the purpose of archive

[GCLW]

These articles are news stories and the thought or hope from the client is that people would only see recent articles no older than a year. But they wanted an “Archive” feature, where users could go into a section just to view the “Archives”. My example is I have all 20K of them in a news category, so in the frontend view, I have a menu that does a category list, and it only displays the articles in the news directory that are “published” no “archived” articles are shown. This (I believe) also works with the search feature, (I think) unless specified your search will only return “published” articles. From: Brian Teeman [mailto:notifications@github.com] Sent: Friday, April 07, 2017 4:40 PM To: joomla/joomla-cms <joomla-cms@noreply.github.com> Cc: Willingham, Carl <CWillingham@corp.ptd.net>; Comment <comment@noreply.github.com> Subject: Re: [joomla/joomla-cms] Saving a new article into a category with thousands of articles that are mostly archived (#15158) Your not wasting time at all. We are currently discussing and evaluating how people are using archive so it would be useful to know why you are using archive. Even if that means you have decided you should be deleting them that is useful to know as that means we have an issue explaining the purpose of archive — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#15158 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AWBAFBJ2LOsG0QXOhmshWgvYUxdebwGEks5rtp8rgaJpZM4M3UDi>.

[brianteeman]

Thats a good use case. Personally I would move the archived articles into a separate category

…

On 7 April 2017 at 21:57, GCLW ***@***.***> wrote: These articles are news stories and the thought or hope from the client is that people would only see recent articles no older than a year. But they wanted an “Archive” feature, where users could go into a section just to view the “Archives”. My example is I have all 20K of them in a news category, so in the frontend view, I have a menu that does a category list, and it only displays the articles in the news directory that are “published” no “archived” articles are shown. This (I believe) also works with the search feature, (I think) unless specified your search will only return “published” articles. From: Brian Teeman ***@***.*** Sent: Friday, April 07, 2017 4:40 PM To: joomla/joomla-cms ***@***.***> Cc: Willingham, Carl ***@***.***>; Comment < ***@***.***> Subject: Re: [joomla/joomla-cms] Saving a new article into a category with thousands of articles that are mostly archived (#15158) Your not wasting time at all. We are currently discussing and evaluating how people are using archive so it would be useful to know why you are using archive. Even if that means you have decided you should be deleting them that is useful to know as that means we have an issue explaining the purpose of archive — You are receiving this because you commented. Reply to this email directly, view it on GitHub<https://github.com/ joomla/joomla-cms#15158#issuecomment-292645996>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ AWBAFBJ2LOsG0QXOhmshWgvYUxdebwGEks5rtp8rgaJpZM4M3UDi>. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#15158 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABPH8dQQnn9gWDy3foNYaN_De3zwTsvnks5rtqMggaJpZM4M3UDi> .

-- Brian Teeman Co-founder Joomla! and OpenSourceMatters Inc. https://brian.teeman.net/ <http://brian.teeman.net/>

[ghost]

@brianteeman there you need a auto-archive Function (move Article after 2 Weeks from "Sport" to "Sport-Archive").

[brianteeman]

@franz-wohlkoenig there are (or were last time I checked) plugins available for that

[ghost]

@brianteeman you're right, i thought about Function in Core.

[csthomas]

Joomla 3.7 has an improvement of reordering articles, take a look at #13505

It still reorder all such articles in category but do it in one query instead above mentioned 20K:)

[ghost]

@GCLW can you test 3.7 about information of @csthomas?

[GCLW]

A question of mine I have been asking is why, when a new article gets created does every article in that category need to have its ordering field updated by +1? Is it because someone felt the need to give the newly created article the ordering number of 1? If it is, I can only guess due to a complaint stating they had to drag a newly added article to the top when they view a category by the ordering field. I am sorry but the system is crippled because of that. New Articles should be given the largest number and the remaining articles should be left untouched. Think of it like a database field that is auto increment.

Something else that is not mentioned:
Prior to the 20 thousand updates there is a select statement that returns 20 thousand records that get whiled into an array of article_id => ordering elements (which that in itself is a load) That array then is used in a foreach statement that executes 20 thousand update statements.

I wish I had more time, but the project is on a deadline that is near. I wish I had more time see how this gets resolved.

[csthomas]

A question of mine I have been asking is why, when a new article gets created does every article in that category need to have its ordering field updated by +1?

In J3.x due to B/C.

[Quy]

@franz-wohlkoenig This probably can be closed.

[joomla-cms-bot]

Set to "closed" on behalf of @franz-wohlkoenig by The JTracker Application at issues.joomla.org/joomla-cms/15158

[ghost]

closed as stated above.

Thanks for hint @Quy.

---

_{This comment was created with the J!Tracker Application at issues.joomla.org/tracker/joomla-cms/15158.}