several people have confirmed it… I haven’t seen them explain how exactly, but they seem convinced it is causing crashes so they blocked it. Lemmy is practically in the realm of voodoo PostgreSQL at this point. Since April or May it’s been scaling very poorly as data gets added.

Why is there a lack of gifs/videos on Lemmy?

Lemmy’s internal data performance is so horribly slow and crash-causing that I think the last thing they want is even more popular data.

Video is simply the most superior type of media there is, and I think that not having easy access to it on Lemmy is hurting it.

Video is more data, popularity is more data. For whatever reason, at every turn, I’ve seen developers turn away from scaling options like Memcache, Redis, or just abandoning ORM data management and rewriting the data interfaces by hand…

since the sites on which the videos are hosted can track you.

That’s already true for images that are hot linked routinely, so I don’t think video really changes it.

I’ve been baffled since June why data and fixing lemmy’s data coding hasn’t been front and center. It’s pretty wild to witness so many come to Lemmy and then turn away… Elon Musk has been flocking people, Reddit, etc. It’s as if the project wants to make code that won’t work on any data. It’s baffeling.

This basically shuts my idea down

it’s not very difficult to modify the code for something like this… and closing off registration wont’ let anyone else login and create new content form your istance.

Personally the load on the major servers by having one more instance that subscribes to everything is why I think people should back off from creating more than the 1500 instances Lemmy network already has. Delivery of every single vote, comment, post 24 hours a day just so one person can read content for an hour or two a day.

That makes sense for email systems where all that content doesn’t have to be sent, but for Lemmy it’s a huge amount of overhead.

ok, I’m going to delete this post. People actually aren’t discussing privacy and are just debating if they think Lemmy needs Multi-Reddit. And I just want to get the code finished. I am probably moving ahead on the code with ZERO sharing of any existing data.

dismissing client-side techniques as nonsense without seeming to understand why they were being discussed in the first place.

I’m the one who started a post about a server-side solution that entirely is based on Reddit’s code for a server-side solution. YOU are the one coming along with this wild idea that a server change isn’t needed at all. yet, you have not demonstrated this wild claim you made!

I’m not interested in any multireddit feature that reduces sub privacy. I’d consider it a net loss for lemmy.

It does NOT require it. I will repeat it: IT IS NOT REQUIRED! It is a sub-feature that facilities better openness that I am suggesting be added as part of the core feature I’m developing.

On Reddit, multi-reddits personal in nature.

10 years ago Reddit announced it as entirely not being personal! That sharing them was the whole point. I again question if you even understand what multi-reddit is!

shouldn’t require relaxing privacy constraints in any case.

It isn’t at all essential to the feature.

I have already coded it so that it does NOT require sharing of anyone’s data, at all. No way shape or form. I’m proposing it as a discussion topic because it’s easy to implement and goes along with the whole spirit of a public forum where people share their public stuff. That people might actually want an easy way to help others out…

But, it’s easier for me just to avoid any privacy topic entirely and not allow sharing of anything. Just build the whole design with opt-in only empty list.

I’m suggesting that multireddits are a “local” function. Theu are so local that they’re possible without server-side support at all,

Again, how? If I want a blend of 50 different communities, how can Reddit or Lemmy do that without 50 API calls if you do not add server-side MultiReddit code?

50 API calls is the overhead and nonsense that is being avoided here…

It could also be a filtered view based on the subscribed/all feed which provides a single API call that can return material from multiple communities.

“that can return material from multiple communities” - that’s exactly how Reddit does multi-reddit, what feature do you think multi-reddit is?

But it should definitely be off by default and have a clear warning when you try to enable it.

I was afraid people would say that. The easier way is to just not touch it at all, as adding new code to opt in/opt out is more Rust code programming that is in rare supply with developers.

The easiest solution is to avoid it and not introduce sharing of personal communities at all. Which was what I was afraid this discussion would yield. So we start fresh with empty MultiPass lists and build them up from scratch.]

the amount of low-effort drive by comments and off-topic posts communities gets just because they are similarly named is bad enough as it is.

which is why I actually want it.

I think a well-cultivated list of quality communities that people share is a means to escape the heavy amount of noise that grew out of the explosion in the number of low-effort barely-any-moderation instances.

Another way to look at this feature is really simple: multiple subscribe lists, the ability to organize what you subscribe to into your cultivated groups. I don’t see why anyone thinks a limitation of having only one community list per login is beneficial in organizing the duplicate choices all over the place.

why does a multi-reddit need multiple instances to collaborate to create the feed?

by “create the feed”, I assume you mean “provide posts” when API call post/list is called?

content is replicated in all federated instances. You only need to use the local copy and merge all the communities of the multi-reddit.

Yes, that is what MultiPass would do, query the local PostgreSQL database. Right now Lemmy only allows this for a single Subscribe/Follow list per user… you have to create 3 different logins if you want 3 different lists of communities. For example, a “games” list, “music” list, “news” list… Plus, the current design does not accommodate logged-out users, they have no way to list multiple communities (other than “All”, local or merged remote+local).

Multi-reddits as they exist on Reddit itself could be implemented entirely client-side, the server side stuff just syncs the behavior of multiple client apps.

Can you explain how? As the only way I can see this is if you did 50 different API requests for all 50 subreddits, merged the results, and then sorted them again by the desired order.

Why does the concept of a multi-reddit need to extend outside of the user’s instance?

it doesn’t need to. But why would you not want it when communities are multi-instance?

perhaps I made a mistake introducing the privacy concern first. As now the whole topic seems to negate the very reason so many people have requested MultiReddit on Lemmy. The privacy issue isn’t even essential, I just wanted to have a discussion about it as a general topic. I’m already building the code so that it can be done entirely without anyone sharing their personal subscribed list.

I’ll say this: a lot of discussion seems to take place on Matrix chat that doesn’t make it into GitHub code comments as to why specific changes are made.

It used to be you could see the actual content of deleted comments and it was at the discretion of the client to show or not show them. The newcomers from Reddit (June) seemed to not like that people could read content of deleted comments, so I think changes were made for that reason.

With federation, it really isn’t reasonable to expect content copies to all be deleted. So it’s a complex issue.

With 0.18.2, 0.18.3 there were changes in the behavior of comment sorting and delete / remove behavior. It is entirely possible that behavior changed, intentional or otherwise.

There is a !test@lemmy.ml community where you could create comments, do some screen shots before and after delete.

Keep in mind that you’re going to be retrieving and storing a huge amount of data running these scripts

And you are adding to the overload of lemmy.world, beehaw, lemmy.ml, etc who have all the popular content communities. Federation has a lot of overhead, as does having to distribute a community one vote at a time to 500 subscribed servers.

pend my time on Lemmy scrolling “All”, which I think is a pretty common thing.

There was a lot of advice handed out back in June that the answer to scaling Lemmy was to go create instances. The reason it works is because “All” is empty on a virgin system ;) With no data in the database, the logic Lemmy hands to PostgreSQL works real fast ;)

Is your intention to have local copies of content from popular servers and read it locally? Major communities like news., memes, etc?

Many people seem to think this is offloading the major servers like lemmy.world - but I think the opposite is true in my measures of how lemmy_server performs. There is a lot of overhead to each additional instance in Lemmy 0.18.3 backend. Lemmy code does a lot of work to keep each of these subscribing servers updated with every post, comment, vote, person - attempted in real-time.

Keep in mind with 0.18.3 there is a new “dead server” check that cuts off communication that won’t show up on the block list. There have been reports in !fediverse@lemmy.ml recently that this has caused some issues. notable posting: https://lemmy.ca/post/2626714

Storage was still pretty expensive, and there we transitions in computing from originally paper terminals to screen and people didn’t have a sense of long-term retention of personal messages (I guess many people probably felt that way about SMS messages on mobile). There also wasn’t really a way to look at a user’s “profile” like you have on Lemmy - to see everything you post in any topic - which a search-engine provided a way to search for your name across a time period.