I’ve just disabled federation for my instance. Thanks again for bringing this issue to my attention, and I’m really sorry for the inconvenience it has caused. I’ll make sure to clear up all the bots before re-enabling federation.

Thanks! Could you please let me know what to search for to find the Lemmy world defense HQ matrix room? I couldn’t find it now.

Additionally, I will current disable chinese.lol by applying a 0 rate limit while I take some time to investigate and remove those bots. Once I’ve cleaned it up, I’ll come back and apologize to those who were affected by the downvoting caused by the bots. I never expected someone would hack my instance to mass-register bots and cause these issues. I’m really sorry for the inconvenience this has caused.

Hi, I’m the admin for chinese.lol, and I just realized that my instance was compromised by those bots, as there is no verification required during registration. Let me check the database and work on banning those suspicious accounts. Also, could you suggest any methods to prevent these bot attacks and stop them from registering in the future?

Hi, I just saw this post. I’m not sure what happened, but let me take a look at it and investigate further.

ok, just post anything you want

what it this?

看到了 Data flow graphs，Samza 这里。

So why has the traditional view of stream processing been as a niche application?

Niche 的意思是“小众的”或“针对特定群体的”。

The US census provides a good example of batch data collection.

Census 的意思是“人口普查”或“统计调查”。

Partitioning allows log appends to occur without co-ordination between shards and allows the throughput of the system to scale linearly with the Kafka cluster size.

“Shards” 的意思是“分片”。

Worse, the systems that we need to interface with are now somewhat intertwined—the person working on displaying jobs needs to know about many other systems and features and make sure they are integrated properly.

“Intertwined” 翻译成中文是“纠缠在一起”或“相互交织”。

This means ensuring the data is in a canonical form and doesn’t retain any hold-overs from the particular code that produced it or the storage system in which it may have been maintained.

“Canonical”的意思是“规范的”或“标准的”。

This architecture also raises a set of different options for where a particular cleanup or transformation can reside:

It can be done by the data producer prior to adding the data to the company wide log. It can be done as a real-time transformation on the log (which in turn produces a new, transformed log) It can be done as part of the load process into some destination data system

reside “Reside”的意思是“驻留”或“位于”。 “Prior”的意思是“在……之前”或“优先于”。

mark 看到 这里了：Let’s talk a little bit about a side benefit of this architecture: it enables decoupled, event-driven systems.

“So began a long slog” 的意思是“从此开始了一段漫长而艰苦的努力”。“Slog” 通常用来形容一段艰难、枯燥且耗时的工作或过程。在这个句子中，它表达了在面对某个挑战（比如数据集成问题）时，必须付出长期且艰苦的努力才能取得进展。

I got to watch this data integration problem emerge in fast-forward as LinkedIn moved from a centralized relational database to a collection of distributed systems.

我亲眼目睹了随着 LinkedIn 从一个集中式的关系型数据库转向一组分布式系统，数据集成问题以极快的速度浮现出来。

The consumer system need not concern itself with whether the data came from an RDBMS, a new-fangled key-value store, or was generated without a real-time query system of any kind. This seems like a minor point, but is in fact critical.

new-fangled Fangled 是一个较少使用的词，通常用在组合词中，比如 “new-fangled”，意思是“新奇的”或“新颖但未必实用的”。它常带有一点轻微的贬义，暗示某个新事物虽然新颖但可能不够可靠或过于花哨。在你提供的上下文中，new-fangled key-value store 意思是“新型的键值存储”，暗示这些新技术可能与传统方法有所不同，但未必被广泛接受或完全可靠。

stale data 过时数据

This data is at the heart of the modern web: Google’s fortune, after all, is generated by a relevance pipeline built on clicks and impressions—that is, events.

impressions 展示曝光

It’s worth noting the obvious: without a reliable and complete data flow, a Hadoop cluster is little more than a very expensive and difficult to assemble space heater.

It’s worth noting the obvious 值得注意的是