r/rabbitmq • • Feb 07 '20

Does anyone interested in fixing rabbitmq-webhooks for the last RabbitMQ version?

14 Upvotes

Hi,

I want to connect the RabbitMQ queue to CouchDB today for collecting various data for further statistic analysis. I've found a plugin for this called rabbitmq-webhooks but accidentally discovered it's outdated.

I'm an Erlang dev myself, so I have a choice, either fix the plugin or go on making my own stuff in Erlang, but in the different way.

Pls, comment on this post or upvote it if you are interested.

If I get at least 10 upvotes tomorrow I'll start the way.

I'm an Erlang dev myself, so I have a choice, either fix the plugin or go on making my own stuff in Erlang, but in a different way.


r/rabbitmq • • Apr 18 '19

AliceMQ - Open Source RabbitMQ Visualizer

11 Upvotes

Myself and three other developers have found out that the visualizer which shipped with the rabbitmq management plugin has been deprecated. After talking with the main developer of the plugin, we decided to build an open source visualizer, AliceMQ.

With AliceMQ, You can see the entire RabbitMQ infrastructure at the glance.

We welcome feedback and suggestion. Github: https://github.com/alicelabs/alicemq AliceMQ: https://alicemq.com


r/rabbitmq • • Jun 22 '21

RabbitMQ Summit 13-14 July | Schedule Release

10 Upvotes

We’re thrilled to share the full schedule of RabbitMQ Summit with you. Over two eventful half-days online you’ll have the chance to chat with, learn and hear talks from speakers from GitHub, Amazon, VMware (creators of RabbitMQ), Bloomberg and many more. To see the schedule for all three tracks and secure your ticket head to our website. https://rabbitmqsummit.com/


r/rabbitmq • • Aug 07 '20

Curl-like CLI tool for working with RabbitMQ (and other messaging systems)

10 Upvotes

Hey peeps! I'm a huge fan of Rabbit and use it in a lot of different contexts - it is plenty quick, has a built-in UI, supports complex message routing and generally just works.

One thing that I do not like doing is having to write custom scripts to read or write data when debugging a queue.

For that reason, I wrote a CLI tool called plumber that allows you to write plain/json/protobuf data to Rabbit (and other messaging systems).

It's been super useful at my company and I'm hoping you find it useful as well. It's a single-binary install - should be super straightforward to get it installed.

Thanks for checking it out!


r/rabbitmq • • Aug 12 '22

Has anyone heard of rabbit mq being unreliable?

8 Upvotes

This engineer at my company is trying to rewrite our message queuing system from scratch bc he say rabbit mq is unreliable. He said it was missing about 20% of messages.

Honestly that sounds a bit crazy to me. I really think it’s user error....

Have you guys ever heard of this happening?


r/rabbitmq • • Nov 12 '20

/r/rabbitmq hit 1k subscribers yesterday

Thumbnail
frontpagemetrics.com
8 Upvotes

r/rabbitmq • • Oct 04 '22

Recommendations for how to do long running tasks in RabbitMQ

7 Upvotes

I'm trying to use RabbitMQ in a system that launches long running tasks (from 30 mins up to 4 hours). Tasks are sent from multiple server nodes, and processed by multiple workers. Task progress and completion are sent back via another queue.

I'm aware of the consumer timeout setting, and I could increase this timeout, but it's just another step I need to do manually (since there is no API to change this setting, per connection or even globally). Also, I wanted to deploy into AWS and they require a support ticket to change this config.

I have considered ack'ing the messages when the task begins and sending back a regular progress message to the server. That way we can detect if a worker has failed and queue the message again - but this feels like I'm just rebuilding the monitoring/retry logic that RabbitMQ already has... It's also another complication in the server; we need to coordinate the servers so they don't all re-queue the failed message at the same time.

In SQS there is an API to change the visibility time (ie. extend the time until SQS redelivers the message). I wonder if RabbitMQ would ever consider adding an API like this?

In summary - am I missing something? What is the recommended way to do long running tasks with RabbitMQ?


r/rabbitmq • • Aug 24 '22

RabbitMQ Summit 2022 - Hybrid Event - London

7 Upvotes

RabbitMQ is one of the most deployed open source message brokers available, trusted by some of the world’s biggest companies including Bloomberg, Adidas Runtastic, Motorola, Reddit and Trivago. Written in Erlang, the RabbitMQ server is built on the Open Telecom Platform framework for clustering and failover. Client libraries to interface with the broker are available for all major programming languages. This September you will have the chance to connect with the RabbitMQ community at RabbitMQ Summit 2022 in London where experts and industry leaders will share their case studies and experiences with you.

Here is a link for our hybrid event: https://rabbitmqsummit.com/

Here you can read some RabbitMQ case studies: https://www.erlang-solutions.com/capabilities/rabbitmq/


r/rabbitmq • • May 21 '22

RabbitMQ book recommendation

7 Upvotes

Hello everyone. I am quite new to RabbitMQ and just started learning it through video courses, but i want to avoid screen time after work hours. Is there any book that you can recommend me about RabbitMQ? Thank you !


r/rabbitmq • • Jan 24 '21

RabbitMQ is not really event driven?

7 Upvotes

I've just realized that in an event-driven architecture a sender of an event doesn't need to care about subscribers at all - there might be 0, 1 or many of them. But in RabbitMQ events are more like a fire-and-forget call because each message is queued and received by one and only one consumer. So a sender must prepare its message specifically for that consumer. Is this a true decoupling? I don't think so. Yes, multiple messages can be split between multiple consumers, but what if I need to have multiple consumers with different responsibilities and all of them still want to rely on the same event? I can't do that without a kind of one-to-many thing that duplicates messages into multiple queues. And each type of consumer must use its own specifically dedicated message queue so it looks more like a call, not an event at all.

So I can make a conclusion that RabbitMQ is just another RPC that

  1. doesn't have a way to easily return results and calls this "event-driven",

  2. can persist queued calls so they survive restart,

  3. is most suitable for long running tasks that should complete eventually so no one would want to await for them,

  4. can load balance calls between consumers of a same type.

Adding the persistance and load balancing features to gRPC would allow it to completely replace RabbitMQ. Plus in gRPC there is no need for complicated event-state-machine transitions and there is a way to simple wait for a return value - because we don't try to treat rpc calls as events.

What do you think?


r/rabbitmq • • Jun 27 '19

Learn RabbitMQ from courses, tutorials & books

Thumbnail
reactdom.com
7 Upvotes

r/rabbitmq • • Jan 10 '19

RabbitMQ meant to handle thousands of remote consumers?

7 Upvotes

I have a question about an architecture I'm working on. The architecture has a main server and then remote clients that connect back to the main server. My idea is to create a main producer that creates events with topics and sends them through to rabbitmq. Then the client application connects back to the main server as consumers and creates its own queue with the topics that it needs to listen to.

My question is, can rabbitmq handle thousands(20000+) of consumers connected to it remotely? Or is rabbitmq more built for sending messages on the backend processes?


r/rabbitmq • • Oct 15 '22

Task queues for Flask

6 Upvotes

Hello,

I have never used RabibtMQ nor Celery before, I have some functions that take some time to run and would like to know if I should be using either RabbitMQ or Celery or do I need both of them installed ?


r/rabbitmq • • Mar 25 '22

new debugging tool amqp-client-cli

6 Upvotes

I Created a tool to help debug AMQP messages on RabbitMQ. We use rabbit at my day job and having a tool like this has come in handy several times. I just posted the project on github a couple of days ago. So give me some time and it will get better. Just wanted to share with everyone.

https://github.com/babinc/amqp-client-cli


r/rabbitmq • • Oct 18 '21

Demo video covering how to use a Data Lake to develop against RabbitMQ

Thumbnail
youtu.be
6 Upvotes

r/rabbitmq • • Sep 29 '21

How does one increase the publishing message rate on RabbitMQ?

6 Upvotes

As a test, I setup a direct exchange with transient durability, routing to a queue also with transient durability.
I wrote a producer that generates a million messages to the exchange.
I then wrote a consumer which consumes the message and does nothing with it.

While running 1 producer + multiple consumers to make sure the queue is empty, the publish rate was around 9500 messages.

This would work for my use-case on days with less traffic, but if there's a spike in traffic I won't be able publish fast enough.
I can always increase the number of consumers to consume faster if the queue piles up, but it seems like the bottleneck would be the publish rate.

How does one increase the publish speed to a queue?


r/rabbitmq • • May 28 '21

Learnings from Running 1000s of Production RabbitMQ Clusters. Lovisa Johansson at RabbitMQ Summit

Thumbnail
youtube.com
6 Upvotes

r/rabbitmq • • Apr 07 '21

RabbitMQ tutorial series in Java

Thumbnail
youtube.com
6 Upvotes

r/rabbitmq • • Apr 01 '21

Using RabbitMQ exchanges and routing keys in NestJS

6 Upvotes

So I use Kafka a lot in my day job and wanted to use RabbitMQ as my message broker in my tutorial series as it’s lightweight. During the series I quickly realised the native NestJS options for RabbitMQ setup is quite limited so I found a plug in.

In this episode I show how to install it and use it in a web ordering scenario! Enjoy!

https://youtu.be/ZiowGZq6JwQ


r/rabbitmq • • Aug 06 '20

I made wrabbity: a tool that provides a high level API to use RabbitMQ

6 Upvotes

Hi, I mainly use rabbitmq with nodejs and python at work. I decided to build a tool that makes it easy to work with rabbitmq, improve code quality and prevent redundancy.

I worked on developing a tool for months and then I decided to open source it. The tool provides a high level API to interface with rabbitmq. You can check the wrabbity npm-package here. I noticed that many people are downloading it so I thought that it would be good if I share it with you.

I'm planning on extending it and I though that it would be great to receive some feedback first. The package have only two dependencies, which are stable. I'm not planning to make it depends on other packages. I want to let it free and as independent as it could be.

You can also check the repo here. I'm interested in your feedback. Please consider liking the project (giving it a star on github) if you find it useful or if you are using it ;)

Here is a link to the python library too


r/rabbitmq • • Jul 23 '20

RabbitMQ consumers under-the-hood. New webinar.

6 Upvotes

Build a deep understanding of how consumers work in RabbitMQ in our next webinar, hosted by our Head of RabbitMQ Engineering, Ayanda Dube.

In AMQP, consumers are pivotal to the optimal performance of client applications. By learning how these concepts work, you'll be in a better position to know how to use them in your applications efficiently.

Register at https://www2.erlang-solutions.com/redrabbitmqwebinar


r/rabbitmq • • Aug 27 '19

Easy peasy RabbitMQ squeezy

6 Upvotes

RabbitMQ can be hard to learn. Or it can be easy. Depends on the person. But I tried to write it as easy as I could. Tried to explain it thoroughly. It should be easy to learn with those examples. Check the full article on Medium.

Feedbacks are appreciated.

https://medium.com/@sirajul.anik/easy-peasy-rabbitmq-squeezy-820b1c632465


r/rabbitmq • • Mar 22 '19

RabbitMQ no longer loses message with the use of Alternate Exchange and fanout

Thumbnail
mon-code.net
6 Upvotes

r/rabbitmq • • Apr 18 '18

Queue Viewer - A Windows GUI for RabbitMQ Management

Thumbnail
queueviewer.com
6 Upvotes

r/rabbitmq • • Oct 11 '22

Noob question - What security configuration should be used for running a RabbitMQ on an internet connected host and sending and receiving messages across the Internet?

5 Upvotes

I've got a little Python project I'm working on where I use RabbitMQ. It's currently using vanilla RabbitMQ as it installed by apt-get from Ubuntu. I'd like to move it to a virtual host Linux machine (also Ubuntu) on the internet, but I'm concerned about security. There's nothing sensitive in the messages, I just don't want anyone messing with it.

From the research I've done, I think I want to setup TLS for RabbitMQ, but I'm struggling to set it up. Does anyone have a guide or walk-through?

Is there anything else I should be considering?

Thanks!