MQTT connector

Use your MQTT data for reporting, automation and AI.

Data Panda brings the topics, retained messages and broker telemetry flowing through your MQTT broker together with the data from the rest of your business. From one place, we turn it into dashboards, automations, AI workflows and custom apps your team uses every day.

Data Panda Reporting Automation AI Apps
MQTT
About MQTT

The lightweight pub/sub protocol that runs most IoT and industrial telemetry.

MQTT is a publish-subscribe messaging protocol designed to move small messages between many clients over unreliable, low-bandwidth networks. Clients publish to hierarchical topics like plant/line-3/temperature, the broker routes those messages to whichever clients have a matching subscription, and the wire format is small enough that a minimal control packet fits in two bytes. Three QoS levels (at most once, at least once, exactly once), retained messages and last-will messages give the protocol enough reliability primitives to survive flaky satellite, cellular and field networks without a heavyweight transport.

It started in 1999 at IBM, where Andy Stanford-Clark and Arlen Nipper (then at Cirrus Link) built it to monitor an oil pipeline over satellite. The acronym originally meant MQ Telemetry Transport, and was officially retired in 2013 once the protocol outgrew its original SCADA roots. OASIS published MQTT 3.1.1 as a standard in October 2014 and MQTT 5.0 in March 2019. Today it sits underneath fleet, manufacturing, smart-building, automotive, energy and consumer-IoT stacks, on brokers like Eclipse Mosquitto, HiveMQ, EMQX, AWS IoT Core and Azure IoT Hub.

The point of pulling MQTT into a warehouse is not to land every device payload, those are usually high-frequency and belong on the hot path between sensor and control loop. It is to make the broker layer visible: connected-client counts, message rate per topic branch, retained-message age, dropped-message counts per QoS, last-will fires per device class, bytes in and out per gateway. That data sits next to ERP production runs, CRM accounts and field-service tickets, and the question of why a line stopped pushing readings on Tuesday stops being a guess between firmware, network and broker.

What your MQTT data is for

What you get once MQTT is connected.

Broker- en device-rapportering

MQTT-broker- en topic-telemetrie gekoppeld aan ERP, CRM en field-service in SQL.

  • Connected-client counts per device-klasse en site over tijd
  • Message-rate per topic-tak en QoS-niveau
  • Retained-message-leeftijd en last-will-fires per gateway

Telemetry-driven automation

Let MQTT signals fire actions across the rest of the stack.

  • Device that stops publishing for N minutes opens a field-service ticket with the last topic and site
  • Last-will burst on a gateway pages on-call in Slack with the affected branch
  • Retained-temperature crossing a threshold pushes a work order to the maintenance system

AI workflows

Use broker and device telemetry to score behaviour and predict where the next outage forms.

  • Failure-forecasting per device-class against historical message gaps and ambient signals
  • Topic-traffic anomaly detection per site and shift
  • Clustering of last-will patterns to surface firmware-version regressions

Custom apps on your data

Internal tools that read MQTT telemetry without broker-console access.

  • Per-site fleet-health console for the field team
  • Connected-client board the NOC reads on every shift change
  • Customer-facing uptime view per installed asset tied to SLA
Use cases

Use cases we deliver with MQTT data.

A list of concrete reports, automations and AI features we have built on MQTT data. Pick the one that matches your situation.

Connected-client countsActive clients per broker, gateway and device-class trended against deploys and field activity.
Topic-volume telemetryMessage rate per topic branch and QoS level, broken down by site and shift.
Retained-message ageHow stale the last retained value is per topic, surfacing devices that stopped publishing without disconnecting.
Last-will firesUnexpected disconnects per device-class and gateway, mapped to firmware version and site.
Dropped messages per QoSQoS 0 drops, QoS 1/2 retransmits and broker-side queue overflows per branch.
Bytes in and outThroughput per gateway and broker node, useful for capacity planning and cellular cost attribution.
Subscription countActive subscriptions per topic filter, surfacing fan-out hotspots and orphaned consumers.
Session persistencePersistent vs clean sessions per client, and reconnect frequency over time.
Auth and ACL eventsConnection refusals, ACL denials and TLS handshake failures per client identity.
Cluster and bridge healthInter-node replication lag, bridge backlog and broker-cluster failover history.
Real business questions

Answers you will finally get.

Why did line 3 stop sending readings on Tuesday morning?

Connected-client count, message rate per topic branch, last-will fires and retained-message age plotted on the same timeline as production runs, network events and firmware deploys. The Tuesday gap stops being a finger-pointing match between firmware, network and broker, and becomes a chart maintenance, IT and operations all read the same way.

Which device-class drives the most last-will fires?

Last-will events broken down by device-class, firmware version, gateway and site. Surfaces the firmware build that quietly drops a TCP keep-alive every few hours, the gateway with a flaky cellular link, and the site where the install crew still has the old image. The conversation with the device vendor stops being anecdotal.

What does our IoT estate cost us per customer?

Broker spend, cellular bytes per gateway and connected-client count joined to the customer record in the warehouse. The IoT line gets a per-customer denominator, and account managers can talk concretely about which installs drive the next broker tier or SIM-plan upgrade.

Value for everyone in the organisation

Where each function gets value.

For finance leaders

Broker spend and cellular cost tied to message volume, gateway and customer. The IoT line stops being a flat infrastructure cost and gets a per-customer denominator finance can defend in the budget review.

For sales leaders

Per-customer connected-device count, uptime and message volume surfaced on the CRM account. Account managers can talk concretely about SLA, plan limits and upgrade triggers without waiting for engineering to dig the numbers out of the broker console.

For operations

Connected-client counts, topic gaps, last-will fires and retained-message age kept in one place across firmware deploys and network events. The field-service ticket starts from a chart, not a phone call from the customer.

Your existing tools

Your data lands in a warehouse. Your BI tools read from it.

You keep the reporting tool you already have. We connect it to the warehouse where your MQTT data lives.

Power BI logo
Power BI Microsoft
Microsoft Fabric logo
Fabric Microsoft
Snowflake logo
Snowflake Data warehouse
Google BigQuery logo
BigQuery Google
Tableau logo
Tableau Visualisation
Microsoft Excel logo
Excel Sheets & pivots
Three steps

From MQTT to answers in three steps.

01

Connect securely

OAuth authentication. Read-only by default. We sign a DPA and your admin keeps the keys.

02

Land in your warehouse

Data flows into your warehouse on your schedule. Near real time or nightly, your call. You own the data.

03

Reporting, automation, AI

We build the first dashboard, workflow or AI feature with you, then hand over the keys. Or we stay on for ongoing delivery.

Two ways to work with us

Pick the track that fits how you work.

Track 01

Self-serve

We set up the foundation. Your team builds on top.

  • MQTT connector configured and running
  • Warehouse set up in your cloud account
  • Clean access for your Power BI, Fabric or Tableau team
  • Documentation on what's in the data model
  • Sync monitoring so you're warned before reports break

Best fit Teams that already have a BI analyst or data engineer and want to own the build.

Track 02

Done for you

We build the whole thing, end to end.

  • Everything in Self-serve
  • Dashboards built to the questions your team actually asks
  • Automations between your systems
  • AI workflows scoped to real tasks your team runs
  • Custom apps where a dashboard does not cut it
  • Ongoing delivery at a pace that fits your team

Best fit Teams without in-house BI or dev capacity. You tell us what you need and we deliver it.

Before you book

Frequently asked questions.

Who owns the data?

You do. It lands in your warehouse, on your cloud account. We don't resell or aggregate it. If you stop working with us, the warehouse stays yours and keeps running.

How fresh is the data?

Near real time for most operational systems. For heavier sources we schedule hourly or nightly. You pick based on what the reports need.

Do I need a warehouse already?

No. If you don't have one, we help you pick one and set it up as part of the first delivery. Common starting points are Snowflake, Microsoft Fabric, or a small Postgres start.

Do you load every MQTT message into the warehouse?

No, and that is on purpose. Device payloads are usually high-frequency and belong on the hot path between sensor and control loop. We pull broker-side metadata: connected-client counts, message rate per topic branch and QoS, retained-message age, last-will fires, bytes in and out per gateway. That metadata is what answers fleet, capacity and SLA questions. If a specific topic carries readings you do want as queryable history, we tee those off explicitly per topic, with retention and downsampling rules attached.

Will subscribing to broker telemetry hurt our broker?

We pull broker stats from the system topics or admin API the broker already exposes (Mosquitto's $SYS branch, the HiveMQ and EMQX management APIs, AWS IoT and Azure IoT Hub metrics endpoints). For per-topic volume we sample rather than mirror every message, scoped per topic filter, and we cache locally so a warehouse refresh does not multiply the load. On high-volume brokers we lean on the metrics the broker already aggregates rather than fanning out per-client calls.

GDPR-compliant
Data stays in the EU
You own the warehouse

A first deliverable live in four to six weeks.

We review your MQTT setup and the systems around it. Together we pick the first thing worth building.