Research Repository

A Dynamic Service Trading in a DLT-Assisted Industrial IoT Marketplace

Hu, Jiejun and Reed, Martin and Thomos, Nikolaos and Al-Naday, Mays and Yang, Kun (2022) 'A Dynamic Service Trading in a DLT-Assisted Industrial IoT Marketplace.' IEEE Transactions on Network and Service Management. ISSN 1932-4537

[img]
Preview
Text
IEEETranNetSerHu22.pdf - Accepted Version

Download (8MB) | Preview

Abstract

With the increasing demand for digitalization and participation in Industry 4.0, new challenges have emerged concerning the market of digital services to compensate for the lack of processing, computation, and other resources within Industrial Internet of Things (IIoTs). At the same time, the complexity of interplay among stakeholders has grown in size, granularity, and variation of trust. In this paper, we consider an IIoT resource market with heterogeneous buyers such as manufacturer owners. The buyers interact with the resource supplier dynamically with specific resource demands. This work introduces a broker between the supplier and the buyers, equipped with Distributed Ledger Technologies (DLT) providing a service for market security and trustworthiness. We first model the DLT-assisted IIoT market analytically to determine an offline solution and understand the selfish interactions among different entities (buyers, supplier, broker). Considering the non-cooperative heterogeneous buyers in the dynamic market, we then follow an independent learners framework to determine an online solution. In particular, the decision-making procedures of buyers are modeled as a Partially Observable Markov Decision Process which is solved using independent Q-learning. We evaluate both the offline and online solutions with analytical simulations, and the results show that the proposed approaches successfully maximize players’ satisfaction. The results further demonstrate that independent Q-learners achieve equilibrium in a dynamic market even without the availability of complete information and communication, and reach a better solution compared to that of centralized Q-learning.

Item Type: Article
Uncontrolled Keywords: DLT; Dynamic Pricing; IIoT marketplace; Independent Learning; POMDP
Divisions: Faculty of Science and Health
Faculty of Science and Health > Computer Science and Electronic Engineering, School of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 20 Jul 2022 09:16
Last Modified: 23 Sep 2022 19:54
URI: http://repository.essex.ac.uk/id/eprint/33174

Actions (login required)

View Item View Item