Beko Pharm<p>Parsing the Elite Dangerous Journal</p><p>I gave in and changed my event forwarding method in <code>node-red</code> for the Elite Dangerous Journal. This file is updated on various in-game events but in a way that makes it difficult to get new events only since last update. Another problem is that it’s not really a valid <code>JSON</code> file because it has one <code>JSON</code> <em>per line</em> but it’s not a valid <code>JSON</code> array. This is why it has to be parsed line by line and mashed together by event type (name) again to get the latest data for each event type per dump. Each event has it’s own timestamp by set by the game. The latest timestamp is now saved on the special <code>flow</code> const so <code>node-red</code> keeps the value in the “global” memory of the current flow:</p><pre><code>msg.payload.event = "Journal";let newJournalTimestamp = flow.lastJournalTimestamp;Object.keys(msg.payload).forEach((key) => { if (msg.payload[key].timestamp) { const keyTimestamp = new Date(msg.payload[key].timestamp).getTime(); if (!flow.lastJournalTimestamp || flow.lastJournalTimestamp < keyTimestamp) { // this entry is new - keep it. MULTIPLE events may have the // same timestamp so wait with reassigning so we don't skip // em or get the latest a 2nd time if nothing else changes. // update the next latest timestamp if this is newer if(!newJournalTimestamp || newJournalTimestamp < keyTimestamp) { newJournalTimestamp = keyTimestamp; } } else { // lastJournalTimestamp is newer, skip this msg.payload[key] = null; } }});// make sure this is a valid date for the next timeflow.lastJournalTimestamp = newJournalTimestamp || new Date().getTime();// remove all nulled events from the payloadmsg.payload = Object.fromEntries( Object.entries(msg.payload).filter(([_, p]) => p !== null));msg.payload.timestamp = new Date(flow.lastJournalTimestamp);return { payload: msg.payload };</code></pre><p>So I do now keep track of the last read timestamp and reject every event that is older than the last read keeping the Journal dump smaller. This way I don’t have to try to keep track of the “latest” event to drag data from. Refuelling e.g. can happen from whopping <em>4</em> (or more) different events and it’s painful to compare all and check which one is the latest to keep track of the real current fuel levels for each tank.</p><a href="https://beko.famkos.net/wp-content/uploads/2025/03/elite-dangerous-journal-via-mqtt-demo.png" rel="nofollow noopener noreferrer" target="_blank"></a><p>Downside is I won’t get a full set of data for the current session any more if I have to reload my <code>HUD</code> app. This could be mitigated by using <code>MQTT</code> though where I could simply persist each event topic. That is already implemented and I can choose between <code>SocketIO</code> or <code>MQTT</code> in my app anyway.</p><p><a href="https://beko.famkos.net/2025/03/29/parsing-the-elite-dangerous-journal/" class="" rel="nofollow noopener noreferrer" target="_blank">https://beko.famkos.net/2025/03/29/parsing-the-elite-dangerous-journal/</a></p><p><a rel="nofollow noopener noreferrer" class="hashtag u-tag u-category" href="https://beko.famkos.net/tag/elitedangerous/" target="_blank">#EliteDangerous</a> <a rel="nofollow noopener noreferrer" class="hashtag u-tag u-category" href="https://beko.famkos.net/tag/elitedangerousodyssey/" target="_blank">#EliteDangerousOdyssey</a> <a rel="nofollow noopener noreferrer" class="hashtag u-tag u-category" href="https://beko.famkos.net/tag/homecockpit/" target="_blank">#homeCockpit</a> <a rel="nofollow noopener noreferrer" class="hashtag u-tag u-category" href="https://beko.famkos.net/tag/mqtt/" target="_blank">#MQTT</a> <a rel="nofollow noopener noreferrer" class="hashtag u-tag u-category" href="https://beko.famkos.net/tag/nodered/" target="_blank">#NodeRed</a> <a rel="nofollow noopener noreferrer" class="hashtag u-tag u-category" href="https://beko.famkos.net/tag/simpit/" target="_blank">#simpit</a> <a rel="nofollow noopener noreferrer" class="hashtag u-tag u-category" href="https://beko.famkos.net/tag/socketio/" target="_blank">#SocketIO</a></p>
Recent searches
Search options
#EliteDangerousOdyssey
1 post1 participant0 posts today
Seems like Fleet Carrier jumps are not working, atm?
Read something about those being currently disabled for server performance reasons?
That'd sure suck. Can anyone confirm?
Ignore - restreaming - working on my chat bridge
[ENG/GER] ViperPit Day - Trying XWVM Alpha to experience X-Wing again
#LinuxGaming #GamingOnLinux #SimPit #Linux #EliteDangerous #EliteDangerousOdyssey #StarCitizen #PewPew #ViperPit #X4Foundations #Macross #VF1 #tech #videogames
GIF
Ignore - restreaming - working on my chat bridge
Ignore - Testing- ViperPit Day - Ace Combat 7
#LinuxGaming #GamingOnLinux #SimPit #Linux #EliteDangerous #EliteDangerousOdyssey #StarCitizen #PewPew #ViperPit #X4Foundations #Macross #VF1 #tech #videogames
GIF
Ignore - restreaming - working on my chat bridge
Ignore - Testing- ViperPit Day - Ace Combat 7
#LinuxGaming #GamingOnLinux #SimPit #Linux #EliteDangerous #EliteDangerousOdyssey #StarCitizen #PewPew #ViperPit #X4Foundations #Macross #VF1 #tech #videogames
GIF
Probably flying in my ViperPit doing pew pew
ViperPit Day - Ace Combat 7
#LinuxGaming #GamingOnLinux #SimPit #Linux #EliteDangerous #EliteDangerousOdyssey #StarCitizen #PewPew #ViperPit #X4Foundations #Macross #VF1 #tech #videogames
GIF
Colonisation details - https://www.elitedangerous.com/news/system-colonisation-beta-details
Downtime details https://forums.frontier.co.uk/threads/elite-dangerous-trailblazers-release-schedule.634056/
Elite DangerousSystem Colonisation Beta Details - Elite DangerousGreetings Commanders, With the launch of our Trailblazers update we will be bringing System Colonisation to Elite Dangerous! The launch of System Colo...
Probably flying in my ViperPit doing pew pew
ViperPit Day - Ace Combat 7
#LinuxGaming #GamingOnLinux #SimPit #Linux #EliteDangerous #EliteDangerousOdyssey #StarCitizen #PewPew #ViperPit #X4Foundations #Macross #VF1 #tech #videogames
GIF
Probably flying in my ViperPit doing pew pew
ViperPit Day - Ace Combat 7
#LinuxGaming #GamingOnLinux #SimPit #Linux #EliteDangerous #EliteDangerousOdyssey #StarCitizen #PewPew #ViperPit #X4Foundations #Macross #VF1 #tech #videogames
GIF
Probably flying in my ViperPit doing pew pew
ViperPit Day - Ace Combat 7
#LinuxGaming #GamingOnLinux #SimPit #Linux #EliteDangerous #EliteDangerousOdyssey #StarCitizen #PewPew #ViperPit #X4Foundations #Macross #VF1 #tech #videogames
GIF
Probably flying in my ViperPit doing pew pew
ViperPit Day - Ace Combat 7
#LinuxGaming #GamingOnLinux #SimPit #Linux #EliteDangerous #EliteDangerousOdyssey #StarCitizen #PewPew #ViperPit #X4Foundations #Macross #VF1 #tech #videogames
GIF
New ship hype. Roll on next week https://forums.frontier.co.uk/threads/elite-dangerous.633916/
#EliteDangerous #EliteDangerousOdyssey
