Load and add missing assets in one batch automatically?

News and discussion about Re-Volt's development.
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Load and add missing assets in one batch automatically?

Unread post by 7wells » Sun Sep 06, 2020 8:58 am

Hi everybody,

Somewhere there are instructions to not overwrite files of the basic RVGL installation when manually adding missing game assets (as far as I correctly remember). Why should we not simply overwrite files? Are the ones from the additional assets older than the ones that come with the installer? There are quite a lot of additional files spread across many places. Would it be feasible to have a "mega" package that includes really everything to download in one batch?

I think about a bash script that can do the job (in my case for an Amazon Fire TV, but it should work for other platforms as well with a few modifications). But first I need to know if overwriting is really not good (then I would think more about it). The script would include wget - or better git clone? - and adb push.

Any hints/ suggestions/ caveats from you? Thank you!

PS:
Would it be problematic (copyright? technically?) if loading and adding additional missing assets from within RVGL?
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Re: Load and add missing assets in one batch automatically?

Unread post by 7wells » Sun Sep 06, 2020 10:30 am

I built a simple Windows Powershell script:

Code: Select all

git clone https://gitlab.com/re-volt/game_files.git	#Core assets needed to play the game.
git clone https://gitlab.com/re-volt/rvgl-dcpack.git	#Dreamcast content pack for RVGL.
git clone https://gitlab.com/re-volt/rvgl-assets.git	#Data files and localization for RVGL.
git clone https://gitlab.com/re-volt/ost.git		#Original soundtrack (based on Dreamcast version).
A few questions:
  1. Could I copy all contents (maybe without the .git files) over into the RVGL folder?
  2. Overwriting or skipping existing files?
  3. What about the following files (from rvgl-assets)?

    Code: Select all

    game_gauge_replay.rpl
    gamecontrollerdb.txt
    gamecontrollerdb_204.txt
    gamecontrollerdb_205.txt
    rvgl_changelog.txt
    I assume that the changelog is not really useful here, but the others?
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Re: Load and add missing assets in one batch automatically?

Unread post by 7wells » Sun Sep 06, 2020 10:38 am

E.g. I found these differences:

From the installed game: \RVGL\cars\panga\parameters.txt

Code: Select all

;====================
; Car spinner details
;====================

SPINNER {   	; Start spinner
ModelNum    	13
Offset      	0.000000 -55.000000 32.000000
Axis        	0.000000 1.000000 0.000000
AngVel      	1.500000
}           	; End Spinner
Cloned from GitLab: \game_files\cars\panga\parameters.txt

Code: Select all

;====================
; Car spinner details
;====================

SPINNER {   	; Start spinner
ModelNum    	13
Offset      	0.000000 -55.000000 32.000000
Axis        	0.000000 1.000000 0.000000
AngVel      	0.000000
}           	; End Spinner
I.e. AngVel values are different. So I wonder which one is the "correct" one. And consequently, again the question whether to overwrite or skip?

Interestingly, from the installed RVGL game, the cars folder is almost (but not completely) empty. Is that on intention? What is the reason for this? Why has 'panga' only parameters.txt, whereas 'q' has additionally shadow.bmp and shadow.bmq?
User avatar
Avecezar
Posts: 45
Joined: Fri May 08, 2020 7:28 am

Re: Load and add missing assets in one batch automatically?

Unread post by Avecezar » Sun Sep 06, 2020 11:02 am

You install rvgl as a patch to original re-volt assets and overwrite it. You need assets first.
User avatar
VaidX47
Site Admin
Posts: 98
Joined: Mon Dec 04, 2017 6:52 pm
Discord: VaidX47#4043
Location: 333

Re: Load and add missing assets in one batch automatically?

Unread post by VaidX47 » Sun Sep 06, 2020 11:09 am

RVGL is an upgrade. It is not bundled together as a full game for a similar reason as to why the source code is not open to everyone.
The RVGL patch only contains modified files to upgrade Re-Volt from original 1999 PC-CD release (or GOG if you own), including pre-patched with official 0916/1207, 1.2 or older version of RVGL.

All RVGL included data must be placed and overwritten on top of game_files. Speaking of game_files from IO website, these come from the original CD, only cleaned from windows only libraries, removed track editor and converted to lowercase filenames (for linux compatibility). Basically RVGL ready game data for all platforms. Although technically, it could still be used with legacy game versions, that is, if you have all needed libraries.

Shadow textures are new assets introduced in 1.2 (Mystery and other cheat cars, including custom used to have basic rectangular shadow, unlike other stock cars, since those do have dedicated textures), as for the existent files, like parameters with different values (from RVGL install), then should be fixes or upgrade over the original game, they are there for a reason.
aka Vaid; >[MediaFire Stuff]<
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Re: Load and add missing assets in one batch automatically?

Unread post by 7wells » Sun Sep 06, 2020 1:17 pm

Sorry, it is still somewhat unclear to me which are the necessary basic/original files and which ones I need on top. E.g., there are various packs: https://re-volt.io/downloads/packs
However, they show version numbers behind the latest update. So what does it mean? Is the latest version 20.0905a the basic set only? Would it make sense or is it even necessary to load/add the "packs" on top (overwriting)?
In case I am the only one with these difficulties of understanding, please do not waste your time. :blush: But maybe just 2 explanatory notes on the main page (https://rvgl.re-volt.io) would help. ;)
Currently, there is this note:
You need the original game data to play RVGL. Grab the game data and soundtrack from Re-Volt I/O.
For Windows users, there are pre-built full game packages available.
WHen I go to full game packages (https://re-volt.io/downloads/game), I see (among others) a 64bit Windows version:
https://distribute.re-volt.io/releases/ ... online.zip

Now how is this related to the newest 20.0905a version? Which one is absolutely necessary, which is optional? Is the 20.0905a "just" a beta version and the linked "online.zip" the latest release? Sorry if my questions are dumb, but I am really not sure about this. Thanks so much for your patience. :thumbsup:
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Re: Load and add missing assets in one batch automatically?

Unread post by 7wells » Sun Sep 06, 2020 2:11 pm

PS: To make it more confusing (for me ;)), there is this:
https://rvgl.re-volt.io/downloads/rvgl_ ... _win64.exe

But also this:
https://distribute.re-volt.io/releases/ ... online.zip

I understand that the "full+online" version includes lots (all?) game assets and online playing capabilities. But how does 20.0905a compare to this?

In other words:
What are the recommendable steps to have the latest and most complete stuff (incl. Dreamcast)?

Is the following the correct order for Windows?
  1. Extract this: https://distribute.re-volt.io/releases/ ... online.zip
  2. Then extract and overwrite from there: https://rvgl.re-volt.io/downloads/rvgl_ ... a_win64.7z
And for Android?
  1. Extract this: https://rvgl.re-volt.io/downloads/rvgl_ ... ndroid.apk
  2. And then?
User avatar
VaidX47
Site Admin
Posts: 98
Joined: Mon Dec 04, 2017 6:52 pm
Discord: VaidX47#4043
Location: 333

Re: Load and add missing assets in one batch automatically?

Unread post by VaidX47 » Sun Sep 06, 2020 3:52 pm

7wells wrote:
Sun Sep 06, 2020 1:17 pm
Sorry, it is still somewhat unclear to me which are the necessary basic/original files and which ones I need on top. E.g., there are various packs: https://re-volt.io/downloads/packs
However, they show version numbers behind the latest update. So what does it mean? Is the latest version 20.0905a the basic set only? Would it make sense or is it even necessary to load/add the "packs" on top (overwriting)?
The IO packs, as we (or I) call them, are completely separate entities from RVGL patch itself, they are done and compiled by different people, and those versioning numbers just tells when they were lastly updated. They are designed to be installed on RVGL, so the install ordering is:
game_files.zip -> RVGL patch (from its official website) -> RVGL Dreamcast pack + DC soundtrack (both optional) |-> everything else in your linked IO packs section (except for soundtrack*) is optional and installed in no specific order

No IO packs, DC pack (rvgl_dcpack.7z) offered from the RVGL website and Dreamcast soundtrack (aka soundtrack.zip) from https://re-volt.io/downloads/misc are highly recommended for having the best original game experience.
► Dreamcast-like carbox stack in the main menu
*Soundtrack can be overwritten on top of each other (original dreamcast or community one; both use the redbook folder)
----------
7wells wrote:
Sun Sep 06, 2020 1:17 pm
When I go to full game packages (https://re-volt.io/downloads/game), I see (among others) a 64bit Windows version:
https://distribute.re-volt.io/releases/ ... online.zip
These are also packed together by different people, they are not directly supported by RVGL Team. They exist for the convenience sake, so people can just download, extract and play. May not include the latest RVGL version (eventually will, but takes some time).

For Windows users, there is Online and Original.
- Online includes most if not all from the IO content packs section (I cannot confirm, if it includes everything, but at least car/track collection + bonus content).
Do note, the Online full game pack uses the community soundtrack instead, it sounds completely different from the original.
- Original is essentially what would you make yourself with my install ordering above without all this IO stuff (clean latest RVGL with game data + rvgl_dcpack.7z + soundtrack.zip).
----------
7wells wrote:
Sun Sep 06, 2020 2:11 pm
What are the recommendable steps to have the latest and most complete stuff (incl. Dreamcast)?
So for Windows:
- either follow my install order above or
- get either Original or Online full game pack

Android (not sure if the best solution, might be cleaner now):
1) Install and run latest apk (will give you errors, just quit)
2) Find newly created "RVGL" folder in your device
3) Extract game data from game_files.zip into your RVGL folder, merge files, do not overwrite.
If you did overwrite by accident or unsure, you can remove rvgl_version.txt file (found in RVGL folder) and run the game again. Technically the game then re-installs RVGL only assets to aforementioned folder.

To update, simply download the latest RVGL patch from its website, then install (or overwrite all files).

That's about it.
aka Vaid; >[MediaFire Stuff]<
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Re: Load and add missing assets in one batch automatically?

Unread post by 7wells » Sun Sep 06, 2020 4:37 pm

Thank you so much for your detailed answer and very helpful hints! :thumbsup: Now well understood. :)
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Re: Load and add missing assets in one batch automatically?

Unread post by 7wells » Sun Sep 06, 2020 5:00 pm

VaidX47 wrote:
Sun Sep 06, 2020 3:52 pm
No IO packs, DC pack (rvgl_dcpack.7z) offered from the RVGL website and Dreamcast soundtrack (aka soundtrack.zip) from https://re-volt.io/downloads/misc are highly recommended for having the best original game experience.
Do you really mean that none of these packs should be used for best original game experience? I do not know the history of the original game and frankly would not bother of with or without Dreamcast "flavour", as long as it is nicely playable and contains enough cars and tracks to have fun (and I guess that eiher way, there are enough ;)).
User avatar
VaidX47
Site Admin
Posts: 98
Joined: Mon Dec 04, 2017 6:52 pm
Discord: VaidX47#4043
Location: 333

Re: Load and add missing assets in one batch automatically?

Unread post by VaidX47 » Sun Sep 06, 2020 5:36 pm

7wells wrote:
Sun Sep 06, 2020 5:00 pm
VaidX47 wrote:
Sun Sep 06, 2020 3:52 pm
No IO packs, DC pack (rvgl_dcpack.7z) offered from the RVGL website and Dreamcast soundtrack (aka soundtrack.zip) from https://re-volt.io/downloads/misc are highly recommended for having the best original game experience.
Do you really mean that none of these packs should be used for best original game experience? I do not know the history of the original game and frankly would not bother of with or without Dreamcast "flavour", as long as it is nicely playable and contains enough cars and tracks to have fun (and I guess that eiher way, there are enough ;)).
For the best original experience, you get a Windows 9X machine with original game CD-ROM 8-)
Jokes aside, Dreamcast content is optional, if you want closer to original PC, you might consider getting PC soundtrack instead (although generally Dreamcast version has extended versions of existing tracks, so it's de facto recommendation).
The thing about custom/IO/community content, AI uses them in Single Races, so for pure experience you might not want to have them. Hence in my terms, it is no longer an original experience, especially for those who want to play single player and clear the progress table without any custom cars getting in your way first.
But in general RVGL might feel a bit different from the official game releases (improved AI, removed Track Editor and other tiny modified tidbits). RVGL still provides the best Re-Volt experience for the latest hardware in 2020 and so on.
aka Vaid; >[MediaFire Stuff]<
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Re: Load and add missing assets in one batch automatically?

Unread post by 7wells » Sun Sep 06, 2020 7:10 pm

Ta ever so much! :thumbsup:
User avatar
Huki
Developer
Posts: 345
Joined: Wed Dec 06, 2017 5:54 am
Discord: Huki#1668

Re: Load and add missing assets in one batch automatically?

Unread post by Huki » Sun Sep 06, 2020 8:30 pm

The recommended way for new players to get the game is to download the full game package from: https://re-volt.io/downloads/game
Just this and nothing else. This already provides you the complete game along with the latest RVGL update.

The difference between Online and Original is already explained in that page, but pick Original if you aren't sure.

The RVGL project page provides just the update patch and not the full game. You'd use it to update an existing installation (say, when a new RVGL update is released, you don't have to download the full game again).

In your case, all you need is:
https://distribute.re-volt.io/releases/ ... iginal.zip
and you're good to go.
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Re: Load and add missing assets in one batch automatically?

Unread post by 7wells » Mon Sep 07, 2020 10:27 am

Assuming that I prefer the full + online set (over the original set) and want to have the same gaming experience (same cars, tracks/levels etc.) on Android/Fire TV as on Windows 10, would I:
  1. Extract https://distribute.re-volt.io/packs/game_files.zip to the (beforehand) created RVGL folder on the Android/Fire TV device
  2. Extract https://distribute.re-volt.io/releases/ ... online.zip on top, overwriting everything? (maybe with the exception of rvgl.ini, which I should let the Android app create by itself? [see there])
I see that the full + online set contains also Windows-related stuff (of course), so maybe it is wiser to only extract the following folders from that package into the assets folder on Android?
  • cars
  • gallery
  • gfx
  • levels
  • models
However, the assets folder on Android on the other hand contains a specific script copy_assets.sh...

Code: Select all

#!/bin/bash

(cd ../../distrib && ./init.sh)
cp -r ../../distrib/assets/* .

re=^.*copy_assets.*$\|^.*assets_list.*$\|^\./$
find . -depth -print0 | while IFS= read -r -d '' file; do
  dest="${file#*./}"
  if [ -d "$file" ]; then
    dest="$dest/"
  fi
  if [[ ! -z "$dest" && ! "$dest" =~ $re ]]; then
    echo "$dest"
  fi
done | sort > assets_list.txt
... that reads from a specific file assets_list.txt, which does not contain the additional files from the full + online package. Should I add them in assets_list.txt before the script is executed?

Sorry, if I think too complicated. :blush:
User avatar
Huki
Developer
Posts: 345
Joined: Wed Dec 06, 2017 5:54 am
Discord: Huki#1668

Re: Load and add missing assets in one batch automatically?

Unread post by Huki » Tue Sep 08, 2020 7:53 am

7wells wrote:
Mon Sep 07, 2020 10:27 am
Assuming that I prefer the full + online set (over the original set) and want to have the same gaming experience (same cars, tracks/levels etc.) on Android/Fire TV as on Windows 10, would I:
  1. Extract https://distribute.re-volt.io/packs/game_files.zip to the (beforehand) created RVGL folder on the Android/Fire TV device
  2. Extract https://distribute.re-volt.io/releases/ ... online.zip on top, overwriting everything? (maybe with the exception of rvgl.ini, which I should let the Android app create by itself? [see there])
Keep in mind that rvgl_full_win64_online.zip already includes game_files.zip contents. It's either one or the other.

The "full" releases are composed of individual "packs". The page at https://distribute.re-volt.io/ lists which packs are included in each release. See win64_online, for example, which lists the following packs. For Android, you'd download these packs individually, getting everything except rvgl_common and rvgl_win64. I struck them off the list:
  • game_files [18.0328]
  • rvgl_common [20.0905] (included in the APK)
  • rvgl_win64 [20.0905] (not applicable for Android)
  • rvgl_dcpack [20.0905]
  • io_tracks [20.0623]
  • io_cars [20.0623]
  • io_tracks_bonus [20.0623]
  • io_cars_bonus [20.0623]
  • io_lmstag [20.0623]
  • io_loadlevel [18.0326]
  • io_music [20.0302]
  • io_skins [20.0623]
  • io_clockworks [18.0415]
  • io_clockworks_modern [18.0807]
  • io_soundtrack [20.0302]
On your Android device:
  1. Find the RVGL folder that was created by the app.
  2. Wipe out the entire contents of this folder.
  3. Extract all those packs.
  4. Run the app.
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Re: Load and add missing assets in one batch automatically?

Unread post by 7wells » Tue Sep 08, 2020 8:32 am

Well understood - thank you. But would it not make sense (as an alternative) to use the Windows 7z archive to extract it to that wiped RVGL folder on Android (minus some Windows-specific folders/files)? Thus, one would not have to download/ extract all the other packages listed above, and one would be sure(?) to have the same assets on Android as on Windows. Do you see what I mean? Sorry that my write-up is somewhat confusing (I am not a native English speaker).
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Re: Load and add missing assets in one batch automatically?

Unread post by 7wells » Wed Sep 09, 2020 5:07 pm

A thought for those who have difficulties in avoiding overwriting newer files:

I use adb over IP, hence:

Code: Select all

adb connect <ip to my device>
On that device, I acknowledge that the access is allowed (USB debugging must be anbled first). Then I do the following from the folder where the extracted games_zip files are stored:

Code: Select all

adb push . /storage/emulated/0/RVGL/
I know that thus the files from the newer Android package are overwritten, but I did not find out how to use adb push while ovoiding this. Now my idea was to simply install the APK after this a second time, assuming that the newer files will (again) be placed in RVGL.

Oh, and for those, who would like to see the screen of their (remote) device (in my case, it is in the living room), there is scrcpy:
https://github.com/Genymobile/scrcpy
User avatar
Huki
Developer
Posts: 345
Joined: Wed Dec 06, 2017 5:54 am
Discord: Huki#1668

Re: Load and add missing assets in one batch automatically?

Unread post by Huki » Wed Sep 09, 2020 9:27 pm

7wells wrote:
Wed Sep 09, 2020 5:07 pm
A thought for those who have difficulties in avoiding overwriting newer files: [...] Now my idea was to simply install the APK after this a second time, assuming that the newer files will (again) be placed in RVGL.
This won't work. The game looks for an rvgl_version.txt file. New assets from the APK are extracted only if the file does not exist, or it specifies an older version. To make the game extract newer assets, you simply delete this file.

In my previous post, I recommended wiping out everything within the RVGL folder before copying files. That way, you don't have to worry about overwriting anything, and when the app is run the next time, it will extract the newer files since there is no rvgl_version.txt yet. In fact, the documentation and main post is better updated with this method rather than the stuff about overwriting files.
7wells
Posts: 78
Joined: Tue Aug 25, 2020 5:18 pm

Re: Load and add missing assets in one batch automatically?

Unread post by 7wells » Thu Sep 10, 2020 7:19 am

Ah, I got it - again, thank you so much! :thumbsup:
Post Reply