Chart Downloader/Updater Plugin

[transmitterdan]

Pavel,

If you read this I found the Netherlands chart server is dropping connections before the file is fully downloaded. About 90% of the time I cannot download their chart file from here in the US. However, wxCurl that has been moved into the O core does not return an error when the complete file does not arrive. So the plugin doesn't know the download failed. It tries to explode the zip file and fails with a cryptic log message.

I have submitted a PR that at least will put a message into the log file when the download file cannot be exploded. Also, the PR fixes the problem where sometimes users have to click the download charts button twice. I have seen several people complaining about that. It was due to trying to make the cancel flag do double duty so I just made a dedicated flag for the button state.

There is one last nuisance bug. When certain option tabs are selected such as the Connections tab pressing the return key creates a Chart Downloader Update button event. I guess the "default" button is not set by each option tab so whatever it last was is the event that gets fired by the Enter key. Is there a way we can de-select the Downloader buttons from being default when the Downloader is not visible?

[rgleason]

TDan is this related to the download button being skewed and out off the box in windows?

[transmitterdan]

Ask and ye shall receive. Netherlands cartographic office has updated their download page and now offer Nederdland base ENC files as a .zip which will work with OpenCPN chart downloader. I will send a PR for the catalog update later today.

ENC - Fairway Information Services

[transmitterdan]

If there are any IP gurus watching this thread I could use some help. On the Netherlands chart site (ENC - Fairway Information Services) several OpenCPN users reportedly become disconnected before the full chart .zip file can be downloaded so the downloader only gets a partial file. This one example end of the TCP conversation:

20211	33.359321	192.168.1.6	145.45.0.180	TCP	54	59523 → 80 [ACK] Seq=311 Ack=13105379 Win=612608 Len=0
20214	33.363423	145.45.0.180	192.168.1.6	TCP	1094	[TCP segment of a reassembled PDU]
20215	33.363523	192.168.1.6	145.45.0.180	TCP	54	59523 → 80 [ACK] Seq=311 Ack=13107799 Win=610048 Len=0
23370	47.687249	145.45.0.180	192.168.1.6	TCP	54	80 → 59523 [FIN, ACK] Seq=13107799 Ack=311 Win=15744 Len=0
23371	47.687407	192.168.1.6	145.45.0.180	TCP	54	59523 → 80 [ACK] Seq=311 Ack=13107800 Win=610048 Len=0
23374	47.687921	192.168.1.6	145.45.0.180	TCP	54	59523 → 80 [FIN, ACK] Seq=311 Ack=13107800 Win=610048 Len=0
23426	47.846116	145.45.0.180	192.168.1.6	TCP	54	80 → 59523 [ACK] Seq=13107800 Ack=312 Win=15744 Len=0

So the connection is set up by the host server with a 15 second keep-alive timeout. And we get the FIN sequence from the host pretty much 15 seconds after the last ACK from the chart downloader (IP=192.168.1.6) so I think that proves it is a timeout issue. I verified that the same thing happens with Chrome and Edge browsers at some random point during the download the host server just stops and then 15 seconds later it closes the connection.

Does anyone have an idea what could be causing this?

[rgleason]

Would Muttnick be able to help? I can send you his email.

[transmitterdan]

I don't know Muttnick but I'll take help from anybody. I have started an email with Netherlands cartography office about this. But I need to tell them something more concrete than "sometimes it works but mostly it doesn't".

[CarCode]

Originally Posted by transmitterdan

I don't know Muttnick but I'll take help from anybody. I have started an email with Netherlands cartography office about this. But I need to tell them something more concrete than "sometimes it works but mostly it doesn't".

Trying to download "Nederland.7z" without success with Firefox. First attempt failed completely, further attempts stops after 13 MB of this 52 MB file.

Gerhard

[transmitterdan]

Gerhard,

Please try the one further down Nederland zip.

[rgleason]

I don't know Muttnick but I'll take help from anybody. I have started an email with Netherlands cartography office about this. But I need to tell them something more concrete than "sometimes it works but mostly it doesn't".

TDan, I've tried to find his email, and then to search members in CF for "muttnick" no luck. Have been looking in opencpn manual for some clues.

I know he was very knowledgeable and helpful while there were TCP IP Connection problems, and bdcat may remember him, because they worked together on it. Also Håkan may remember him.

Sorry, I can't seem to do better than that. I also think he wrote some code...github? I'll check.

[rgleason]

Found him.

http://www.cruisersforum.com/forums/...ml#post1728377

Cruisers & Sailing Forums - View Profile: muttnik

I have left a private message with him.
I could not leave any url links to your Profile Dan or to this thread, so It would be best if you PM him directly.

[did-g]

Originally Posted by transmitterdan

Does anyone have an idea what could be causing this?

It looks like they have a timeout (not the keep alive) on their side.
I tried from a 1Gb link
at full speed it's downloaded in 3s at 25MB/s

if I limit to 200KB/s in wget they cut after 40/60 seconds.

[transmitterdan]

Originally Posted by did-g

It looks like they have a timeout (not the keep alive) on their side.
I tried from a 1Gb link
at full speed it's downloaded in 3s at 25MB/s

if I limit to 200KB/s in wget they cut after 40/60 seconds.

Thanks for confirming. I have started an email trail with the cartographic office. They know about the problem and I'm sure they will fix it.

[Aart K.]

Problem seems to be solved now.
For ENC charts for The Netherlands complete in .7z and/or .zip go to:
ENC - Fairway Information Services

Aart

P.S. Days are going to be longer from now on!

[transmitterdan]

Originally Posted by Aart K.

Problem seems to be solved now.
For ENC charts for The Netherlands complete in .7z and/or .zip go to:
ENC - Fairway Information Services

Aart

P.S. Days are going to be longer from now on!

Aart,

Thanks for checking this. I was able to download using the chart downloader the big "Nederland zip.zip" file. However, the smaller week 49 update file did not download correctly the first time. The second time I tried it worked. So they still may have some small problem but it is a lot better than it was. I will send email back to them confirming the improvement.

Also, we will update the chart catalog in the cloud "real soon now".

[.Paul.]

Pavel,

I think this should be addressed to you, but I am including additional information for other readers of CruisersForum.

If requested by the user, the ChartDownloader fetches charts for the Slovakian section of the Danube which were updated in 2010. Charts updated in 2013 are available, and the ChartDownloader should get these newer charts.

Here is the URL to a webpage in English that links to 2010 versions of the charts.

SlovRIS: Download

That webpage has a link to a page in Slovak with links to charts that are "constantly updated". Here is the link to the page with the updated charts.

SLOVENSK? VODOHOSPOD?RSKY PODNIK, ?.p.

Here is Google's translation of this page.

River Information Services

ENC maps Danube

Slovak Water Management Company is responsible for the creation of maps ENC (Electronic Navigational maps - electronic chart) in Slovakia. Our ENC maps are prepared in accordance with the Inland ECDIS Standard 2.1 in the whole area of the Danube from rkm 1880.2 through 1708.3 (Devin - Chlaba) except old Danube between Cunovo and Sap, since this segment is currently fairway is not maintained.

ENC maps on this site will be constantly updated.

Maps are the property of GMP. They can be downloaded for free, but may not be used for commercial purposes. Once downloaded, you need to unpack example. WinZip software.

The maps are in * .000. On You need to have installed SeeMyENC - SevenCs software from which you can download for free here.

Yesterday, 20 July 2016, I used the ChartDownloader to download charts for the Slovakian section of the Danube. The downloader's catalog is SK_IENC_Catalog.xml. The catalog contains

<zipfile_location>http://www.svp.sk/dunaj/media/2010/ENCmapyDunaja/ENCs-SK.zip</zipfile_location>

which points to the charts that were updated in 2010. I think this should be changed to

<zipfile_location>http://www.svp.sk/dunaj/media/ris/ENCs-SK.zip</zipfile_location>

in order to download the newer charts (updated in 2013). The dates in the catalog will also need to be changed.

I have downloaded both the 2010 and 2013 charts. The newer charts have depth contour lines and more shoreline detail.

Thank you,
Paul