Armory jams up bitcoind

[hydra44]

So I have a severe problem here !
Armory jams up bitcoind.
I grabbed the latest bincoind (Bitcoin Core version v0.16.99.0-d792e47 (release build)) and Armory versions (0.96.4 - GIT) and build them here on my Ubuntu 16.04 machine. So far everything went fine. But when you start Armory an take a look at the debug log I can see that nothing is happening. Blockchain is NOT downloading. (Firewall is disabled)

But when you kill -9 Armory (and only the Armory process) bitcoind starts downloading the blockchain.
Again stop all processes ... fire up Armory ... dubug log shows noting (for hours).
Kill Armory and see the BC entries flushing in
Delete all the DB's and trying again didn't change anything ...

[hydra44]

So here is my Logfile:
2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1154 - C++ block utilities loaded successfully 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:679 - Executing popen: free -m 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:679 - Executing popen: ['cat', '/proc/cpuinfo'] 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1271 - 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1272 - 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1273 - 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1274 - ************************************************************ 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1275 - Invoked: /usr/local/bin/../lib/armory/ArmoryQt.py --db-type=DB_FULL --satoshi-datadir=/data/bitcoin --datadir=/data/bitcoin --dbdir=/data/bitcoin/armorydb 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1276 - ************************************************************ 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1277 - Loading Armory Engine: 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1278 - Armory Version : 0.96.4 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1279 - Armory Build: : None 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1280 - PyBtcWallet Version : 1.35 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1281 - Detected Operating system: Linux 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1282 - OS Variant : Ubuntu-16.04-xenial 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1283 - User home-directory : /home/martin 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1284 - Satoshi BTC directory : /data/bitcoin 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1285 - Armory home dir : /data/bitcoin 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1286 - Detected System Specs : 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1287 - Total Available RAM : 15.57 GB 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1288 - CPU ID string : Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1289 - Number of CPU cores : 12 cores 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1290 - System is 64-bit : True 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1291 - Preferred Encoding : UTF-8 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1292 - Machine Arch : x86_64 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1293 - Available HDD (ARM) : 1076 GB 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1294 - Available HDD (BTC) : 1076 GB 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1295 - 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1296 - Network Name: Main Network 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1297 - Satoshi Port: 8333 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1298 - Do wlt check: True 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1299 - Named options/arguments to armoryengine.py: 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - force_segwit : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - nettimeout : 2 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - rescan : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - force_fcgi : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - ignoreAllZC : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - rescanBalance : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - disableModules : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - port : None 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - interport : 8223 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - coverageOutputDir: None 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - forceWalletCheck: False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - regtest : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - rebuild : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - thread_count : -1 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - datadir : /data/bitcoin 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - clearMempool : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - offline : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - armoryDBDir : /data/bitcoin/armorydb 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - armorydb_port : 9001 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - satoshiPort : DEFAULT 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - disableConfPermis: False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - useTorSettings : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - netlog : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - keypool : 100 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - coverageInclude : None 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - forceOnline : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - disableWalletCheck: False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - redownload : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - rpcBindAddr : 127.0.0.1 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - armorydb_ip : 127.0.0.1 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - multisigFile : DEFAULT 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - ram_usage : -1 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - ignoreZC : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - logDisable : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - settingsPath : /data/bitcoin/ArmorySettings.txt 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - language : en 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - db_type : DB_FULL 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - doDebug : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - enableDetSign : True 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - mtdebug : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - testnet : False 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - rpcport : DEFAULT 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - satoshiHome : /data/bitcoin 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - satoshiRpcport : DEFAULT 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - logFile : /data/bitcoin/ArmoryQt.py.log.txt 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1301 - verbosity : None 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1302 - Other arguments: 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1305 - ************************************************************ 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:1708 - C++ block utilities loaded successfully 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:3566 - Using settings file: /data/bitcoin/ArmorySettings.txt 2018-05-27 02:15:45 (ERROR) -- ArmoryUtils.py:3723 - Unsupported language specified. Defaulting to English (en) 2018-05-27 02:15:45 (INFO) -- ArmoryUtils.py:3726 - Using Language: en 2018-05-27 02:15:45 (INFO) -- BDM.py:361 - Using the asynchronous/multi-threaded BlockDataManager. 2018-05-27 02:15:45 (INFO) -- BDM.py:362 - Blockchain operations will happen in the background. 2018-05-27 02:15:45 (INFO) -- BDM.py:363 - Devs: check TheBDM.getState() before asking for data. 2018-05-27 02:15:45 (INFO) -- BDM.py:364 - Registering addresses during rescans will queue them for 2018-05-27 02:15:45 (INFO) -- BDM.py:365 - inclusion after the current scan is completed. 2018-05-27 02:15:46 (INFO) -- ArmoryUtils.py:3566 - Using settings file: /data/bitcoin/ArmorySettings.txt 2018-05-27 02:15:46 (INFO) -- ArmoryQt.py:2061 - loadWalletsAndSettings 2018-05-27 02:15:46 (INFO) -- ArmoryQt.py:2121 - Loading wallets... 2018-05-27 02:15:46 (INFO) -- ArmoryQt.py:2186 - Number of wallets read in: 1 2018-05-27 02:15:46 (INFO) -- ArmoryQt.py:2191 - Wallet (dtp53hWX): "Primary-Wallet " (No Encryption) 2018-05-27 02:15:46 (INFO) -- ArmoryQt.py:2196 - Loading Multisig Lockboxes 2018-05-27 02:15:50 (INFO) -- ArmoryQt.py:1763 - acquiring process mutex... 2018-05-27 02:15:50 (INFO) -- ArmoryQt.py:1395 - setupUriRegistration 2018-05-27 02:15:50 (INFO) -- ArmoryUtils.py:679 - Executing popen: gconftool-2 --get /desktop/gnome/url-handlers/bitcoin/command 2018-05-27 02:15:50 (INFO) -- ArmoryUtils.py:679 - Executing popen: xdg-mime query default x-scheme-handler/bitcoin 2018-05-27 02:15:50 (INFO) -- ArmoryQt.py:566 - Usermode: Expert 2018-05-27 02:15:50 (INFO) -- ArmoryQt.py:1698 - Changing usermode: 2018-05-27 02:15:50 (INFO) -- ArmoryQt.py:1699 - From: Expert 2018-05-27 02:15:50 (INFO) -- ArmoryQt.py:1707 - To: Expert 2018-05-27 02:15:50 (INFO) -- ArmoryQt.py:1836 - startBitcoindIfNecessary 2018-05-27 02:15:50 (INFO) -- ArmoryQt.py:1872 - setSatoshiPaths 2018-05-27 02:15:50 (INFO) -- ArmoryUtils.py:679 - Executing popen: ['whereis', 'bitcoind'] 2018-05-27 02:15:50 (INFO) -- SDM.py:291 - "whereis" returned: ['/usr/local/bin/bitcoind'] 2018-05-27 02:15:50 (INFO) -- SDM.py:171 - Found bitcoind in the following places: 2018-05-27 02:15:50 (INFO) -- SDM.py:173 - /usr/local/bin/bitcoind 2018-05-27 02:15:50 (INFO) -- SDM.py:173 - /usr/local/bin/bitcoind 2018-05-27 02:15:50 (INFO) -- SDM.py:175 - Using: /usr/local/bin/bitcoind 2018-05-27 02:15:50 (INFO) -- SDM.py:339 - Called startBitcoind 2018-05-27 02:15:50 (WARNING) -- SDM.py:441 - Spawning bitcoind with command: /usr/local/bin/bitcoind -datadir=/data/bitcoin -dbcache=2000 2018-05-27 02:15:50 (INFO) -- ArmoryUtils.py:679 - Executing popen: ['/usr/local/bin/bitcoind', '-datadir=/data/bitcoin', '-dbcache=2000'] 2018-05-27 02:15:50 (INFO) -- SDM.py:447 - PID of bitcoind: 16707 2018-05-27 02:15:50 (INFO) -- SDM.py:448 - PID of armory: 16684 2018-05-27 02:15:50 (INFO) -- ArmoryUtils.py:679 - Executing popen: ['python', '/usr/local/lib/armory/guardian.py', '16684', '16707'] 2018-05-27 02:15:50 (INFO) -- ArmoryQt.py:1872 - setSatoshiPaths 2018-05-27 02:15:50 (WARNING) -- SDM.py:398 - Spawning DB with command: ArmoryDB --db-type="DB_FULL" --cookie --satoshi-datadir="/data/bitcoin/blocks" --datadir="/data/bitcoin" --dbdir="/data/bitcoin/armorydb" 2018-05-27 02:15:50 (INFO) -- ArmoryUtils.py:679 - Executing popen: ['ArmoryDB', '--db-type="DB_FULL"', '--cookie', '--satoshi-datadir="/data/bitcoin/blocks"', '--datadir="/data/bitcoin"', '--dbdir="/data/bitcoin/armorydb"'] 2018-05-27 02:15:50 (INFO) -- ArmoryQt.py:1824 - Connecting on port 56905 2018-05-27 02:15:50 (INFO) -- ArmoryQt.py:1924 - Setting netmode: 1 2018-05-27 02:15:51 (INFO) -- ArmoryQt.py:1906 - loadBlockchainIfNecessary 2018-05-27 02:15:51 (INFO) -- ArmoryQt.py:1924 - Setting netmode: 1 2018-05-27 02:15:51 (INFO) -- ArmoryQt.py:4673 - Dashboard switched to "Scanning" mode 2018-05-27 02:15:51 (INFO) -- ArmoryQt.py:4673 - Dashboard switched to "Scanning" mode 2018-05-27 02:15:53 (INFO) -- ArmoryQt.py:4673 - Dashboard switched to "Scanning" mode 2018-05-27 02:15:54 (INFO) -- ArmoryQt.py:4673 - Dashboard switched to "Scanning" mode 2018-05-27 02:37:21 (INFO) -- ArmoryQt.py:5476 - BDM state is scanning -- force shutdown BDM 2018-05-27 02:37:21 (INFO) -- SDM.py:461 - Called stopBitcoind

[goatpig]

Once bitcoind starts downloading, does running Armory stops it?

[droark]

It looks like you're actually running a pre-release version of 0.17, from May 18. You really ought to run 0.16. I don't know offhand what exactly has changed in 0.17 so far. Some of it might require changes on our end. (I'm guessing not but it is possible.) That and pre-releases often have major bugs.

Also, do you have bitcoind auto-management turned on? If so, you should turn it off and manually start and stop bitcoind.

[achow101]

I am able to replicate this on testnet (haven't tried mainnet) with auto bitcoind. Bitcoind is at the same commit. It looks like bitcoind's RPCs are also stopped, so my guess is that there is some lock contention going on. I'll investigate further. Bitcoind appears to download a few blocks, and then it stops.

[achow101]

Ok, did a git bisect and found the problem. As of commit bitcoin/bitcoin@6a3b0d3, Bitcoin Core will print all of the debug.log output to the console. Since we run bitcoind without -daemon, the new output to stdout seems to be getting caught somewhere and thus blocking bitcoind from being able to do anything. I have a fix incoming that just disables this behavior from bitcoind.

You can replicate this behavior in 0.16.0 by setting printtoconsole=1 in the bitcoin.conf file. No output will appear in the debug.log file, but you can will find that the RPC interface becomes unresponsive.

[hydra44]

Thanks guys for your help !
I also noticed the stdout going to the console (and to debug.log) but couldn't link that to the Armory problem.
Reading along the Bitcoin-Core release docu I can see that some Low-Level Changes were made to the RPC. But the description is too generic to draw some 1st hand conclusions from it.
So, it this an Armory or Bitcoin-Core issue ?

[achow101]

The issue is related to both, but Armory can be more easily made compatible than Bitcoin Core. I have already PR'ed the fix in #498. For now, set printtoconsole=0 in bitcoind's bitcoin.conf file to fix the problem.