Skip to main content

Gear Node Q&A

Edit this page on GitHub

Summary of common questions and answers from the official Discord #node channel.

For questions that have already been answered in one of the following pages,

the link to its existing answer will be placed in the solution section in order to avoid duplication.

Verification failed for block ... rejected: too far in the future

Hi guys! Please help me to understand what could be wrong, my node seems like doesn't work properly now. I'll attach a screenshot below. Too many verification failed errors.

context

  • Error: Verification failed for block xxxxxx received from peer: xxxxxx , Header xxxxxx rejected: too far in the future

    10:06:37 💤 Idle (19 peers), best: #6505505 (0xe347…aa2b), finalized #6505488 (0x12e0…4fa5), ⬇ 4.8kiB/s ⬆ 220.0kiB/s
    10:06:40 💔 Verification failed for block 0xe2f7243f630c10282082a6249e349d679d770467fa3d3523212f6ccc18d49eb0 received from peer: 12D3KooWPyu2AyUAkpK9VAh8HnraVRVg2SAGZqQwBEScz649MYiC, "Header 0xe2f7243f630c10282082a6249e349d679d770467fa3d3523212f6ccc18d49eb0 rejected: too far in the future"
    10:06:40 ✨ Imported #6505506 (0x2564…7a99)
    10:06:40 💔 Verification failed for block 0xe2f7243f630c10282082a6249e349d679d770467fa3d3523212f6ccc18d49eb0 received from peer: 12D3KooWQPjTpadV5n5We2kr27UDTmeMHPm53AYQ3Po26YXANDph, "Header 0xe2f7243f630c10282082a6249e349d679d770467fa3d3523212f6ccc18d49eb0 rejected: too far in the future"
    10:06:41 💔 Verification failed for block 0xe2f7243f630c10282082a6249e349d679d770467fa3d3523212f6ccc18d49eb0 received from peer: 12D3KooWEE3iEPtkkGToXPmUfSAjps3HKEKTTLB7LPYriHxxHHcL, "Header 0xe2f7243f630c10282082a6249e349d679d770467fa3d3523212f6ccc18d49eb0 rejected: too far in the future"
  • Solution: The clock of your machine is most likely not accurate. You should sync the time of your machine with an NTP server then restart the node.

    First check your current time skew by running:

    ntpdate -q pool.ntp.org

    Then check the status of timesyncd by running:

    systemctl status systemd-timesyncd.service

    If the service is disabled enable it first:

    sudo systemctl start systemd-timesyncd.service

    After that, restart the node to see if the issue is gone

    sudo systemctl restart gear-node

Windows node stuck at block #157437

Hi! My Windows-based nodes stucked at block №157437. What shall i do?

context

hi friends. Can anybody help me with this issue? This is about win based node. My Windows-based nodes stucked at block №157437.

context

Hi. My node stuck at 157437 block. Could someone please help me? Here https://telemetry.gear-tech.io/#list/0x6f022bd353c56b3e441507e1173601fd9dc0fb7547e6a95bbaf9b21f311bcab6 I see a lot of stucks at this block

context

  • Error: Execution failed: Execution aborted due to trap: wasm trap: wasm unreachable instruction executed

    2022-09-12 15:25:14.506 ERROR tokio-runtime-worker runtime: panicked at 'Storage root must match that calculated.', /Users/vadimsmirnov/.cargo/git/checkouts/substrate-e6594450811c5caa/abc1345/frame/executive/src/lib.rs:479:9
    2022-09-12 15:25:14.509 WARN tokio-runtime-worker sc_service::client::client: Block prepare storage changes error: Error at calling runtime api: Execution failed: Execution aborted due to trap: wasm trap: wasm `unreachable` instruction executed
    WASM backtrace:

    0: 0x3ab3 - <unknown>!rust_begin_unwind
    1: 0x15d7 - <unknown>!core::panicking::panic_fmt::h6b1842d842074d9f
    2: 0x11e22f - <unknown>!Core_execute_block
  • Solution: The problem was fixed so update your nodes.

    You need to download node executable from https://builds.gear.rs/gear-nightly-windows-x86_64.zip and replace old executable.

Cannot allocate memory

hello everyone. I updated the node according to the latest update, but the node stopped at block 14,523,318 and there is such an error in the logs. Can you tell me what to do?

context

Error importing block 0x4ae7f75de9466c4425487186152a5f31ae7da7e0c867dfc2c8603ebbf235c86c: consensus error: Import failed: Import failed: Error at calling runtime api: Execution failed: Execution aborted due to trap: host code panicked while being called by the runtime: Failed to create new memory with sandbox: "Sandbox error: Memory: encountered failure while operating with virtual memory: System call failed: Cannot allocate memory (os error 12)

context

  • Error: Failed to create new memory with sandbox: ... System call failed: Cannot allocate memory (os error 12)

    14:39:35 elyqq gear-node2382149]:2022-07-03 14:39:35 0 Error importing block 0xee7fd629ca528f25b46f4f3aceesc0724920157ffc86871bcaea801d31379987: consensus error: Import failed: Import failed: Error at calling runtime api: Execution failed: Excution aborted due to trap: host code panicked while being called by the runtime: Failed to create new memory with sandbox: "sandbox error Memory: System call failed: Cannot allocate memory (os error 12)" Jul 03 14:39:35 elygggear-node[2382149]: WASM backtrace:
    14:39:35 elyqq gear-node[2382149]: 0:0x173800 <unknown>!spio::sandbox:extern host function impls::memory new::h86494df2b46f540
    14:39:35 elygq gear-node 12282140 1:0x743dg-<unknown>!kaear backendsandbox::env::SandboxEnvironment<e>as dear backend common::Environment<E>>::new::ha62a9b16c2aa43e8
  • Solution: Such error messages usually indicate insufficient memory. Consider upgrade your machine's memory or increase swap space on your operating system.

    The node could take up to 8 GB of memory during syncing. The memory consumption will decrease after blocks are synced.

    So if your machine has less than 8 GB of memory, it is recommended to enable swap to prevent potential memory exhaustion.

    Please refer to Increasing the Swap Space on Ubuntu for instructions.

    For Windows, refer to How to increase swap memory in Windows instead.

Version GLIBC_2.2x not found

Hi guys! I am trying to run a gear node but there's and error /gear-node: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.29' not found (required by ./gear-node) is there anybody who can help me solve that ? 🙂

context

Guys, help pls, what happened? Why do not work?

context

You have too old linux distro. To settle the issue you could build the node from sources - https://wiki.gear-tech.io/node/setting-up#compile-gear-node-by-yourself

Failed to execute command / no such file or directory / Exec format error / status 203/exec

?????????

context

I have read all the chat above but I still couldn’t solve the problem. Please help

context

Started Gear Node.
gear-node.service: Failed to execute command: No such file or directory
gear-node.service: Failed at step EXEC spawning /root/gear-node: No such file or directory
gear-node.service: Main process exited, code=exited, status=203/EXEC
gear-node.service: Failed with result 'exit-code'.
gear-node.service: Scheduled restart job, restart counter is at 15.
Stopped Gear Node.

context

Hello! As I understood, it was not necessary to update!

Please help me, what can cause such an error?

context

HI! Can anyone help me ?

context

Whats wrong?

context

Hello everyone. After updating the node, such an error appeared. What to do? and can you help how to set up telemetry? I didn't understand how and what to write at all

context

You've specified path /root/gear-node for executable binary of the node. Please check that file is located under the path

Permission denied

Thanks. However, when I use the command "touch gear-node.service" I get the following error: "touch: cannot touch 'gear-node.service': Permission denied". When I'm using "sudo nano" I am able to configure the file gear-node.service.

context

whats wrong?

context

Can't find node in telemetry

Hey! I need a help. I can't find my node name in telemetry. Everything works fine as I see in logs

context

Hello everyone. Tell me what to do. When I close putty, I have to log out of telemetry

context

good logs? I don't see myself in telemetry v2 :/

context

How to find exactly your node in https://telemetry.gear-tech.io/?)

context

after what time will the node appear in telemetry?

context

However, I do not find out my account from https://telemetry.gear-tech.io/#/0x70f04c10c85b57482a63514576e6fab6b0df4ddcfbfdf1da8f03dc3f59ba5439

context

Logs ok? Can’t find name in telemetry

context

Please use filter for quick access.

https://discord.com/channels/891063355526217738/907067604928188426/958669927420686356

If you want to see the node in telemetry, you are to add --telemetry-url ... parameter: https://wiki.gear-tech.io/docs/node/telemetry

https://discord.com/channels/891063355526217738/907067604928188426/1011367354690707526

by the name you entered in the service file

https://discord.com/channels/891063355526217738/907067604928188426/1014250891362193448

Is it necessary to upgrade whenever a new version is released?

new update 31/03/2022? need install?

context

No need to update the node after every change. But it is important to update it after some breaking changes. We will announce such kind of updates.

How to save node key?

@Shamil hey could you be so kind as to share docs on "adding session key"? cannot find any info on that

context

yes,Thank you very much! Now it automatically drops to 3G Image How do I save the Node key?

context

Hey guys, question – If I want to move my node to another server, should I save and later import private key or there is no reason to do so right now?

context

There is no dedicated node key at the moment.

Hi, What do you mean by session key? There is a network key: https://wiki.gear-tech.io/node/backup-restore#network-key

https://discord.com/channels/891063355526217738/907067604928188426/1006212517766385745

Is there any incentive? How to get reward?

hi, its node has incentive?

context

someone knows when incentivised TN is planned?

context

Hi, no at the moment.

How to keep my node running?

I saw my node running on Telemetry, but as soon as I'm being logged off from the Terminal, it disappears. Anyone knows how to keep the node running after quitting the Terminal?

context

You can use systemd to run the node as a daemon. We are going to prepare the manual for it. But you can search in internet "configure service with systemd" at the moment, it is quite usual operation for deploying web-services.

https://discord.com/channels/891063355526217738/907067604928188426/946496878671986709

Can I use screen/tmux instead of systemd service?

Hey guys. Is it ok to just install from binary and run a node in a dev mode through screen ? or it has to be done through service creation for sure ?

context

For long time node running the service is preferable.

If you use screen/tmux, your node will not automatically restart after system reboot.

How to check node status?

Tell me, I launched the node and exited the server via ssh, what command should I use to see if the node is working when I re-enter the server?

context

You can check your node at https://telemetry.gear-tech.io/ or https://wiki.gear-tech.io/docs/node/node-as-service#checking-logs

https://discord.com/channels/891063355526217738/907067604928188426/1014248989601824868

Unavailable LOCK file

I get an error: Error: Service(Client(Backend("IO error: While lock file: /root/.local/share/gear-node/chains/staging_testnet_v2/db/full/LOCK: Resource temporarily unavailable")))

context

Help me pls

context

Hello. Tell me what the reason is.

Service(Client(Backend("IO error: While lock file: /root/.local/share/gear-node/chains/staging_testnet/db/full/LOCK: Resource temporarily unavailable")))

context

what to do?I did it according to the guide

context

how to solve a problem? Error: Service(Client(Backend("IO error: While lock file: /root/.local/share/gear-node/chains/staging_testnet/db/full/LOCK: Resource temporarily unavailable")))

context

can somebody help me? Error: Service(Client(Backend("IO error: While lock file: /root/.local/share/gear-node/chains/staging_testnet/db/full/LOCK: Resource temporarily unavailable")) it shows when i try ./gear-node

context

but, my node showed me this: what the case? what i should do?

context

Hey, did I made something error?

context

Who knows what this error is?

context

what part do i have to make up? Any idea....??

context

What should i do with that error? Error: Service(Client(Backend("IO error: While lock file: /root/.local/share/gear-node/chains/staging_testnet/db/full/LOCK: Resource temporarily unavailable")))

context

  • Error: IO error: While lock file /root/.local/share/gear-node/chains/staging_testnet_v2/db/full/LOCK: Resource temporarily unavailable

  • Solution: Please check existing solution

Program 0x... terminated with a trap

guys any idea what this error is about?

Program 0x5060…77d2 terminated with a trap: Not enough gas for loading memory.

context

After I restart the node

...
Jul 25 09:34:53 sm-server-1 gear-node[2956069]: 2022-07-25 09:34:53 👻 Program 0x9572…102d will stay in limbo until explicitly removed
Jul 25 09:34:53 sm-server-1 gear-node[2956069]: 2022-07-25 09:34:53 👻 Program 0xa0ec…9f7d will stay in limbo until explicitly removed
Jul 25 09:34:53 sm-server-1 gear-node[2956069]: 2022-07-25 09:34:53 👻 Program 0x8b85…759c will stay in limbo until explicitly removed
Jul 25 09:34:53 sm-server-1 gear-node[2956069]: 2022-07-25 09:34:53 👻 Program 0x7796…92d6 will stay in limbo until explicitly removed
Jul 25 09:34:53 sm-server-1 gear-node[2956069]: 2022-07-25 09:34:53 🪤 Program 0x7e59…96ee terminated with a trap: Gas limit exceeded
Jul 25 09:34:53 sm-server-1 gear-node[2956069]: 2022-07-25 09:34:53 👻 Program 0xf048…8a45 will stay in limbo until explicitly removed
Jul 25 09:34:55 sm-server-1 gear-node[2956069]: 2022-07-25 09:34:54 🪤 Program 0xaaa8…37a9 terminated with a trap: Gas limit exceeded
...

context

You just fetch old log messages, while syncing. That’s ok

💔 Error importing block 0x...: block has an unknown parent

Why these errors?

context

Have this logs after update, its stopped at 866244, and according to telemetry not only me

context

Hello.What was the solution with 866244? Thank you.

context

after update 🤨

context

Here is a part of console output 2022-09-02 13:50:21 💔 Error importing block 0x2142a83ff4a352ee0400bb371e8ffded2e8e6bd60fb98b71e6ea9aa418f382f8: block has an unknown parent 2022-09-02 13:50:21 Cannot set page protection for addr=0x2ada9200000 size=0x120000 mask=---: System call failed: Попытка обращения к неверному адресу. (os error 487) 2022-09-02 13:50:25 ⚙️ Syncing 0.0 bps, target=#2745800 (24 peers), best: #338499 (0x8ab4…9291), finalized #338432 (0x99d9…6483), ⬇ 652.5kiB/s ⬆ 16.5kiB/s 2022-09-02 13:50:41 failed to associate send_message response to the sender 2022-09-02 13:50:41 failed to associate send_message response to the sender 2022-09-02 13:50:41 failed to associate send_message response to the sender 2022-09-02 13:50:47 panicked at 'Cannot set/unset protection for wasm mem: MprotectError { interval: 2944890044416..=2944891224064, mask: 0 }', /Users/vadimsmirnov/Documents/projects/gear/common/src/lazy_pages.rs:56:5 2022-09-02 13:50:47 Block prepare storage changes error: Error at calling runtime api: Execution failed: Execution aborted due to trap: wasm trap: wasm unreachable instruction executed

context

Need to purge the chain:

sudo systemctl stop gear-node
/root/gear-node purge-chain
sudo systemctl start gear-node

💔 The bootnode you want to connect to provided a different peer ID than the one you expect

Hi! Have some problem with node:Jul 31 20:26:03 vmi955015.contaboserver.net gear-node[41467]: 2022-07-31 20:26:03 💔 The bootnode you want to connect to at /dns4/testnet-validator-node2.gear-tech.io/tcp/30333/p2p/12D3KooWCfm5T1uRq3rCNzqjsq3eFwu8fjHkUo1XBZmZvo611BwA provided a different peer ID 12D3KooWRf7vAr79yAyDxGvYAdSqhh2EoeWe35Lx4QH4N6XMv2gH than the one you expect 12D3KooWCfm5T1uRq3rCNzqjsq3eFwu8fjHkUo1XBZmZvo611BwA.

context

Is it normal?

logs after udate

is it good logs?

context

How do I change default ports for node?

Hello everyone. Does anyone know how to change ports for node?

context

Unexpected argument when starting the node service

  • Error: Found argument '\' which wasn't expected, or isn't valid in this context

  • Solution: Please check existing solution

Corrupted data base

Asked this in general , but it seems i should have asked this here.

Guys, do you know what to do with it? Configuration of PC is 3gb RAM/20gb memory. Node restart doesn't help

context

  • Error: Database version cannot be read from existing db_version file

help me please, i just restart node and start get this

context

  • Alternative error: Invalid argument: Column families not opened: ..., col2, col1, col0

  • Solution: Please check existing solution

Node executable file obsolescence

Why it's not working?

context

  • Error: Verification failed for block <block-id> received from peer <peer-id>

Please help

context

whats wrong?

context

I updated the node, but still the error, help me fix it

context

Hello! My node stops synchronize, I was trying to restart it and catch such errors

context

  • Alternative error: runtime requires function imports which are not present on the host

  • Solution: Please check existing solution

Masked service

what is the problem?

context

  • Error: Failed to start gear-node.service: Unit gear-node.service is masked.

  • Solution: Please check existing solution