Trudesk has been running great on far on my ubuntu server.
but recently i had like 2000 tickets and the interface became heavy and trudesk went offline.
unable to reproduce the issue thought when trudesk hit the 1000 open ticket it start slowing down.
also when will version 1.0.7 be release?
trudesk version 1.0.6
os: ubuntu 18.04
processor: intel core i3 3.37GHZ
ram: 16 gb
memory: 1TB
I need a little more information. Can you tell me how many notifications the users have active? If you clear notifications does it speed up? How many users are active on the site during this time? When you say it went offline, did the server crash or the disconnected overlay was displayed but the server was still running? If it crashed can you provide the section of the log that shows the crash?
I doubt it is the ticket count. I develop with a server with over 100,000 tickets, but how many active users could play a role.
As far as 1.0.7, I’m trying to test it as much as possible due to the amount of code and database changes that occur. The permission system is a huge update, and affects the majority of the codebase.
i really think the issue is with my config.
{
“header”: {
“event”: “Allocation failed - JavaScript heap out of memory”,
“location”: “OnFatalError”,
“filename”: “report.20190308.091302.10675.001.json”,
“dumpEventTime”: “2019-03-08T09:13:02Z”,
“dumpEventTimeStamp”: “1552021982455”,
“processId”: 10675,
“commandLine”: [
“node”,
“/usr/local/lib/node_modules/pm2/lib/ProcessContainerFork.js”
],
“nodejsVersion”: “v11.9.0”,
“glibcVersion”: “2.12”,
“wordSize”: 64,
“componentVersions”: {
“node”: “11.9.0”,
“v8”: “7.0.276.38-node.16”,
“uv”: “1.25.0”,
“zlib”: “1.2.11”,
“brotli”: “1.0.7”,
“ares”: “1.15.0”,
“modules”: “67”,
“nghttp2”: “1.34.0”,
“napi”: “4”,
“llhttp”: “1.0.1”,
“http_parser”: “2.8.0”,
“openssl”: “1.1.1a”,
“cldr”: “34.0”,
“icu”: “63.1”,
“tz”: “2018e”,
“unicode”: “11.0”,
“arch”: “x64”,
“platform”: “linux”,
“release”: “node”
},
“osVersion”: “Linux 4.15.0-46-generic #49-Ubuntu SMP Wed Feb 6 09:33:07 UTC 2019”,
“glibc”: “2.27”,
“machine”: “Linux 4.15.0-46-generic #49-Ubuntu SMP Wed Feb 6 09:33:07 UTC 2019serverga x86_64”
},
“javascriptStack”: {
“message”: “No stack.”,
“stack”: [
“Unavailable.”
]
},
“nativeStack”: [
" [pc=0xa61a28] report::TriggerNodeReport(v8::Isolate*, node::Environment*, char const*, char const*, std::string, v8::Localv8::String) [node /home/admin/trudesk/app.js]",
" [pc=0x9526e3] node::OnFatalError(char const*, char const*) [node /home/admin/trudesk/app.js]",
" [pc=0xb28c2e] v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [node /home/admin/trudesk/app.js]",
" [pc=0xb28e64] v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [node /home/admin/trudesk/app.js]",
" [pc=0xf25bd2] [node /home/admin/trudesk/app.js]",
" [pc=0xf25cd8] v8::internal::Heap::CheckIneffectiveMarkCompact(unsigned long, double) [node /home/admin/trudesk/app.js]",
" [pc=0xf323f8] v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::GCCallbackFlags) [node /home/admin/trudesk/app.js]",
" [pc=0xf32f0b] v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [node /home/admin/trudesk/app.js]",
" [pc=0xf35c41] v8::internal::Heap::AllocateRawWithRetryOrFail(int, v8::internal::AllocationSpace, v8::internal::AllocationAlignment) [node /home/admin/trudesk/app.js]",
" [pc=0xeffe74] v8::internal:
:NewFillerObject(int, bool, v8::internal::AllocationSpace) [node /home/admin/trudesk/app.js]",
" [pc=0x11b582e] v8::internal::Runtime_AllocateInNewSpace(int, v8::internal::Object**, v8::internal::Isolate*) [node /home/admin/trudesk/app.js]",
" [pc=0x1a76817cfc5d] "
],
“javascriptHeap”: {
“totalMemory”: 1477410816,
“totalCommittedMemory”: 1472267512,
“usedMemory”: 1419655400,
“availableMemory”: 50947488,
“memoryLimit”: 1526909922,
“heapSpaces”: {
“read_only_space”: {
“memorySize”: 524288,
“committedMemory”: 42224,
“capacity”: 515584,
“used”: 33520,
“available”: 482064
},
“new_space”: {
“memorySize”: 2097152,
“committedMemory”: 1250328,
“capacity”: 1031168,
“used”: 293608,
“available”: 737560
},
“old_space”: {
“memorySize”: 1458245632,
“committedMemory”: 1458089936,
“capacity”: 1410207048,
“used”: 1409786320,
“available”: 420728
},
“code_space”: {
“memorySize”: 3670016,
“committedMemory”: 3574272,
“capacity”: 2984736,
“used”: 2984736,
“available”: 0
},
“map_space”: {
“memorySize”: 6828032,
“committedMemory”: 3265056,
“capacity”: 1887040,
“used”: 1887040,
“available”: 0
},
“large_object_space”: {
“memorySize”: 6045696,
“committedMemory”: 6045696,
“capacity”: 53977312,
“used”: 4670176,
“available”: 49307136
},
“new_large_object_space”: {
“memorySize”: 0,
“committedMemory”: 0,
“capacity”: 0,
“used”: 0,
“available”: 0
}
}
},
“resourceUsage”: {
“userCpuSeconds”: 4567.74,
“kernelCpuSeconds”: 4567.74,
“cpuConsumptionPercent”: 0.000588618,
“maxRss”: 1955053568,
“pageFaults”: {
“IORequired”: 0,
“IONotRequired”: 9631789
},
“fsActivity”: {
“reads”: 5336,
“writes”: 3072
}
},
“uvthreadResourceUsage”: {
“userCpuSeconds”: 3669.48,
“kernelCpuSeconds”: 3669.48,
“cpuConsumptionPercent”: 0.000472865,
“fsActivity”: {
“reads”: 4896,
“writes”: 3072
}
},
“libuv”: [
],
“environmentVariables”: {
“prev_restart_delay”: “0”,
“versioning”: “[object Object]”,
“node_version”: “11.9.0”,
“version”: “1.0.5”,
“unstable_restarts”: “0”,
“restart_time”: “14”,
“created_at”: “1551945292971”,
“axm_dynamic”: “[object Object]”,
“axm_options”: “[object Object]”,
“axm_monitor”: “[object Object]”,
“axm_actions”: “”,
“pm_uptime”: “1552015426085”,
“status”: “launching”,
“unique_id”: “de15fccb-9ae0-488f-b7fb-7aee9c450549”,
“PM2_HOME”: “/root/.pm2”,
“CLUTTER_IM_MODULE”: “xim”,
“LS_COLORS”: “rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:.tar=01;31:.tgz=01;31:.arc=01;31:.arj=01;31:.taz=01;31:.lha=01;31:.lz4=01;31:.lzh=01;31:.lzma=01;31:.tlz=01;31:.txz=01;31:.tzo=01;31:.t7z=01;31:.zip=01;31:.z=01;31:.Z=01;31:.dz=01;31:.gz=01;31:.lrz=01;31:.lz=01;31:.lzo=01;31:.xz=01;31:.zst=01;31:.tzst=01;31:.bz2=01;31:.bz=01;31:.tbz=01;31:.tbz2=01;31:.tz=01;31:.deb=01;31:.rpm=01;31:.jar=01;31:.war=01;31:.ear=01;31:.sar=01;31:.rar=01;31:.alz=01;31:.ace=01;31:.zoo=01;31:.cpio=01;31:.7z=01;31:.rz=01;31:.cab=01;31:.wim=01;31:.swm=01;31:.dwm=01;31:.esd=01;31:.jpg=01;35:.jpeg=01;35:.mjpg=01;35:.mjpeg=01;35:.gif=01;35:.bmp=01;35:.pbm=01;35:.pgm=01;35:.ppm=01;35:.tga=01;35:.xbm=01;35:.xpm=01;35:.tif=01;35:.tiff=01;35:.png=01;35:.svg=01;35:.svgz=01;35:.mng=01;35:.pcx=01;35:.mov=01;35:.mpg=01;35:.mpeg=01;35:.m2v=01;35:.mkv=01;35:.webm=01;35:.ogm=01;35:.mp4=01;35:.m4v=01;35:.mp4v=01;35:.vob=01;35:.qt=01;35:.nuv=01;35:.wmv=01;35:.asf=01;35:.rm=01;35:.rmvb=01;35:.flc=01;35:.avi=01;35:.fli=01;35:.flv=01;35:.gl=01;35:.dl=01;35:.xcf=01;35:.xwd=01;35:.yuv=01;35:.cgm=01;35:.emf=01;35:.ogv=01;35:.ogx=01;35:.aac=00;36:.au=00;36:.flac=00;36:.m4a=00;36:.mid=00;36:.midi=00;36:.mka=00;36:.mp3=00;36:.mpc=00;36:.ogg=00;36:.ra=00;36:.wav=00;36:.oga=00;36:.opus=00;36:.spx=00;36:.xspf=00;36:”,
“LC_MEASUREMENT”: “en_US.UTF-8”,
“LESSCLOSE”: “/usr/bin/lesspipe %s %s”,
“LC_PAPER”: “en_US.UTF-8”,
“TERMINATOR_UUID”: “urn:uuid:68af0199-9886-4860-9d9f-590de9f259c4”,
“LC_MONETARY”: “en_US.UTF-8”,
“XDG_MENU_PREFIX”: “gnome-”,
“LANG”: “en_US.UTF-8”,
“DISPLAY”: “:0”,
“GNOME_SHELL_SESSION_MODE”: “ubuntu”,
“COLORTERM”: “truecolor”,
“USERNAME”: “admin”,
“JAVA_HOME”: “/usr/lib/jvm/java-10-oracle”,
“J2SDKDIR”: “/usr/lib/jvm/java-10-oracle”,
“XDG_VTNR”: “2”,
“GIO_LAUNCHED_DESKTOP_FILE_PID”: “3719”,
“SSH_AUTH_SOCK”: “/run/user/1000/keyring/ssh”,
“MANDATORY_PATH”: “/usr/share/gconf/ubuntu.mandatory.path”,
“S_COLORS”: “auto”,
“LC_NAME”: “en_US.UTF-8”,
“XDG_SESSION_ID”: “169”,
“DERBY_HOME”: “/usr/lib/jvm/java-10-oracle/db”,
“USER”: “root”,
“DESKTOP_SESSION”: “ubuntu”,
“QT4_IM_MODULE”: “xim”,
“TEXTDOMAINDIR”: “/usr/share/locale/”,
“DEFAULTS_PATH”: “/usr/share/gconf/ubuntu.default.path”,
“PWD”: “/home/admin”,
“HOME”: “/root”,
“TEXTDOMAIN”: “im-config”,
“J2REDIR”: “/usr/lib/jvm/java-10-oracle”,
“SSH_AGENT_PID”: “24287”,
“QT_ACCESSIBILITY”: “1”,
“LIBVIRT_DEFAULT_URI”: “qemu:///system”,
“XDG_SESSION_TYPE”: “x11”,
“XDG_DATA_DIRS”: “/home/admin/.local/share/flatpak/exports/share:/var/lib/flatpak/exports/share/:/usr/share/ubuntu:/home/admin/.local/share/flatpak/exports/share/:/var/lib/flatpak/exports/share/:/usr/local/share/:/usr/share/:/var/lib/snapd/desktop”,
“TERMINATOR_DBUS_NAME”: “net.tenshu.Terminator20x1a6021154d881c”,
“XDG_SESSION_DESKTOP”: “ubuntu”,
“LC_ADDRESS”: “en_US.UTF-8”,
“GJS_DEBUG_OUTPUT”: “stderr”,
“LC_NUMERIC”: “en_US.UTF-8”,
“GTK_MODULES”: “gail:atk-bridge”,
“TERMINATOR_DBUS_PATH”: “/net/tenshu/Terminator2”,
“MAIL”: “/var/mail/root”,
“PAPERSIZE”: “letter”,
“WINDOWPATH”: “2”,
“SHELL”: “/bin/bash”,
“VTE_VERSION”: “5202”,
“TERM”: “xterm-256color”,
“QT_IM_MODULE”: “ibus”,
“XMODIFIERS”: “@im=ibus”,
“IM_CONFIG_PHASE”: “2”,
“XDG_CURRENT_DESKTOP”: “ubuntu:GNOME”,
“GPG_AGENT_INFO”: “/run/user/1000/gnupg/S.gpg-agent:0:1”,
“GIO_LAUNCHED_DESKTOP_FILE”: “/usr/share/applications/terminator.desktop”,
“XDG_SEAT”: “seat0”,
“SHLVL”: “2”,
“LANGUAGE”: “en”,
“LC_TELEPHONE”: “en_US.UTF-8”,
“GDMSESSION”: “ubuntu”,
“GNOME_DESKTOP_SESSION_ID”: “this-is-deprecated”,
“LOGNAME”: “root”,
“DBUS_SESSION_BUS_ADDRESS”: “unix:path=/run/user/1000/bus”,
“XDG_RUNTIME_DIR”: “/run/user/1000”,
“XAUTHORITY”: “/run/user/1000/gdm/Xauthority”,
“XDG_CONFIG_DIRS”: “/etc/xdg/xdg-ubuntu:/etc/xdg”,
“PATH”: “/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games”,
“LC_IDENTIFICATION”: “en_US.UTF-8”,
“GJS_DEBUG_TOPICS”: “JS ERROR;JS LOG”,
“SESSION_MANAGER”: “local/serverga:@/tmp/.ICE-unix/24195,unix/serverga:/tmp/.ICE-unix/24195”,
“LESSOPEN”: “| /usr/bin/lesspipe %s”,
“GTK_IM_MODULE”: “ibus”,
“LC_TIME”: “en_US.UTF-8”,
“_”: “/usr/local/bin/pm2”,
“PM2_USAGE”: “CLI”,
“NODE_APP_INSTANCE”: “1”,
“vizion_running”: “false”,
“km_link”: “false”,
“pm_pid_path”: “/root/.pm2/pids/trudesk-1.pid”,
“pm_err_log_path”: “/root/.pm2/logs/trudesk-error.log”,
“pm_out_log_path”: “/root/.pm2/logs/trudesk-out.log”,
“exec_mode”: “fork_mode”,
“exec_interpreter”: “node”,
“pm_cwd”: “/home/admin”,
“pm_exec_path”: “/home/admin/trudesk/app.js”,
“node_args”: “”,
“name”: “trudesk”,
“env”: “[object Object]”,
“merge_logs”: “true”,
“vizion”: “true”,
“autorestart”: “true”,
“watch”: “false”,
“instance_var”: “NODE_APP_INSTANCE”,
“pmx”: “true”,
“automation”: “true”,
“treekill”: “true”,
“username”: “root”,
“windowsHide”: “true”,
“kill_retry_time”: “100”,
“pm_id”: “1”,
“exit_code”: “0”
},
“userLimits”: {
“core_file_size_blocks”: {
“soft”: “unlimited”,
“hard”: “unlimited”
},
“data_seg_size_kbytes”: {
“soft”: “unlimited”,
“hard”: “unlimited”
},
“file_size_blocks”: {
“soft”: “unlimited”,
“hard”: “unlimited”
},
“max_locked_memory_bytes”: {
“soft”: 16777216,
“hard”: 16777216
},
“max_memory_size_kbytes”: {
“soft”: “unlimited”,
“hard”: “unlimited”
},
“open_files”: {
“soft”: 1048576,
“hard”: 1048576
},
“stack_size_bytes”: {
“soft”: 8388608,
“hard”: “unlimited”
},
“cpu_time_seconds”: {
“soft”: “unlimited”,
“hard”: “unlimited”
},
“max_user_processes”: {
“soft”: “unlimited”,
“hard”: “unlimited”
},
“virtual_memory_kbytes”: {
“soft”: “unlimited”,
“hard”: “unlimited”
}
},
“sharedObjects”: [
“linux-vdso.so.1”,
“/lib/x86_64-linux-gnu/libdl.so.2”,
“/lib/x86_64-linux-gnu/librt.so.1”,
“/usr/lib/x86_64-linux-gnu/libstdc++.so.6”,
“/lib/x86_64-linux-gnu/libm.so.6”,
“/lib/x86_64-linux-gnu/libgcc_s.so.1”,
“/lib/x86_64-linux-gnu/libpthread.so.0”,
“/lib/x86_64-linux-gnu/libc.so.6”,
“/lib64/ld-linux-x86-64.so.2”,
“/home/admin/trudesk/node_modules/bcrypt/lib/binding/bcrypt_lib.node”,
“/lib/x86_64-linux-gnu/libnss_files.so.2”,
“/home/admin/trudesk/node_modules/node-sass/vendor/linux-x64-67/binding.node”,
“/lib/x86_64-linux-gnu/libnss_mdns4_minimal.so.2”,
“/lib/x86_64-linux-gnu/libnss_dns.so.2”,
“/lib/x86_64-linux-gnu/libresolv.so.2”
]
}
i got this in the trudesk folder… Might help
404 on that output.log link
Also how much memory does this server have?
Trudesk sets the max_heap to 2gb on the cache process, but I’m not sure which process is hitting heap limit.
You can change the heap limit trudesk sets for the cache here: https://github.com/polonel/trudesk/blob/master/app.js#L236
The system has 8 gb memory for now and will be upgrading to 32 in the coming days.
I noticed in the log you’re on v1.0.5; upgrade to v1.0.6
https://forum.trudesk.io/t/announcement-trudesk-v1-0-6-release/96
It fixed a lot of memory issues with WebSockets and allowed increasing the transport timeout on the disconnect overlay to fight latency on the server.
The update has been performed thank you.
The issue regarding slowness has been resolve.
