vfense / vfenseagent-nix

The Mac and Linux vFense agent

vFenseAgent-nix

The vFenseAgent-nix repository pertains to the Mac and Linux vFense agent.

Download

To download the agent please visit releases and download the agent from the release marked as Latest Release.

Documentation

To install and/or manage the agent please see the links below:

• Installing the vFense *nix agent
• Managing the *nix agent

vfenseagent-nix's Issues

Feature Request - Add apt-get dist-upgrade

Please add the feature to install patches, which are normally installed with apt-get dist-upgrade. It is necessary, for example, for Kernel Updates. Also information about CVEs would be nice.

Thank you

Linux agent not detected some software

The Linux agent seems to only detect software installed through the distro package manager (apt in this case on Ubuntu). Manually compiled programs aren't being detected. Ruby gems also aren't showing.

Debian several problems

I installed the agent on several different debian systems ( squeeze , wheezy ) , and they all failed with these error messages.
Even in a clean docker like environment it failes.
Are there minimal requirements packages voor debian ?

The log is starting with ,
Moved daemon to init.d
Added daemon to startup.
Checking run levels.
Done checking run levels.
Attempting to start agent.
TopPatch Agent is running.
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1259, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory

DEBUG : 05/01/2014 10:06:40 AM : Added result / bf40daee-df64-4659-aa82-6dd8a0f47c7f-agent to OpQueue.
INFO : 05/01/2014 10:06:40 AM : Ready up.
DEBUG : 05/01/2014 10:06:44 AM : bf40daee-df64-4659-aa82-6dd8a0f47c7f-agent / result will not be saved.
DEBUG : 05/01/2014 10:06:44 AM : Results to be sent: [<serveroperation.sofoperation.ResultOperation instance at 0x2e04170>]
DEBUG : 05/01/2014 10:06:44 AM : Operation has not been processed, or unknown operation was received.

ERROR : 05/01/2014 09:53:32 AM : Unable to save vine password.
ERROR : 05/01/2014 09:53:32 AM : Exception: [Errno 8] Exec format error
DEBUG : 05/01/2014 09:53:32 AM : Traceback (most recent call last):
File "/opt/TopPatch/agent/plugins/ra/vine/init.py", line 198, in _vine_set_password
stderr=subprocess.PIPE
File "/usr/lib/python2.7/subprocess.py", line 679, in init
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1259, in _execute_child
raise child_exception
OSError: [Errno 8] Exec format error

DEBUG : 05/01/2014 09:53:33 AM : Unable to import module rv.rvsofoperation. Skipping.
ERROR : 05/01/2014 09:53:33 AM : Exception: init() takes exactly 12 arguments (1 given)
DEBUG : 05/01/2014 09:53:33 AM : Traceback (most recent call last):
File "/opt/TopPatch/agent/src/core.py", line 103, in load_plugins
plug = _class()
TypeError: init() takes exactly 12 arguments (1 given)

INFO : 05/01/2014 09:53:33 AM : Starting agent.
DEBUG : 05/01/2014 09:53:33 AM : Internet connection detected.
INFO : 05/01/2014 09:53:33 AM : Sending initial data.
INFO : 05/01/2014 09:53:33 AM : Process the following operation: {'core_data': {}, 'reboot_delay_seconds': 90, 'plugin': u'', 'type': u'new_agent', 'raw_result': '', 'raw_operation': '{"operation_id": "d500cf8b-38bd-49ad-a10c-d2
b088c502d9-agent", "operation": "new_agent", "plugin": ""}', 'json_message': {u'operation_id': u'd500cf8b-38bd-49ad-a10c-d2b088c502d9-agent', u'operation': u'new_agent', u'plugin': u''}, 'request_method': '', 'urn_response': '',
'error': '', 'data': [], 'id': u'd500cf8b-38bd-49ad-a10c-d2b088c502d9-agent', 'shutdown_delay_seconds': 90, 'plugin_data': {}}
DEBUG : 05/01/2014 09:53:33 AM : Adding operation d500cf8b-38bd-49ad-a10c-d2b088c502d9-agent.
DEBUG : 05/01/2014 09:53:33 AM : System info sent: {"os_code": "linux", "version": "3.11.0-19-generic", "bit_type": "64", "host_name": "", "computer_name": "5790666c679b", "os_string": "debian 7.4"}
ERROR : 05/01/2014 09:53:33 AM : Error while processing operation: {'core_data': {'system_info': {'os_code': 'linux', 'version': '3.11.0-19-generic', 'bit_type': '64', 'host_name': '', 'computer_name': '5790666c679b', 'os_string
': 'debian 7.4'}}, 'reboot_delay_seconds': 90, 'plugin': u'', 'type': u'new_agent', 'raw_result': '', 'raw_operation': '{"operation_id": "d500cf8b-38bd-49ad-a10c-d2b088c502d9-agent", "operation": "new_agent", "plugin": ""}', 'js
on_message': {u'operation_id': u'd500cf8b-38bd-49ad-a10c-d2b088c502d9-agent', u'operation': u'new_agent', u'plugin': u''}, 'request_method': '', 'urn_response': '', 'error': '', 'data': [], 'id': u'd500cf8b-38bd-49ad-a10c-d2b088
c502d9-agent', 'shutdown_delay_seconds': 90, 'plugin_data': {}}
ERROR : 05/01/2014 09:53:33 AM : Exception: [Errno 2] No such file or directory
DEBUG : 05/01/2014 09:53:33 AM : Traceback (most recent call last):
File "/opt/TopPatch/agent/src/serveroperation/operationmanager.py", line 139, in process_operation
operation_methodsoperation.type
File "/opt/TopPatch/agent/src/serveroperation/operationmanager.py", line 167, in new_agent_op
operation = self._initial_data(operation)
File "/opt/TopPatch/agent/src/serveroperation/operationmanager.py", line 280, in _initial_data
operation.core_data[OperationValue.HardwareInfo] = self.hardware_info()
File "/opt/TopPatch/agent/src/serveroperation/operationmanager.py", line 596, in hardware_info
hardware_info = systeminfo.hardware()
File "/opt/TopPatch/agent/src/utils/systeminfo.py", line 116, in hardware
return utils.hardware.get_hw_info()
File "/opt/TopPatch/agent/src/utils/hardware.py", line 22, in get_hw_info
hw_info['display'] = DisplayInfo().get_display_list()
File "/opt/TopPatch/agent/src/utils/hardware.py", line 309, in get_display_list
raw_output = self._get_pci_device_info()
File "/opt/TopPatch/agent/src/utils/hardware.py", line 236, in _get_pci_device_info
process = subprocess.Popen(cmd, stdout=subprocess.PIPE)
File "/usr/lib/python2.7/subprocess.py", line 679, in init
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1259, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory

ERROR : 05/01/2014 09:54:34 AM : Unable to read data from server. Invalid JSON?
ERROR : 05/01/2014 09:54:34 AM : Exception: No JSON object could be decoded
DEBUG : 05/01/2014 09:54:34 AM : Traceback (most recent call last):
File "/opt/TopPatch/agent/src/net/netmanager.py", line 176, in send_message
received_data = response.json()
File "/opt/TopPatch/agent/deps/requests/models.py", line 651, in json
return json.loads(self.text or self.content, **kwargs)
File "/usr/lib/python2.7/json/init.py", line 326, in loads
return _default_decoder.decode(s)
File "/usr/lib/python2.7/json/decoder.py", line 365, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib/python2.7/json/decoder.py", line 383, in raw_decode
raise ValueError("No JSON object could be decoded")
ValueError: No JSON object could be decoded

Set port to talk with server

Allow the user to set the port the agent will use to talk to the vFense server.

dpkg-preconfigure error when installing debian packages

toppatch/vFense#86

Figure out how to fix the dpkg-preconfigure warning that gets passed to stderr when installing updates on Debian systems. This warning does not indicate a failure to install the update.

Github source significantly different than agent download?

Folks - I ran into an issue during agent install where serverport is not being passed to the validate method. Was going to patch and submit a pull request, but github source looks way different than content of VFAgent_0_7_0-rpm6_64.tar.gz - what gives?

Agent needs a local file based database

The agent is eating to much CPU during every startup and updates applications, when it should only be checking for release dates and data related for applications it does not have already stored locally. This will make the agent use less cpu.

New expiration keys for operations

toppatch/vFense#32

Use the new expiration keys "server_queue_ttl" and "agent_queue_ttl" in each operation to determine if an operation should be placed in queue and/or processed.

1. With "server_queue_ttl" the agent should determine, by checking if the current epoch time is less than the value of this key, if the operation is worth putting into the agent queue. This serves as a backup to what the server is already doing, by checking if the operation is past its "pickup time," meaning the operation should have not been picked up by the agent due to its expiration.

2. With "agent_queue_ttl" the agent should determine, by checking if the current epoch time is less than the value of this key, if the operation should be processed. This tells the agent to avoid processing operations that have been sitting in queue for too long.

Add bandwidth throttling

Add the ability to do bandwidth throttling when downloading packages from the server.

Missing download file

Trying to download the agent for my ubuntu boxes like I did before but file isn't there anymore?

https://github.com/vFense/vFenseAgent-nix/releases/download/v0.7.2/VFAgent_0_7_2-deb.tar.gz

Improve the severity labeling for each patch

Some patches have the wrong severity due to either no information on the severity or incorrect information from the system.

Updates failed due to user input.

This is the error that was returned in vFense operations tab.

Checking for services that may need to be restarted...done.
Checking for services that may need to be restarted...done.
Checking init scripts...
Failed to open terminal.debconf: whiptail output the above errors, giving up!
dpkg: error processing libssl1.0.0:armhf (--configure):
subprocess installed post-installation script returned error exit status 255
Errors were encountered while processing:
libssl1.0.0:armhf
E: Sub-process /usr/bin/dpkg returned an error code (1)

I tried to install the package manually and this user input popped up.

Problem when installing agent on Debian

Hi guys,

I'm testing Vfense and I have some trouble with the Agent (0.7.2) only on my debian server (Debian 7.5).
Here is what it shows in the log in /opt/TopPatch/agent_install_failure.log

2014-08-22 16:44:23.859615 : Traceback (most recent call last):
File "./install", line 1111, in install
self._clean_up()
File "./install", line 1020, in _clean_up
self._deb_remove_service()
File "./install", line 1016, in _deb_remove_service
raise Exception(err)
Exception: perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = "fr",
LC_ALL = (unset),
LC_PAPER = "fr_FR.UTF-8",
LC_ADDRESS = "fr_FR.UTF-8",
LC_MONETARY = "fr_FR.UTF-8",
LC_NUMERIC = "fr_FR.UTF-8",
LC_TELEPHONE = "fr_FR.UTF-8",
LC_IDENTIFICATION = "fr_FR.UTF-8",
LC_MEASUREMENT = "fr_FR.UTF-8",
LC_TIME = "fr_FR.UTF-8",
LC_NAME = "fr_FR.UTF-8",
LANG = "eu_FR.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").

If you have any idea on how I could fix that, it would be great !!

Thx for this awesome project !

Laurent

High Disk IO on Linux Agent

Hi All.
We are seeing really high DISK IO on machines running the agent.
Strace: http://sprunge.us/DigJ
Seeing around 60MB every 5-10 seconds.
The load increases over time, so when the agent's first start, there is no issue, after about a month they seem to be generating extreme amounts of disk IO.
We think there might be a thread locking/loop somewhere.
The file being heavily written to is etc/.rqd

Agent log file retrieval

Add the ability to pull the logs for the agent from the WebUI. This is helpful for debugging issues with the agent remotely.

Operations will now contain the response uri and request method

toppatch/vFense#46

Remove all the hardcoding that has been done and modify the code to take advantage of the new keys.

Operations should not pass their TTL after start of processing

Even though an operation has begun to be processed the agent should continually check its agent_queue_ttl and stop the operation if it passes it.

VMs are showing as physical machine

Virtual Machines are being identified as physical when they should be showing as virtual in "Machine Type."

CentOS 6.5 is not sending release dates for the applications

This is needed in order for the graphs to work.

Add app_id to to apps_to_delete in the sending of the results of an install operation

Currently you are sending the app_name and app_version, I would also like the agent to include the app_id of the application. Since the app_id is generated by add the app_name + app_version, the agent can generate it instead of the server doing it. Since we do not want to continue to bog down the server with the app_id generation.