octopussy-project / octopussy Goto Github PK
View Code? Open in Web Editor NEWOctopussy - Open Source Log Management Solution
Home Page: https://octopussy.pm
License: GNU General Public License v3.0
Octopussy - Open Source Log Management Solution
Home Page: https://octopussy.pm
License: GNU General Public License v3.0
Reports problem when huge data.
We get an "error writing file in /tmp" message !
Inserting Data... 5434/5435
Inserting Data... 5435/5435
QUERY: SELECT DATE_FORMAT(datetime,'%d/%m/%Y') as
D_datetime, instance, COUNT(DISTINCT(src_addr)) as
COUNT_DISTINCT_src_addr FROM DenyAll_Traffic_11417
WHERE instance LIKE '%ligne%' GROUP BY instance,
D_datetime ORDER BY instance, D_datetime asc LIMIT 100000
DBD::mysql::st execute failed: Error writing file
'/tmp/MYxdjWk1' (Errcode: 28) at
/usr/share/perl5/Octopussy/DB.pm line 123.
DBD::mysql::st fetchrow_hashref failed: fetch() without
execute() at /usr/share/perl5/Octopussy/DB.pm line 125.
NSCA lines in octo_parser are commented out. Is this feature active?
if ($match)
{
Octopussy::Alert::Insert_In_DB($device, $a, $line, $date);
my ($subject, $body) =
Octopussy::Alert::Message_Building($a, $device, $line);
Octopussy::Jabber::Send_Alert($subject, $body, @{$a->{imdest}});
Octopussy::Mail::Send_Message($subject, $body, @{$a->{maildest}});
#Octopussy::NSCA::Send((($a->{level} =~ /Warning/i) ? 1 : 2),
}
i see the alerts in alerts viewer. the only change was that of an upgrade to v0.9
here is an alert i created:
<octopussy_alert name="Switch_Network_Error_critical"
description="Critical Switch Network Error"
level="Critical"
msgbody="log"
msgsubject="Check device"
taxonomy="Network.Errors"
timeperiod="-ANY-"
type="dynamic">
<action>Mail</action>
<contact>nocops</contact>
<device>-ANY-</device>
<service>Cisco_Switch</service>
</octopussy_alert>
here is my main.xml:
<octopussy_system>
<database db="octopussy"
host="localhost"
password="octopussy"
user="octopussy" />
<directory alerts="/var/lib/octopussy/conf/alerts/"
base="/usr/sbin/"
contacts="/var/lib/octopussy/conf/contacts/"
data_logs="/var/lib/octopussy/logs/"
data_reports="/var/lib/octopussy/reports/"
devices="/var/lib/octopussy/conf/devices/"
main="/etc/octopussy/"
maps="/var/lib/octopussy/conf/maps/"
pid="/var/run/octopussy/"
plugins="/var/lib/octopussy/conf/plugins/"
reports="/var/lib/octopussy/conf/reports/"
services="/var/lib/octopussy/conf/services/"
tables="/var/lib/octopussy/conf/tables/"
themes="/usr/share/octopussy/THEMES/" />
<file device_models="/var/lib/octopussy/conf/device_models.xml"
device_types="/var/lib/octopussy/conf/device_types.xml"
devicegroup="/var/lib/octopussy/conf/devicegroup.xml"
dialogs="/etc/octopussy/dialogs.xml"
locations="/var/lib/octopussy/conf/locations.xml"
messages="/etc/octopussy/messages.xml"
schedule="/var/lib/octopussy/conf/schedule.xml"
taxonomy="/etc/octopussy/taxonomy.xml"
timeperiods="/etc/octopussy/timeperiods.xml"
translations="/etc/octopussy/translations.xml"
types="/etc/octopussy/types.xml"
users="/var/lib/octopussy/conf/users.xml" />
<jabber password="octopussy"
server=""
user="octopussy" />
<ldap contacts_base=""
contacts_filter=""
contacts_server=""
users_base=""
users_filter=""
users_server="" />
<nsca bin="/usr/sbin/send_nsca"
conf="/etc/send_nsca.cfg"
nagios_host="lumberjack"
nagios_server="192.168.1.25"
nagios_service="OCTOPUSSY" />
<smtp sender="[email protected]"
server="mail.internal.lan" />
No Unknown msgs for a new device don't have services
defined
[Tue Jul 25 14:04:34 2006] [error] [asp] [26139]
[error] error executing code for
include /usr/local/apache2/htdocs/octopussy/INC/table_
contacts.inc: error executing code for
include /usr/local/apache2/htdocs/octopussy/INC/table.
inc: Can't use string
("Octopussy::Contact::Configuratio") as a subroutine
ref while "strict refs" in use
at /usr/local/apache2/htdocs/octopussy/INC/table.inc
line 29. <--> ; compiled to SCALAR(0x9162ed4)
at /usr/lib/perl5/site_perl/5.8.0/Apache/ASP/Response.
pm line 844. <--> ; compiled to SCALAR(0x81fb53c)
at /usr/lib/perl5/site_perl/5.8.0/Apache/ASP/Response.
pm line 844. <--
> , /usr/lib/perl5/site_perl/5.8.0/Apache/ASP.pm line
1521
j'ai un probléme avec Octopussy .
les logs ne s'enregistre pas dans le serveur Mysql , et le octo_dispatcher n'execute pas .
et aussi j'aime avoir plus de documentation sur octopussy .
merci pour votre réponse.
Need to check fields & tables when creating/modifying
messages in services
i stopped octopussy, made sure all files (etc, usr, var) have permission octopussy (user and group). started octopussy and still getting these errors.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy/Device.pm line 146.
Use of uninitialized value in string eq at /usr/share/perl5/Octopussy/Device.pm line 147.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Bugs in escaping special characters in Wizard
Duplucated lines between Unknown & services
Dispatcher doesn't work after logrotate
v0.9.1.3
un fichier conf/devices/.xml est apparus (device a null).
je pense qu'il manque un test sur le nom du device puisque ce fichier étais pris en compte, le repertoire Unknown/Incomming a été créer ...
user get these errors in apache logs:
[Thu Aug 3 17:22:45 2006] [error] [asp] [11950]
[error] error including INC/top.inc, not compiled:
XML::Twig version 3.22 required--this is only version
3.17 at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc/XPath.pm
line 16, <DATA> line 225. <--> BEGIN
failed--compilation aborted at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc/XPath.pm
line 16, <DATA> line 225. <--> Compilation failed in
require at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc/Meta.pm
line 17, <DATA> line 225. <--> BEGIN
failed--compilation aborted at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc/Meta.pm
line 17, <DATA> line 225. <--> Compilation failed in
require at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc.pm line
14, <DATA> line 225. <--> BEGIN failed--compilation
aborted at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc.pm line
14, <DATA> line 225. <--> Compilation failed in require
at /usr/share/perl5//Octopussy/OpenDocument.pm line 10,
<DATA> line 225. <--> BEGIN failed--compilation aborted
at /usr/share/perl5//Octopussy/OpenDocument.pm line 10,
<DATA> line 225. <--> Compilation failed in require at
/usr/share/perl5//Octopussy.pm line 31, <DATA> line
225. <--> BEGIN failed--compilation aborted at
/usr/share/perl5//Octopussy.pm line 31, <DATA> line
225. <--> Compilation failed in require at
/usr/share/octopussy/INC/top.inc line 4, <DATA> line
225. <--> BEGIN failed--compilation aborted at
/usr/share/octopussy/INC/top.inc line 4, <DATA> line
225. <--> , /usr/share/perl5/Apache/ASP.pm line 1518
[Thu Aug 3 17:22:57 2006] [error] [asp] [11953]
[error] error including INC/top.inc, not compiled:
XML::Twig version 3.22 required--this is only version
3.17 at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc/XPath.pm
line 16, <DATA> line 225. <--> BEGIN
failed--compilation aborted at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc/XPath.pm
line 16, <DATA> line 225. <--> Compilation failed in
require at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc/Meta.pm
line 17, <DATA> line 225. <--> BEGIN
failed--compilation aborted at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc/Meta.pm
line 17, <DATA> line 225. <--> Compilation failed in
require at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc.pm line
14, <DATA> line 225. <--> BEGIN failed--compilation
aborted at
/usr/local/share/perl/5.8.4/OpenOffice/OODoc.pm line
14, <DATA> line 225. <--> Compilation failed in require
at /usr/share/perl5//Octopussy/OpenDocument.pm line 10,
<DATA> line 225. <--> BEGIN failed--compilation aborted
at /usr/share/perl5//Octopussy/OpenDocument.pm line 10,
<DATA> line 225. <--> Compilation failed in require at
/usr/share/perl5//Octopussy.pm line 31, <DATA> line
225. <--> BEGIN failed--compilation aborted at
/usr/share/perl5//Octopussy.pm line 31, <DATA> line
225. <--> Compilation failed in require at
/usr/share/octopussy/INC/top.inc line 4, <DATA> line
225. <--> BEGIN failed--compilation aborted at
/usr/share/octopussy/INC/top.inc line 4, <DATA> line
225. <--> , /usr/share/perl5/Apache/ASP.pm line 1518
Slt,
Dans les champs destinés aux filtres du logviewer, certaines expressions régulières ne donnent aucun résultats :
(GET|POST) /stb/exemple/
Les "/" sont peut être interprétés par Octopussy comme des limiteur d'expression régulière...
Serait-il possible de mettre en place un échappement automatique de ceux-ci ?
Parser should launch UParser only if unknown logs exist !
in NSCA.pm the subroutine Send has a duplicate check for $nsca_conf->{bin}. I guess this will error out if the conf file doesn't exist.
sub Send
{
my ($level, $msg) = @_;
Init() if (!defined $nsca_conf);
if ((defined $nsca_conf)
&& (defined $nsca_conf->{bin}) && (defined $nsca_conf->{conf})
&& (-e $nsca_conf->{bin}) && (-e $nsca_conf->{bin}))
{
open(NSCA, "| $nsca_conf->{bin} -c $nsca_conf->{conf} -H $nsca_conf->{host}");
print NSCA "$nsca_conf->{nagios_host}\t$nsca_conf->{nagios_service}\t$level\t$msg\n";
close(NSCA);
}
}
BUG in removing misformed logs
Need to remove empty log directories
Pb with variable fields messages
can't use the 'Load data' function => slow reporter
TO DO: Finish aleter
Infinite loop when logs directory is in '/' partition on the first page of the Web Interface (index.asp)
si aucune ligne d'un fichier ne match, on a l'erreur suivante :
Use of uninitialized value in concatenation (.) or string at /usr/sbin/octo_pusher line 192.
, Vitrines-Tridion-ssl_log, 2007, 07, 12, 09, 58, -1
je pense qu'en ajoutant le test sur le nombre de ligne (if ($#lines >= 0) {) à la ligne 191 ca resoudra le probleme:
unlink("$FTP_DIR/$d/$f") if (($#lines >= 0) || (-z "$FTP_DIR/$d/$f"));
Write_To_Incoming($device, $year, $month, $mday, $hour, $min, @lines);
print "$device, $service, $year, $month, $mday, $hour,
}
devient
unlink("$FTP_DIR/$d/$f") if (($#lines >= 0) || (-z "$FTP_DIR/$d/$f"));
if ($#lines >= 0) {
Write_To_Incoming($device, $year, $month, $mday, $hour, $min, @lines);
print "$device, $service, $year, $month, $mday, $hour,
}
}
Need to check that msg_id is uniq
Hi Sebastien,
I have upgraded from 0.8.9.9 to 0.9 without promems but now when starting octopussy I get lots of the same error:
ERROR: invalid rpn expression 'AccessA,UN,0,AccessA,IF'
Not sure what critical is. Everything seems to work right.
Best regards.
Reporter don't care about fields in where clause !
if user want to use a field in WHERE clause, he needs
to get it in the SELECT clause...
Need to change how we build report to take care about
this problem.
The "ERROR: No DS called..." message appears when you had a new Device Type...
rrdtool tries to update with a DS (the one of the new device type) that didn't exist when you create your RRD file... :(
BUG Dynamic type/model device in devices table
octopussy v.0.9.0.2
si le /var est a 100%, certains équipements disparaissent.
Tout équipement éditer si le /var est a 100% sont détruits!
Total events by minute unproperly refresh on the main page
BUG in dynamic locations
Unable to create Rack in Locations Page
Installed version 0.9.1.1 on Debian Etch 4.0r1 - for this to work I ran
apt-get remove librrd2
dpkg -i rrdtool_1.0.49-1_i386.deb
dpkg -i librrd0_1.0.49-1_i386.deb
Everything seems to work fine, except when I click on the "Select this message" button I get an empty screen. Is it related to running on Debian Etch?
V0.9.1.3
le dispatcher continue à loguer un device même s'il est au status "arrete" (le status "arrete" se comporte comme le status "pause")
Hello Sebastien,
I have detected some issues in debian installation.
The package is assuming that root as MySQL database admin has not password and the installation fail. During the installation it should ask for the root pass. Maybe you can use dbconfig-common for manage this.
After install the package, the directory creation /var/run/octopussy/rrd is missing.
This has been tested with Octopussy v0.8.9.6 and Debian 3.1 (stable).
Best regards.
TO DO: Finish scheduler
Message Rank can be less than 1 ! :(
Need to stop parser before deleting device
Reports launch on a static device groups does not take
logs from all device of a group.
Results are different if you set a group of device than
results based on each device separatly.
i stopped octopussy, made sure all files (etc, usr, var) have permission octopussy (user and group). started octopussy and still getting these errors.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy/Device.pm line 146.
Use of uninitialized value in string eq at /usr/share/perl5/Octopussy/Device.pm line 147.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
Use of uninitialized value in stat at /usr/share/perl5/Octopussy.pm line 139.
Use of uninitialized value in hash element at /usr/share/perl5/Octopussy.pm line 140.
BUG "Malformed UTF-8 character" warning msg in octo_parser
Devices not clickable on Maps on IE ! :(
hi, i configured another device to send to octopussy and it didn't create automatically. i am sure that logs are coming in through the syslog-ng side but did not see logs coming through octopussy. i did a diff and maybe it has something to do with:
Octopussy::Logs::Create_Directory($dir_incoming);
Octopussy::Create_Directory($dir_incoming);
diff -Naur /root/octo_backup/usr/sbin/octo_dispatcher /usr/sbin/octo_dispatcher
--- /root/octo_backup/usr/sbin/octo_dispatcher 2007-01-05 12:44:49.000000000 -0500
+++ /usr/sbin/octo_dispatcher 2007-02-28 12:06:23.000000000 -0500
@@ -25,12 +25,14 @@
sub Init
{
%device_type = ();
Octopussy::Syslog($PROG_NAME, "Load Devices Configuration");
foreach my $d (Octopussy::Device::Configurations("name"))
{
my $type = $d->{type};
$type =~ s/ /_/g;
$device_type{$d->{name}} = $type;
my $status = (defined $d->{status} ? $d->{status} : "Paused");
$device_type{$d->{name}} = $type if ($status ne "Stopped");
}
Octopussy::RRDTool::Syslog_By_DeviceType_Init();
}
@@ -45,7 +47,7 @@
my $device_dir = "$dir_data/$type/$device";
my $dir_incoming = "$device_dir/Incoming/$year/$month/$day";
- Octopussy::Logs::Create_Directory($dir_incoming);
Octopussy::Create_Directory($dir_incoming);
if (!defined $device_cache{$device})
{
if (!defined Octopussy::Device::Filename($device))
@@ -119,6 +121,6 @@
($year, $month, $mday, $hour, $min) =
($n_year, $n_month, $n_mday, $n_hour, $n_min);
}
push(@{$logs{$device}}, $line);
push(@{$logs{$device}}, $line) if (defined $device_type{$device});
}
}
Need to give sample or info about Maps creation...
RRD Error message "ERROR: illegal attempt to update using time..."
There is a bug in Octopussy v0.9.0.8 and older versions with "incorrect utf-8" xml file...
On Debian Etch, it generates an "HTTP 500 Server Error" message, with something like this in the log:
"Input is not proper UTF-8, indicate encoding !"
when a new alert is created for example, for taxonomy config.changes and critical it will alert for all other config.changes even when it is not critical.
V0.9.1.3
Si un octo_parser plante, l'état reste à Démarré.
BUG in displaying messages with special characters * + < >
--> Nagios & Samhain logs
Nedd to check that tablename has no spaces
Constants Handling
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.