GithubHelp home page GithubHelp logo

Comments (66)

marcinwisniowski avatar marcinwisniowski commented on June 18, 2024 11

@bbarani Can you tell us any ETA of DEBs for OpenSearch? It's over a year that Ubuntu users are waiting to adopt OpenSearch in place of OpenDistro :)

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024 9

APT/DEB will release with the 2.5.0 version.
#2908 (comment)

https://opensearch.org/downloads.html

from opensearch-build.

bbarani avatar bbarani commented on June 18, 2024 7

We are currently working on putting together a high level design and plan for both Windows and Deb distribution. We will publish the initial version of the plan very soon on this issue. Having said that, we don't have the release timeline for additional Linux distributions yet.

from opensearch-build.

theOperand avatar theOperand commented on June 18, 2024 6

I think we'd spend our energy building support for things like MacOS or Windows before we build a second or a third way of distributing for Linux.

Does this mean that this issue is postponed indefinitely? A .deb package would be very useful, as many organizations (such as mine) that use Ubuntu servers but no Docker are still effectively stuck on the last non-SSPL Elasticsearch version.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024 4

Finished running lintian.
I: upon return to the shell, current directory becomes /tmp/tmppyavbyxh
I: please execute "cd .." and inspect the build results.
2023-01-05 18:29:07 INFO     Found deb file: None
2023-01-05 18:29:07 INFO     Published /test/opensearch-build/deb/dist/opensearch/opensearch-2.4.1-linux-x64.deb.
2023-01-05 18:29:07 INFO     Removing /tmp/tmppyavbyxh
2023-01-05 18:29:08 INFO     Done.

It's there.

from opensearch-build.

bbarani avatar bbarani commented on June 18, 2024 4

Added Debian support in 2.5.0 release . We will keep this issue open until we add Debian support for 1.x version.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024 3

Test OS:

{
  "name" : "ip-172-31-11-119",
  "cluster_name" : "opensearch",
  "cluster_uuid" : "SDEDaK2vQNuVSduQ_rYRdw",
  "version" : {
    "distribution" : "opensearch",
    "number" : "1.3.8",
    "build_type" : "deb",
    "build_hash" : "2ac1c13e3877692bc9cbbab4c796d7244fe8486a",
    "build_date" : "2023-03-06T22:22:50.498038Z",
    "build_snapshot" : false,
    "lucene_version" : "8.10.1",
    "minimum_wire_compatibility_version" : "6.8.0",
    "minimum_index_compatibility_version" : "6.0.0-beta1"
  },
  "tagline" : "The OpenSearch Project: https://opensearch.org/"
}

OSD:


ubuntu@ip-172-31-11-119:~$ curl localhost:5601/api/status -u admin:admin --insecure
{"name":"ip-172-31-11-119","uuid":"a1b51042-002b-4c97-a3ce-92dcf330b49c","version":{"number":"1.3.8","build_hash":"55783c976d503fc1de2611d1c56b967d453bbf27","build_number":1,"build_snapshot":false},"status":{"overall":{"since":"2023-03-07T23:40:08.911Z","state":"green","title":"Green","nickname":"Looking good","icon":"success","uiColor":"secondary"},"statuses":[{"id":"core:[email protected]","message":"OpenSearch is available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"core:[email protected]","message":"SavedObjects service has completed migrations and is available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-03-07T23:40:08.911Z","state":"green","icon":"success","uiColor":"secondary"}]},"metrics":{"last_updated":"2023-03-07T23:40:04.173Z","collection_interval_in_millis":5000,"os":{"platform":"linux","platformRelease":"linux-5.15.0-1028-aws","load":{"1m":0.40478515625,"5m":0.1201171875,"15m":0.041015625},"memory":{"total_in_bytes":16377524224,"free_in_bytes":11480748032,"used_in_bytes":4896776192},"uptime_in_millis":12018000,"distro":"Ubuntu","distroRelease":"Ubuntu-20.04","cpuacct":{"control_group":"/system.slice/opensearch-dashboards.service","usage_nanos":4358022928},"cpu":{"control_group":"/system.slice/opensearch-dashboards.service","cfs_period_micros":100000,"cfs_quota_micros":-1,"stat":{"number_of_elapsed_periods":0,"number_of_times_throttled":0,"time_throttled_nanos":0}}},"process":{"memory":{"heap":{"total_in_bytes":124121088,"used_in_bytes":96783264,"size_limit":1526909922},"resident_set_size_in_bytes":165933056},"pid":5864,"event_loop_delay":0.3935230001807213,"uptime_in_millis":17644},"response_times":{"avg_in_millis":0,"max_in_millis":0},"concurrent_connections":0,"requests":{"disconnects":0,"total":0,"statusCodes":{},"status_codes":{}}}}

from opensearch-build.

mbreevoort avatar mbreevoort commented on June 18, 2024 2

Using opendistro and waiting until the debian packages are available, does it make v1 2.0 this time?

from opensearch-build.

mnin avatar mnin commented on June 18, 2024 2

@peterzhuamazon thanks for your effort to fix these issues!

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024 2

Able to get jenkins to run full end-to-end on build to assemble to upload to s3 for deb on opensearch, dashboards standby.

from opensearch-build.

BlackMetalz avatar BlackMetalz commented on June 18, 2024 2

2.5.0, lets goooooooo

from opensearch-build.

bbarani avatar bbarani commented on June 18, 2024 2

Closing this issue as we have added support in both 2.5.0 and 1.3.9 versions

from opensearch-build.

jcgraybill avatar jcgraybill commented on June 18, 2024 1

It looks like Elasticsearch's DEB packages set up SysV or systemd hooks for running Elasticsearch. In the spirit of allowing OpenSearch to be a drop-in migration, let's be sure its DEB packages are set up the same way. https://www.elastic.co/guide/en/elasticsearch/reference/current/starting-elasticsearch.html#start-deb

from opensearch-build.

deknos avatar deknos commented on June 18, 2024 1

Sure!
For Debian at least here: https://wiki.debian.org/Packaging/SourcePackage

What you do in general is, that you have an original software (like your source) and you build with debian tooling a debian source package which are the original tar.gz (just an example) and a dsc-file. with these you can build a debian binary package with dpkg-buildpackage.

for the question how to do this, there's a good tutorial by a former debian project leader:
https://www.debian.org/doc/manuals/packaging-tutorial/packaging-tutorial.en.pdf

the only drawback is: debian in general wants that you also package your dependency properly, i do not know if there's some kind of workaround if you do not want to to this.

But also: when you did this for debian (source package, from which a debian binary package is built easily), building an rpm package is very easy because they adhere to similar principles.

if you want, you can contact me ([email protected]) and i could try to help with debian packaging, i packaged software for a company a few years back :)

from opensearch-build.

dblock avatar dblock commented on June 18, 2024 1

It just means nobody is working on it. @peterzhuamazon care to update this ticket with a list of things you think one would need to do to make a .deb package so that someone can contribute?

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024 1

Tested 18.04 / 20.04 / 22.04 all have different issues.
Would need to test 3.8 python and see if that is the cause.
Thanks.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024 1

More issues:

from opensearch-build.

etgraylog avatar etgraylog commented on June 18, 2024 1

Hi @BlackMetalz! It appears execution is failing on line 24 of the Post-Installation Script. Reproducing issue after adding set -x to /var/lib/dpkg/info/opensearch.postinit (on line 4?) may help you confirm this (Note: 1st completely uninstall opensearch before modification & subsequent execution). The contents of file /var/log/opensearch/install_demo_configuration.log might contain hints on what is causing error as well. To track investigation of this problem, please create Github issue. Thank you!

from opensearch-build.

gaiksaya avatar gaiksaya commented on June 18, 2024

[Triage] We are working on the design documentation at this point. Please see #956

from opensearch-build.

deknos avatar deknos commented on June 18, 2024

Hello, please consider to generate not only debian/rpm binary packages, but also source packages.

This will for one ensure that your packaging quality will be better, it also would enhance the possibilities that your software would be included in standard repositories of systems like redhat, debian, ubuntu, suse as they will only include packages where the have the source version of.

Please consider this. This would dramatically enhance your position as a project in the opensource community.

from opensearch-build.

dblock avatar dblock commented on June 18, 2024

@deknos Do you have some more specifics about this for those like me not familiar with the different kinds of packages?

from opensearch-build.

dblock avatar dblock commented on June 18, 2024

Thanks @deknos. This is similar to how FreeBSD folks do it, or how OpenSearch was added to Homebrew, i.e. build from source using tooling on the host on which the software is ultimately going to reside. Generally I see two drawbacks to that approach: it would produce a different set of binaries depending on the environment, it doesn't produce signed binaries that users can rely on and verify the origin of (or we'd have to use the rpm process to build the binaries, then release the signed bits, but rpm doesn't exist on all platforms, and in this issue we chose to go directly to a binary package that includes signed bits built from source).

I think we'd spend our energy building support for things like MacOS or Windows before we build a second or a third way of distributing for Linux. I think though we would definitely welcome a community project just like what was done for FreeBSD and Homebrew and we could integrate it similarly to those (some source code is in opensearch-project, such as docs, and some code is not, such as the FreeBSD ports themselves).

Thanks for the offer to do the debian packaging work though, don't let me stop you from doing that! We'd gladly accept PRs here if they move us forward into the right direction. You could absolutely start contributing those things here, or build a personal repo, up to you and let us know how we can help.

from opensearch-build.

gruselglatz avatar gruselglatz commented on June 18, 2024

How is the current State? Do you need some Help? There is already a Debian Build in the project iirc in the build.gradle?

from opensearch-build.

bertvandepoel avatar bertvandepoel commented on June 18, 2024

I see this has moved to In-progress. Is there anything we can do to help with development or testing? We're upgrading from 20.04 to 22.04 and are concerned that our old pre-SSPL packages will at some point fail. So we have a lot of motivation to help out 😅

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

I see this has moved to In-progress. Is there anything we can do to help with development or testing? We're upgrading from 20.04 to 22.04 and are concerned that our old pre-SSPL packages will at some point fail. So we have a lot of motivation to help out 😅

#2460 would be a great start as we are working with Graylog forks on the implementations.

from opensearch-build.

setiah avatar setiah commented on June 18, 2024

Adding a related request from the forums - https://forum.opensearch.org/t/debian-ubuntu-installer-please/11442

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Hi @setiah @bbarani, now we have merged @mnin changes to have deb in python code, next step would be to bring it up to Jenkins.

Please advice on the plans to get it into a release form.

Thanks.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Weird issue on Jenkins as local docker does not show such cases:


2022-12-14 19:25:12 INFO     Execute debmake -f "OpenSearch Team" -e "[email protected]" -i debuild -p opensearch -n -r 1 -u 2.4.1 in /tmp/tmptbsf26kp
Traceback (most recent call last):
  File "/usr/bin/debmake", line 25, in <module>
    import debmake
ModuleNotFoundError: No module named 'debmake'
2022-12-14 19:25:12 INFO     Removing /tmp/tmptbsf26kp
Traceback (most recent call last):
  File "./src/run_assemble.py", line 58, in <module>
    sys.exit(main())
  File "./src/run_assemble.py", line 49, in main
    bundle.package(output_dir)
  File "/var/jenkins/workspace/bundle-build-zhujiaxi@2/src/assemble_workflow/bundle.py", line 103, in package
    self.min_dist.build(self.bundle_recorder.package_name, dest)
  File "/var/jenkins/workspace/bundle-build-zhujiaxi@2/src/assemble_workflow/dist.py", line 85, in build
    self.__build__(name, dest)
  File "/var/jenkins/workspace/bundle-build-zhujiaxi@2/src/assemble_workflow/dist.py", line 127, in __build__
    BundleLinuxDeb(self.filename, self.path, self.min_path).build(name, dest, self.archive_path, self.build_cls)
  File "/var/jenkins/workspace/bundle-build-zhujiaxi@2/src/assemble_workflow/bundle_linux_deb.py", line 121, in build
    subprocess.check_call(bundle_cmd, cwd=ext_dest, shell=True)
  File "/usr/local/lib/python3.7/subprocess.py", line 363, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command 'debmake -f "OpenSearch Team" -e "[email protected]" -i debuild -p opensearch -n -r 1 -u 2.4.1' returned non-zero exit status 1.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Apparently install python37 completely broke debmake on Ubuntu2004.

from opensearch-build.

jgrammen-agilitypr avatar jgrammen-agilitypr commented on June 18, 2024

Doesn't Ubuntu 20.04 Focal ship python3.8 natively? so python 3.7 would be a downgrade from the stock version of python.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

More issue:
deb-log.txt

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Doesn't Ubuntu 20.04 Focal ship python3.8 natively? so python 3.7 would be a downgrade from the stock version of python.

Our code base is based on 3.7 version, I just figured out a way to resolve the issue.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Doesn't Ubuntu 20.04 Focal ship python3.8 natively? so python 3.7 would be a downgrade from the stock version of python.

Also, the image I used does not install 38 natively, so I can just install 37 and all the new packages that relies on python3 will just install without the need of 38.

from opensearch-build.

marcosfsch avatar marcosfsch commented on June 18, 2024

I was able to run build.sh successfully using pyenv:

WORKDIR /usr/share/opensearch

RUN curl -L https://raw.githubusercontent.com/pyenv/pyenv-installer/master/bin/pyenv-installer | bash

ENV PYENV_ROOT /usr/share/opensearch/.pyenv
ENV PATH $PYENV_ROOT/shims:$PYENV_ROOT/bin:$PATH
RUN pyenv install 3.7.7

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

I was able to run build.sh successfully using pyenv:

WORKDIR /usr/share/opensearch

RUN curl -L https://raw.githubusercontent.com/pyenv/pyenv-installer/master/bin/pyenv-installer | bash

ENV PYENV_ROOT /usr/share/opensearch/.pyenv
ENV PATH $PYENV_ROOT/shims:$PYENV_ROOT/bin:$PATH
RUN pyenv install 3.7.7

Hi man, build.sh is not the issue as the problem now is with assemble.sh using debmake on Ubuntu2004 server.
Thanks.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

More issue: deb-log.txt

Hi @mnin

I am currently on vacation so I dont have access to my dev env yet.
I see your suggestions on skipping the lib check, which seems useful.
I have transitioned my current process to @prudhvigodithi and he will take care of DEB in the next few weeks.

Would love to see if this issue is resolved.
Thanks.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

New issue testing on a debian 10 with python 37 showing these:

dwz: Too few files for multifile optimization
objcopy: 'debian/opensearch/usr/lib/debug/.dwz/x86_64-linux-gnu/opensearch.debug': No such file
dh_dwz: objcopy --compress-debug-sections debian/opensearch/usr/lib/debug/.dwz/x86_64-linux-gnu/opensearch.debug returned exit code 1
make: *** [debian/rules:9: binary] Error 2
dpkg-buildpackage: error: fakeroot debian/rules binary subprocess returned exit status 2
debuild: fatal error at line 1182:
dpkg-buildpackage -us -uc -ui failed

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

I have confirmed that build have to happen at least on debian11/ubuntu2004 to bypass above errors.
At least I reach this stage on both debian11/ubuntu2004 then fail the dep checks:

deps logs

dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jar: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jarsigner: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/java: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/javac: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/javadoc: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/javap: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jcmd: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jconsole: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jdb: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jdeprscan: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jdeps: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jfr: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jhsdb: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jimage: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jinfo: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jlink: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jmap: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jmod: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jpackage: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jps: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jrunscript: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jshell: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jstack: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jstat: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/jstatd: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/keytool: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/rmiregistry: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/bin/serialver: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/jexec: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/jspawnhelper: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libattach.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libawt.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libawt_headless.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libawt_xawt.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libdt_socket.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libextnet.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libfontmanager.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libinstrument.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libj2gss.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libj2pcsc.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libj2pkcs11.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libjaas.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libjava.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libjavajpeg.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libjawt.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libjdwp.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libjimage.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libjli.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libjsig.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libjsound.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libjsvml.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/liblcms.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement_agent.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement_ext.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libmlib_image.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libnet.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libnio.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libprefs.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/librmi.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libsaproc.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libsctp.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libsplashscreen.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libsyslookup.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libverify.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/libzip.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/server/libjsig.so: .debug_info section not present
dwz: debian/opensearch/usr/share/opensearch/jdk/lib/server/libjvm.so: .debug_info section not present
dwz: Too few files for multifile optimization
dh_dwz: warning: No dwz multifile created, but not explicitly requested either so ignoring it.
dh_dwz: warning: Common issues include no debug information at all (missing -g) and
dh_dwz: warning: compressed debug information (#931891).
   dh_strip
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libsctp.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libj2pcsc.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement_ext.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libjli.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libsaproc.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libjsound.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libextnet.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libverify.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libprefs.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libj2gss.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libjawt.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libnet.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/liblcms.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libjava.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libjsvml.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libnio.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libzip.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libsplashscreen.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libjdwp.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/jexec
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libmlib_image.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libdt_socket.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libawt_xawt.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libawt.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libjsig.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libawt_headless.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libsyslookup.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libjavajpeg.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libj2pkcs11.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/librmi.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libjimage.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libinstrument.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libfontmanager.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libjaas.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement_agent.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/libattach.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/server/libjvm.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/server/libjsig.so
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/lib/jspawnhelper
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jshell
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/javap
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/keytool
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jpackage
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/java
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jrunscript
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jps
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jfr
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jcmd
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jhsdb
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jmap
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jdeprscan
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jconsole
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jdeps
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jinfo
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jmod
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/javac
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/rmiregistry
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/javadoc
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jimage
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jarsigner
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jar
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jdb
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/serialver
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jstack
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jstat
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jstatd
dh_strip: warning: Could not find the BuildID in debian/opensearch/usr/share/opensearch/jdk/bin/jlink
   dh_makeshlibs
   dh_shlibdeps
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libprefs.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libawt_headless.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libextnet.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/librmi.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/liblcms.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libnet.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libnet.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libinstrument.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libjimage.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libzip.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: error: cannot find library libXrender.so.1 needed by debian/opensearch/usr/share/opensearch/jdk/lib/libawt_xawt.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: error: cannot find library libXtst.so.6 needed by debian/opensearch/usr/share/opensearch/jdk/lib/libawt_xawt.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: error: cannot find library libXi.so.6 needed by debian/opensearch/usr/share/opensearch/jdk/lib/libawt_xawt.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libawt_xawt.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libjava.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libjdwp.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libsplashscreen.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libawt.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement_ext.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libjavajpeg.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libjawt.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt_xawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt_xawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libmlib_image.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libnet.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libjsound.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: error: cannot find library libasound.so.2 needed by debian/opensearch/usr/share/opensearch/jdk/lib/libjsound.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libattach.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libsctp.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libnio.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libnio.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libnet.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libnet.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libverify.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjli.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement_agent.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: cannot find library libjvm.so needed by debian/opensearch/usr/share/opensearch/jdk/lib/libfontmanager.so (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '/usr/share/opensearch/jdk/lib')
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libawt.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: can't extract name and version from library name 'libjava.so'
dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/opensearch/usr/share/opensearch/jdk/lib/libsctp.so was not linked against libnio.so (it uses none of the library's symbols)
dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/opensearch/usr/share/opensearch/jdk/lib/server/libjvm.so was not linked against librt.so.1 (it uses none of the library's symbols)
dpkg-shlibdeps: error: cannot continue due to the errors listed above
Note: libraries are not searched in other binary packages that do not have any shlibs or symbols file.
To help dpkg-shlibdeps find private libraries, you might need to use -l.
dh_shlibdeps: error: dpkg-shlibdeps -Tdebian/opensearch.substvars debian/opensearch/usr/share/opensearch/jdk/lib/libsctp.so debian/opensearch/usr/share/opensearch/jdk/lib/libj2pcsc.so debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement_ext.so debian/opensearch/usr/share/opensearch/jdk/lib/libjli.so debian/opensearch/usr/share/opensearch/jdk/lib/libsaproc.so debian/opensearch/usr/share/opensearch/jdk/lib/libjsound.so debian/opensearch/usr/share/opensearch/jdk/lib/libextnet.so debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement.so debian/opensearch/usr/share/opensearch/jdk/lib/libverify.so debian/opensearch/usr/share/opensearch/jdk/lib/libprefs.so debian/opensearch/usr/share/opensearch/jdk/lib/libj2gss.so debian/opensearch/usr/share/opensearch/jdk/lib/libjawt.so debian/opensearch/usr/share/opensearch/jdk/lib/libnet.so debian/opensearch/usr/share/opensearch/jdk/lib/liblcms.so debian/opensearch/usr/share/opensearch/jdk/lib/libjava.so debian/opensearch/usr/share/opensearch/jdk/lib/libjsvml.so debian/opensearch/usr/share/opensearch/jdk/lib/libnio.so debian/opensearch/usr/share/opensearch/jdk/lib/libzip.so debian/opensearch/usr/share/opensearch/jdk/lib/libsplashscreen.so debian/opensearch/usr/share/opensearch/jdk/lib/libjdwp.so debian/opensearch/usr/share/opensearch/jdk/lib/jexec debian/opensearch/usr/share/opensearch/jdk/lib/jspawnhelper debian/opensearch/usr/share/opensearch/jdk/lib/libmlib_image.so debian/opensearch/usr/share/opensearch/jdk/lib/libdt_socket.so debian/opensearch/usr/share/opensearch/jdk/lib/libawt_xawt.so debian/opensearch/usr/share/opensearch/jdk/lib/libawt.so debian/opensearch/usr/share/opensearch/jdk/lib/libjsig.so debian/opensearch/usr/share/opensearch/jdk/lib/libawt_headless.so debian/opensearch/usr/share/opensearch/jdk/lib/libsyslookup.so debian/opensearch/usr/share/opensearch/jdk/lib/libjavajpeg.so debian/opensearch/usr/share/opensearch/jdk/lib/libj2pkcs11.so debian/opensearch/usr/share/opensearch/jdk/lib/librmi.so debian/opensearch/usr/share/opensearch/jdk/lib/libjimage.so debian/opensearch/usr/share/opensearch/jdk/lib/libinstrument.so debian/opensearch/usr/share/opensearch/jdk/lib/libfontmanager.so debian/opensearch/usr/share/opensearch/jdk/lib/libjaas.so debian/opensearch/usr/share/opensearch/jdk/lib/libmanagement_agent.so debian/opensearch/usr/share/opensearch/jdk/lib/libattach.so debian/opensearch/usr/share/opensearch/jdk/lib/server/libjvm.so debian/opensearch/usr/share/opensearch/jdk/lib/server/libjsig.so debian/opensearch/usr/share/opensearch/jdk/bin/jshell debian/opensearch/usr/share/opensearch/jdk/bin/javap debian/opensearch/usr/share/opensearch/jdk/bin/keytool debian/opensearch/usr/share/opensearch/jdk/bin/jpackage debian/opensearch/usr/share/opensearch/jdk/bin/java debian/opensearch/usr/share/opensearch/jdk/bin/jrunscript debian/opensearch/usr/share/opensearch/jdk/bin/jps debian/opensearch/usr/share/opensearch/jdk/bin/jfr debian/opensearch/usr/share/opensearch/jdk/bin/jcmd debian/opensearch/usr/share/opensearch/jdk/bin/jhsdb debian/opensearch/usr/share/opensearch/jdk/bin/jmap debian/opensearch/usr/share/opensearch/jdk/bin/jdeprscan debian/opensearch/usr/share/opensearch/jdk/bin/jconsole debian/opensearch/usr/share/opensearch/jdk/bin/jdeps debian/opensearch/usr/share/opensearch/jdk/bin/jinfo debian/opensearch/usr/share/opensearch/jdk/bin/jmod debian/opensearch/usr/share/opensearch/jdk/bin/javac debian/opensearch/usr/share/opensearch/jdk/bin/rmiregistry debian/opensearch/usr/share/opensearch/jdk/bin/javadoc debian/opensearch/usr/share/opensearch/jdk/bin/jimage debian/opensearch/usr/share/opensearch/jdk/bin/jarsigner debian/opensearch/usr/share/opensearch/jdk/bin/jar debian/opensearch/usr/share/opensearch/jdk/bin/jdb debian/opensearch/usr/share/opensearch/jdk/bin/serialver debian/opensearch/usr/share/opensearch/jdk/bin/jstack debian/opensearch/usr/share/opensearch/jdk/bin/jstat debian/opensearch/usr/share/opensearch/jdk/bin/jstatd debian/opensearch/usr/share/opensearch/jdk/bin/jlink returned exit code 2
dh_shlibdeps: error: Aborting due to earlier error
make: *** [debian/rules:9: binary] Error 25
dpkg-buildpackage: error: debian/rules binary subprocess returned exit status 2
debuild: fatal error at line 1182:
dpkg-buildpackage -us -uc -ui failed
E: failed to build Debian package(s).

Tried to use @mnin suggestions on this in rules file:

override_dh_shlibdeps:
    dh_shlibdeps --dpkg-shlibdeps-params=--ignore-missing-info

Still failed and have a rule error.

Still researching.

Thanks.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Solved one:

sudo apt-get install libxrender1

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Solved two:

apt-get install libxtst6

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Solved three:

apt-get install libasound2

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Seems like more missing when running on Jenkins:

dpkg-shlibdeps: error: cannot find library libXi.so.6


apt-get install libxi6

Try again

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Seems like the above is caused by python37, python38 by default is ok with this.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Installed more pkgs and get close enough, not sure why there is suddenly a permission issue:

apt-get install libxi6 libgconf-2-4

N: 77 tags overridden (73 errors, 3 warnings, 1 info)
Finished running lintian.
I: upon return to the shell, current directory becomes /tmp/tmpy_8qwj3l
I: please execute "cd .." and inspect the build results.
2023-01-06 02:55:48 INFO     Found deb file: None
2023-01-06 02:55:48 INFO     Removing /tmp/tmpy_8qwj3l
Traceback (most recent call last):
  File "/usr/lib/python3.7/shutil.py", line 566, in move
    os.rename(src, real_dst)
PermissionError: [Errno 13] Permission denied: '/tmp/opensearch_2.4.1_amd64.deb' -> 'opensearch-2.4.1-linux-x64.deb'

During handling of the above exception, another exception occurred:

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Seems like the issue is due to user used to be root in my last test.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Also seems like we need to remove Multi-Arch: foreign as amd64 version should not be used for arm64 version?

Quote: https://wiki.debian.org/Multiarch/HOWTO

If a package is marked ‘Multi-Arch: foreign’, then it can satisfy dependencies of a package of a different architecture (e.g `debhelper:amd64` will satisfy a dependency on debhelper for any-architecture package).

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Some description might need changes as well:


 new Debian package, version 2.0.
 size 554485222 bytes: control archive=24731 bytes.
    1604 bytes,    30 lines      conffiles
     245 bytes,    10 lines      control
   94339 bytes,   934 lines      md5sums
     471 bytes,    11 lines   *  postinst             #!/bin/sh
      32 bytes,     1 lines      shlibs
      73 bytes,     2 lines      triggers
 Package: opensearch
 Version: 2.4.1
 Architecture: amd64
 Maintainer: OpenSearch Team <[email protected]>
 Installed-Size: 759860
 Section: database
 Priority: optional
 Multi-Arch: foreign
 Homepage: https://opensearch.org/
 Description: OpenSearch

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

BUG:

I: debuild
 dpkg-buildpackage -us -uc -ui
dpkg-buildpackage: info: source package opensearch-dashboards
dpkg-buildpackage: info: source version 2.4.0
dpkg-buildpackage: info: source distribution UNRELEASED
dpkg-buildpackage: info: source changed by OpenSearch Team <[email protected]>
 dpkg-source --before-build .
dpkg-buildpackage: info: host architecture amd64
 fakeroot debian/rules clean
dh clean
   dh_auto_clean
   dh_clean
 dpkg-source -b .
dpkg-source: warning: no source format specified in debian/source/format, see dpkg-source(1)
dpkg-source: warning: source directory 'tmppqr2vfon' is not <sourcepackage>-<upstreamversion> 'opensearch-dashboards-2.4.0'
dpkg-source: info: using source format '1.0'
dpkg-source: info: building opensearch-dashboards in opensearch-dashboards_2.4.0.tar.gz
dpkg-source: info: building opensearch-dashboards in opensearch-dashboards_2.4.0.dsc
 debian/rules build
dh build
   dh_update_autotools_config
   dh_autoreconf
   dh_auto_configure
   dh_auto_build
	make -j8 "INSTALL=install --strip-program=true"
make[1]: Entering directory '/tmp/tmppqr2vfon'
mkdir -p /tmp/tmppqr2vfon/debian/opensearch
cp -a /tmp/tmppqr2vfon/etc /tmp/tmppqr2vfon/debian/opensearch/etc
cp -a /tmp/tmppqr2vfon/usr /tmp/tmppqr2vfon/debian/opensearch/usr
cp -a /tmp/tmppqr2vfon/var /tmp/tmppqr2vfon/debian/opensearch/var
make[1]: Leaving directory '/tmp/tmppqr2vfon'
   dh_auto_test
   create-stamp debian/debhelper-build-stamp
 fakeroot debian/rules binary
dh binary
   dh_testroot
   dh_prep
   dh_auto_install
	make -j8 install DESTDIR=/tmp/tmppqr2vfon/debian/opensearch-dashboards AM_UPDATE_INFO_DIR=no "INSTALL=install --strip-program=true"
make[1]: Entering directory '/tmp/tmppqr2vfon'
mkdir -p /tmp/tmppqr2vfon/debian/opensearch
cp -a /tmp/tmppqr2vfon/etc /tmp/tmppqr2vfon/debian/opensearch/etc
cp -a /tmp/tmppqr2vfon/usr /tmp/tmppqr2vfon/debian/opensearch/usr
cp -a /tmp/tmppqr2vfon/var /tmp/tmppqr2vfon/debian/opensearch/var

OSD is going to OS directory causing the pkg to be only 4KB size:

4.0K	opensearch-dashboards-2.4.0-linux-x64.deb

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Also OS part the deb is having some issues to start:


● opensearch.service - OpenSearch
     Loaded: loaded (/lib/systemd/system/opensearch.service; disabled; vendor preset: enabled)
     Active: failed (Result: exit-code) since Sat 2023-01-07 01:40:08 UTC; 13s ago
       Docs: https://opensearch.org/
    Process: 10071 ExecStart=/usr/share/opensearch/bin/systemd-entrypoint -p ${PID_DIR}/opensearch.pid --quiet (code=exited, status=217/USER)
   Main PID: 10071 (code=exited, status=217/USER)

Jan 07 01:40:08 ip systemd[1]: Starting OpenSearch...
Jan 07 01:40:08 ip systemd[10071]: opensearch.service: Failed to determine user credentials: No such process
Jan 07 01:40:08 ip systemd[10071]: opensearch.service: Failed at step USER spawning /usr/share/opensearch/bin/systemd-entrypoint: No such process
Jan 07 01:40:08 ip systemd[1]: opensearch.service: Main process exited, code=exited, status=217/USER
Jan 07 01:40:08 ip systemd[1]: opensearch.service: Failed with result 'exit-code'.
Jan 07 01:40:08 ip systemd[1]: Failed to start OpenSearch.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Changed to OSD folder and now it shows more reports related deps.
Tho chrome might be removed for 2.5.0 using 2.4.x to test still need to resolve these:


dpkg-shlibdeps: warning: debian/opensearch-dashboards/usr/share/opensearch-dashboards/node_modules/re2/build/Release/re2.node contains an unresolvable reference to symbol _ZN2v814ObjectTemplate11NewInstanceENS_5LocalINS_7ContextEEE: it's probably a plugin
dpkg-shlibdeps: warning: 70 other similar warnings have been skipped (use -v to see them all)
dpkg-shlibdeps: warning: cannot find library libnss3.so needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: warning: cannot find library libnssutil3.so needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: warning: cannot find library libsmime3.so needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: warning: cannot find library libnspr4.so needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libatk-1.0.so.0 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libatk-bridge-2.0.so.0 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libcups.so.2 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libdrm.so.2 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libatspi.so.0 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libXcomposite.so.1 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libXdamage.so.1 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libXfixes.so.3 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libXrandr.so.2 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libgbm.so.1 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libxkbcommon.so.0 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libpango-1.0.so.0 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')
dpkg-shlibdeps: error: cannot find library libcairo.so.2 needed by debian/opensearch-dashboards/usr/share/opensearch-dashboards/plugins/reportsDashboards/.chromium/headless_shell (ELF format: 'elf64-x86-64' abi: '0201003e00000000'; RPATH: '')

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

libatk1.0-0 libatk-bridge2.0-0 libcups2 libdrm2 libatspi2.0-dev libxcomposite-dev libxdamage1 libxfixes3 libxfixes-dev libxrandr2 libgbm-dev libxkbcommon-x11-0 libpangocairo-1.0-0 libcairo2 libcairo2-dev libnss3 libnspr4 libnspr4-dev
freeglut3 possible
need to also install aptly and gpg.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Fixed OSD size:

318M	opensearch-dashboards-2.4.0-linux-x64.deb

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Need proper maintainers scripts just like in RPM to make DEB run correctly.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

After a lot of research we will not sign DEB packages but sign APT repo InRelease files.
As for the deb packages directly available for download, not through apt, we will provide detached .sig file just like rpm.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

OS deb now:

$ dpkg-deb -I opensearch-2.4.1-linux-x64.deb
 new Debian package, version 2.0.
 size 554486428 bytes: control archive=25738 bytes.
    1687 bytes,    32 lines      conffiles
     418 bytes,    12 lines      control
   94409 bytes,   935 lines      md5sums
    2239 bytes,    63 lines   *  postinst             #!/bin/sh
    1040 bytes,    31 lines   *  preinst              #!/bin/sh
     774 bytes,    26 lines   *  prerm                #!/bin/sh
      32 bytes,     1 lines      shlibs
      73 bytes,     2 lines      triggers
 Package: opensearch
 Version: 2.4.1
 Architecture: amd64
 Maintainer: OpenSearch Team <[email protected]>
 Installed-Size: 759872
 Section: web
 Priority: optional
 Homepage: https://opensearch.org/
 Description: An open source distributed and RESTful search engine
     OpenSearch makes it easy to ingest, search, visualize, and analyze your data
     For more information, see: https://opensearch.org/
 License: Apache-2.0

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Since Ubuntu will point the default /bin/sh to dash instead of the normal bourne shell, I will have to force everything on bash so some of the scripts like the install demo config will not fail due to it is written in bash build-ins.

$ ll /usr/bin/sh
lrwxrwxrwx 1 root root 4 Dec 12 21:39 /usr/bin/sh -> dash*
$ ll /bin/sh
lrwxrwxrwx 1 root root 4 Dec 12 21:39 /bin/sh -> dash*
$ sh /usr/share/opensearch/plugins/opensearch-security/tools/install_demo_configuration.sh -y -i -s
**************************************************************************
** This tool will be deprecated in the next major release of OpenSearch **
** https://github.com/opensearch-project/security/issues/1755           **
**************************************************************************
/usr/share/opensearch/plugins/opensearch-security/tools/install_demo_configuration.sh: 9: Bad substitution

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

OS online:

$ sudo dpkg -i opensearch-2.4.1-linux-x64.deb
Selecting previously unselected package opensearch.
(Reading database ... 146329 files and directories currently installed.)
Preparing to unpack opensearch-2.4.1-linux-x64.deb ...
Running preinst script
Unpacking opensearch (2.4.1) ...
Setting up opensearch (2.4.1) ...
Running postinst script
### NOT starting on installation, please execute the following statements to configure opensearch service to start automatically using systemd
 sudo systemctl daemon-reload
 sudo systemctl enable opensearch.service
### You can start opensearch service by executing
 sudo systemctl start opensearch.service
### Create opensearch demo certificates in /etc/opensearch/
 See demo certs creation log in /var/log/opensearch/install_demo_configuration.log
Processing triggers for libc-bin (2.31-0ubuntu9.9) ...
Processing triggers for systemd (245.4-4ubuntu3.19) ...

$ cat /var/log/opensearch/install_demo_configuration.log
**************************************************************************
** This tool will be deprecated in the next major release of OpenSearch **
** https://github.com/opensearch-project/security/issues/1755           **
**************************************************************************
OpenSearch Security Demo Installer
 ** Warning: Do not use on production or public reachable systems **
Basedir: /usr/share/opensearch
This script maybe require your root password for 'sudo' privileges
OpenSearch install type: rpm/deb on DISTRIB_ID=Ubuntu
OpenSearch config dir: /etc/opensearch
OpenSearch config file: /etc/opensearch/opensearch.yml
OpenSearch bin dir: /usr/share/opensearch/bin
OpenSearch plugins dir: /usr/share/opensearch/plugins
OpenSearch lib dir: /usr/share/opensearch/lib
Detected OpenSearch Version: x-content-2.4.1
Detected OpenSearch Security Version: 2.4.1.0

### Success
### Execute this script now on all your nodes and then start all nodes
### OpenSearch Security will be automatically initialized.
### If you like to change the runtime configuration
### change the files in ../../../config/opensearch-security and execute:
sudo "/usr/share/opensearch/plugins/opensearch-security/tools/securityadmin.sh" -cd "/etc/opensearch/opensearch-security" -icl -key "/etc/opensearch/kirk-key.pem" -cert "/etc/opensearch/kirk.pem" -cacert "/etc/opensearch/root-ca.pem" -nhnv
### or run ./securityadmin_demo.sh
### To use the Security Plugin ConfigurationGUI
### To access your secured cluster open https://<hostname>:<HTTP port> and log in with admin/admin.
### (Ignore the SSL certificate warning because we installed self-signed demo certificates)

$ sudo systemctl start opensearch.service
$ sudo systemctl status opensearch.service
● opensearch.service - OpenSearch
     Loaded: loaded (/lib/systemd/system/opensearch.service; disabled; vendor preset: enabled)
     Active: active (running) since Sun 2023-01-08 06:04:54 UTC; 20s ago
       Docs: https://opensearch.org/
   Main PID: 19546 (java)
      Tasks: 71 (limit: 18830)
     Memory: 1.2G
     CGroup: /system.slice/opensearch.service
             └─19546 /usr/share/opensearch/jdk/bin/java -Xshare:auto -Dopensearch.networkaddress.cache.ttl=60 -Dopensearch.networkaddress.cache.negative.ttl=10 -XX:+AlwaysPreTouch -Xss1m -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djna.nosys=true -XX:-OmitStackTraceInFastThrow -XX:+ShowCodeDetailsInExceptionMe>

Jan 08 06:04:40 ip systemd[1]: Starting OpenSearch...
Jan 08 06:04:42 ip systemd-entrypoint[19546]: WARNING: A terminally deprecated method in java.lang.System has been called
Jan 08 06:04:42 ip systemd-entrypoint[19546]: WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.OpenSearch (file:/usr/share/opensearch/lib/opensearch-2.4.1.jar)
Jan 08 06:04:42 ip systemd-entrypoint[19546]: WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.OpenSearch
Jan 08 06:04:42 ip systemd-entrypoint[19546]: WARNING: System::setSecurityManager will be removed in a future release
Jan 08 06:04:43 ip systemd-entrypoint[19546]: WARNING: A terminally deprecated method in java.lang.System has been called
Jan 08 06:04:43 ip systemd-entrypoint[19546]: WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.Security (file:/usr/share/opensearch/lib/opensearch-2.4.1.jar)
Jan 08 06:04:43 ip systemd-entrypoint[19546]: WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.Security
Jan 08 06:04:43 ip systemd-entrypoint[19546]: WARNING: System::setSecurityManager will be removed in a future release
Jan 08 06:04:54 ip systemd[1]: Started OpenSearch.

$ curl https://localhost:9200 -u admin:admin --insecure
{
  "name" : "ip",
  "cluster_name" : "opensearch",
  "cluster_uuid" : "M2nPp2cyS9edB6bpRlQYxg",
  "version" : {
    "distribution" : "opensearch",
    "number" : "2.4.1",
    "build_type" : "deb",
    "build_hash" : "f2f809ea280ffba217451da894a5899f1cec02ab",
    "build_date" : "2023-01-06T21:08:43.134090306Z",
    "build_snapshot" : false,
    "lucene_version" : "9.4.2",
    "minimum_wire_compatibility_version" : "7.10.0",
    "minimum_index_compatibility_version" : "7.0.0"
  },
  "tagline" : "The OpenSearch Project: https://opensearch.org/"
}
$ curl https://localhost:9200/_cat/plugins -u admin:admin --insecure
ip-172-31-11-175 opensearch-alerting                  2.4.1.0
ip-172-31-11-175 opensearch-anomaly-detection         2.4.1.0
ip-172-31-11-175 opensearch-asynchronous-search       2.4.1.0
ip-172-31-11-175 opensearch-cross-cluster-replication 2.4.1.0
ip-172-31-11-175 opensearch-geospatial                2.4.1.0
ip-172-31-11-175 opensearch-index-management          2.4.1.0
ip-172-31-11-175 opensearch-job-scheduler             2.4.1.0
ip-172-31-11-175 opensearch-knn                       2.4.1.0
ip-172-31-11-175 opensearch-ml                        2.4.1.0
ip-172-31-11-175 opensearch-neural-search             2.4.1.0
ip-172-31-11-175 opensearch-notifications             2.4.1.0
ip-172-31-11-175 opensearch-notifications-core        2.4.1.0
ip-172-31-11-175 opensearch-observability             2.4.1.0
ip-172-31-11-175 opensearch-performance-analyzer      2.4.1.0
ip-172-31-11-175 opensearch-reports-scheduler         2.4.1.0
ip-172-31-11-175 opensearch-security                  2.4.1.0
ip-172-31-11-175 opensearch-security-analytics        2.4.1.0
ip-172-31-11-175 opensearch-sql                       2.4.1.0
$ curl https://localhost:9200/_cluster/health?pretty -u admin:admin --insecure
{
  "cluster_name" : "opensearch",
  "status" : "green",
  "timed_out" : false,
  "number_of_nodes" : 1,
  "number_of_data_nodes" : 1,
  "discovered_master" : true,
  "discovered_cluster_manager" : true,
  "active_primary_shards" : 1,
  "active_shards" : 1,
  "relocating_shards" : 0,
  "initializing_shards" : 0,
  "unassigned_shards" : 0,
  "delayed_unassigned_shards" : 0,
  "number_of_pending_tasks" : 0,
  "number_of_in_flight_fetch" : 0,
  "task_max_waiting_in_queue_millis" : 0,
  "active_shards_percent_as_number" : 100.0
}

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

PA test, also test post script to stop OS and PA services before uninstall:

$ sudo systemctl status opensearch-performance-analyzer.service
● opensearch-performance-analyzer.service - OpenSearch Performance Analyzer
     Loaded: loaded (/lib/systemd/system/opensearch-performance-analyzer.service; disabled; vendor preset: enabled)
     Active: active (running) since Sun 2023-01-08 06:11:12 UTC; 6s ago
   Main PID: 20300 (java)
      Tasks: 24 (limit: 18830)
     Memory: 108.0M
     CGroup: /system.slice/opensearch-performance-analyzer.service
             └─20300 /usr/share/opensearch/jdk/bin/java -Xshare:auto -Xms4m -Xmx64m -XX:+UseSerialGC -Dlog4j.configurationFile=/etc/opensearch/opensearch-performance-analyzer/log4j2.xml -Xms64M -Xmx64M -XX:+UseSerialGC -XX:CICompilerCount=1 -XX:-TieredCompilation -XX:InitialCodeCacheSize=4096 -XX:MaxRAM=400m -Dope>

Jan 08 06:11:17 ip performance-analyzer-agent-cli[20300]: Jan 08, 2023 6:11:17 AM org.jooq.tools.JooqLogger info
Jan 08 06:11:17 ip performance-analyzer-agent-cli[20300]: INFO: Single batch             : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Jan 08 06:11:17 ip performance-analyzer-agent-cli[20300]: Jan 08, 2023 6:11:17 AM org.jooq.tools.JooqLogger info
Jan 08 06:11:17 ip performance-analyzer-agent-cli[20300]: INFO: Single batch             : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Jan 08 06:11:17 ip performance-analyzer-agent-cli[20300]: Jan 08, 2023 6:11:17 AM org.jooq.tools.JooqLogger info
Jan 08 06:11:17 ip performance-analyzer-agent-cli[20300]: INFO: Single batch             : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Jan 08 06:11:17 ip performance-analyzer-agent-cli[20300]: Jan 08, 2023 6:11:17 AM org.jooq.tools.JooqLogger info
Jan 08 06:11:17 ip performance-analyzer-agent-cli[20300]: INFO: Single batch             : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Jan 08 06:11:17 ip performance-analyzer-agent-cli[20300]: Jan 08, 2023 6:11:17 AM org.jooq.tools.JooqLogger info
Jan 08 06:11:17 ip performance-analyzer-agent-cli[20300]: INFO: Single batch             : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
$ sudo dpkg -r opensearch
(Reading database ... 147663 files and directories currently installed.)
Removing opensearch (2.4.1) ...
Running prerm script
Stop existing opensearch.service
Stop existing opensearch-performance-analyzer.service
Processing triggers for libc-bin (2.31-0ubuntu9.9) ...

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

OSD online:

$ sudo dpkg -I opensearch-dashboards-2.4.1-linux-x64.deb
 new Debian package, version 2.0.
 size 333229730 bytes: control archive=2200231 bytes.
     162 bytes,     4 lines      conffiles
     423 bytes,    12 lines      control
 12169994 bytes, 87732 lines      md5sums
    1484 bytes,    46 lines   *  postinst             #!/bin/bash
     943 bytes,    27 lines   *  preinst              #!/bin/bash
     605 bytes,    22 lines   *  prerm                #!/bin/bash
      45 bytes,     1 lines      shlibs
      73 bytes,     2 lines      triggers
 Package: opensearch-dashboards
 Version: 2.4.1
 Architecture: amd64
 Maintainer: OpenSearch Team <[email protected]>
 Installed-Size: 1179197
 Section: web
 Priority: optional
 Homepage: https://opensearch.org/
 Description: Open source visualization dashboards for OpenSearch
     OpenSearch Dashboards is the visualization tool for data in OpenSearch
     For more information, see: https://opensearch.org/
 License: Apache-2.0

$ sudo dpkg -i opensearch-dashboards-2.4.1-linux-x64.deb
Selecting previously unselected package opensearch-dashboards.
(Reading database ... 147998 files and directories currently installed.)
Preparing to unpack opensearch-dashboards-2.4.1-linux-x64.deb ...
Running OpenSearch-Dashboards Pre-Installation Script
Unpacking opensearch-dashboards (2.4.1) ...
Setting up opensearch-dashboards (2.4.1) ...
Running OpenSearch-Dashboards Post-Installation Script
### NOT starting on installation, please execute the following statements to configure opensearch-dashboards service to start automatically using systemd
 sudo systemctl daemon-reload
 sudo systemctl enable opensearch-dashboards.service
### You can start opensearch-dashboards service by executing
 sudo systemctl start opensearch-dashboards.service
Processing triggers for libc-bin (2.31-0ubuntu9.9) ...
Processing triggers for systemd (245.4-4ubuntu3.19) ...


$ sudo systemctl restart opensearch-dashboards

$ curl localhost:5601/api/status -u admin:admin
{"name":"ip","uuid":"ab449934-7f03-4093-a23f-9a26f97419d2","version":{"number":"2.4.1","build_hash":"ea36827cdedf1e726e7cb8315ffc49f73f9b4eb7","build_number":1,"build_snapshot":false},"status":{"overall":{"since":"2023-01-08T23:01:14.854Z","state":"green","title":"Green","nickname":"Looking good","icon":"success","uiColor":"secondary"},"statuses":[{"id":"core:[email protected]","message":"OpenSearch is available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"core:[email protected]","message":"SavedObjects service has completed migrations and is available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:[email protected]","message":"All dependencies are available","since":"2023-01-08T23:01:14.854Z","state":"green","icon":"success","uiColor":"secondary"}]},"metrics":{"last_updated":"2023-01-08T23:01:11.200Z","collection_interval_in_millis":5000,"os":{"platform":"linux","platformRelease":"linux-5.15.0-1026-aws","load":{"1m":0.34,"5m":0.16,"15m":0.06},"memory":{"total_in_bytes":16468430848,"free_in_bytes":8015761408,"used_in_bytes":8452669440},"uptime_in_millis":178125610,"distro":"Ubuntu","distroRelease":"Ubuntu-20.04","cpuacct":{"control_group":"/system.slice/opensearch-dashboards.service","usage_nanos":6621138114},"cpu":{"control_group":"/system.slice/opensearch-dashboards.service","cfs_period_micros":100000,"cfs_quota_micros":-1,"stat":{"number_of_elapsed_periods":0,"number_of_times_throttled":0,"time_throttled_nanos":0}}},"process":{"memory":{"heap":{"total_in_bytes":107233280,"used_in_bytes":99110840,"size_limit":2197815296},"resident_set_size_in_bytes":162652160},"pid":25723,"event_loop_delay":0.6528150141239166,"uptime_in_millis":28527.517938999998},"response_times":{"avg_in_millis":0,"max_in_millis":0},"concurrent_connections":0,"requests":{"disconnects":0,"total":0,"statusCodes":{},"status_codes":{}}}}

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

We would need to add debian apt automation:
* #3126

from opensearch-build.

BlackMetalz avatar BlackMetalz commented on June 18, 2024

I'm trying to write automation for setup Opensearch cluster.
Opensearch version: 2.6.0
OS: Ubuntu 20.04
The first-time install is successful, after that, I tried to uninstall it. It still works but the second time attempted to install it. The error raised

apt install opensearch=2.6.0
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following NEW packages will be installed:
  opensearch
0 upgraded, 1 newly installed, 0 to remove and 391 not upgraded.
Need to get 0 B/744 MB of archives.
After this operation, 971 MB of additional disk space will be used.
Selecting previously unselected package opensearch.
(Reading database ... 153685 files and directories currently installed.)
Preparing to unpack .../opensearch_2.6.0_amd64.deb ...
Running OpenSearch Pre-Installation Script##############........................................................................................................................................................] 
Unpacking opensearch (2.6.0) ...
Setting up opensearch (2.6.0) ...#############################################################..................................................................................................................] 
Running OpenSearch Post-Installation Script#########################################################################################............................................................................] 
dpkg: error processing package opensearch (--configure):
 installed opensearch package post-installation script subprocess returned error exit status 255
Processing triggers for systemd (245.4-4ubuntu3.3) ...
Processing triggers for libc-bin (2.31-0ubuntu9) ...
Errors were encountered while processing:
 opensearch
E: Sub-process /usr/bin/dpkg returned an error code (1)

from opensearch-build.

BlackMetalz avatar BlackMetalz commented on June 18, 2024

Hi, after your comment, I took a look deeper. Problem resolve with:

  1. Purge the package, not remove
  2. Delete all folders to make we left nothing behind:
product_dir=/usr/share/opensearch
config_dir=/etc/opensearch
data_dir=/var/lib/opensearch
log_dir=/var/log/opensearch
pid_dir=/var/run/opensearch

After that, I can run state ( Saltstack ) for install / uninstall multiple times for testing

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Hi,

Me and @zelinh starting to check the 1.x branch support on DEB.

We will test the following scenarios on 1.3.8 version:

x64: OS, OSD
arm64: OS OSD

Thanks,
Peter

from opensearch-build.

zelinh avatar zelinh commented on June 18, 2024

Current building/assembling status for 1.3.8:
for x64: OS & OSD are building & assembling successfully.
for arm64: OS & OSD are building & assembling successfully.

from opensearch-build.

zelinh avatar zelinh commented on June 18, 2024

@peterzhuamazon and I will verify the installations/executions of above debian packages tomorrow.

from opensearch-build.

peterzhuamazon avatar peterzhuamazon commented on June 18, 2024

Thanks @zelinh.

We will verify the installation, api calling, even native plugins installation tomorrow to make sure the 1.3.8 packages runs, before trying the process on upcoming 1.3.9 version.

Thanks.

from opensearch-build.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.