brpc / media-server Goto Github PK

A brpc-based server to host and proxy live streams

License: Apache License 2.0

CMake 0.96% Shell 0.79% C++ 98.25%

streaming-service rtmp http-flv hls cdn live-streaming media-server

media-server's Introduction

bRPC is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Machine learning, Advertisement, Recommendation etc.

"bRPC" means "better RPC".

You can use it to:

Build a server that can talk in multiple protocols (on same port), or access all sorts of services
- restful http/https, h2/gRPC. using http/h2 in bRPC is much more friendly than libcurl. Access protobuf-based protocols with HTTP/h2+json, probably from another language.
- redis and memcached, thread-safe, more friendly and performant than the official clients.
- rtmp/flv/hls, for building streaming services.
- hadoop_rpc (may be opensourced)
- rdma support
- thrift support, thread-safe, more friendly and performant than the official clients.
- all sorts of protocols used in Baidu: baidu_std, streaming_rpc, hulu_pbrpc, sofa_pbrpc, nova_pbrpc, public_pbrpc, ubrpc and nshead-based ones.
- Build HA distributed services using an industrial-grade implementation of RAFT consensus algorithm which is opensourced at braft
Servers can handle requests synchronously or asynchronously.
Clients can access servers synchronously, asynchronously, semi-synchronously, or use combo channels to simplify sharded or parallel accesses declaratively.
Debug services via http, and run cpu, heap and contention profilers.
Get better latency and throughput.
Extend bRPC with the protocols used in your organization quickly, or customize components, including naming services (dns, zk, etcd), load balancers (rr, random, consistent hashing)

Try it!

Read overview to know where bRPC can be used and its advantages.
Read getting started for building steps and play with examples.
Docs:
- Performance benchmark
- bvar
  - bvar_c++
- bthread
- Client
- Server
- Builtin Services
  - status
  - vars
  - connections
  - flags
  - rpcz
  - cpu_profiler
  - heap_profiler
  - contention_profiler
- Tools
- Others
  - IOBuf
  - Streaming Log
  - FlatMap
  - bRPC introduction(training material)
  - A tutorial on building large-scale services(training material)
  - bRPC internal(training material)
- RPC in depth
- Use cases
  - User cases

Contribute code

Please refer to here.

Feedback and Getting involved

Report bugs, ask questions or give suggestions by Github Issues
Subscribe to the mailing list([email protected]) to get updated with the project

Code of Conduct

We follow the code of conduct from Apache Software Foundation, please refer it here Link

media-server's People

Contributors

Stargazers

Watchers

media-server's Issues

cdn_merge_to的具体用法可以介绍下吗

如果有L0(边缘), L1(汇聚), L2(中心)
3种节点, 只需要L0 proxy_to L1 proxy_to L2, 便可以建一个分发网络
假设一个机房有20个L0, 这些L0的上层是同一个L1, 如果20个L0都向L1回源, 会有20份流量
我理解的cdn_merge_to, 应该角色上类似"机房代理", 也就是这个机房内的20个L0都向cdn_merge_to的节点回源, cdn_merge_to再向上层L1回源, 达到节省传输带宽的目的?
是这么理解吗?

使用media-server向srs拉流失败

握手阶段就失败了，

正常来说握手报文，c0c1,应该是1537个字节，但media-server发送的报文只有二百多个字节,

windows 10 wsl2 linux找不到brpc

确定 pthread_create 是否存在失败，输出如下：
更改目录：/home/sudosocourus/work/media-server/build/CMakeFiles/CMakeTmp

运行构建命令："/usr/bin/make" "cmTC_d96c9/fast"
/usr/bin/make -f CMakeFiles/cmTC_d96c9.dir/build.make CMakeFiles/cmTC_d96c9.dir/build
make[1]: 进入目录'/home/sudosocourus/work/media-server/build/CMakeFiles/CMakeTmp'
构建 C 对象 CMakeFiles/cmTC_d96c9.dir/CheckSymbolExists.c.o
/usr/bin/cc -o CMakeFiles/cmTC_d96c9.dir/CheckSymbolExists.c.o -c /home/sudosocourus/work/media-server/build/CMakeFiles/CMakeTmp/CheckSymbolExists.c
链接 C 可执行文件 cmTC_d96c9
/usr/bin/cmake -E cmake_link_script CMakeFiles/cmTC_d96c9.dir/link.txt --verbose=1
/usr/bin/cc -rdynamic CMakeFiles/cmTC_d96c9.dir/CheckSymbolExists.c.o -o cmTC_d96c9
CMakeFiles/cmTC_d96c9.dir/CheckSymbolExists.c.o：在函数“main”中：
CheckSymbolExists.c:(.text+0x1b): 未定义对“pthread_create”的引用
collect2：错误：ld 返回 1 个退出状态
CMakeFiles/cmTC_d96c9.dir/build.make:97：目标“cmTC_d96c9”的配方失败
make[1]: *** [cmTC_d96c9] 错误 1
make[1]: 离开目录 '/home/sudosocourus/work/media-server/build/CMakeFiles/CMakeTmp'
Makefile:126: 目标“cmTC_d96c9/fast”的配方失败
制作：*** [cmTC_d96c9/fast] 错误 2

文件/home/sudosocourus/work/media-server/build/CMakeFiles/CMakeTmp/CheckSymbolExists.c：
/* */
#include <pthread.h>

int main(int argc, char** argv)
{
  （无效）argv；
#ifndef pthread_create
  返回 ((int*)(&pthread_create))[argc];
＃别的
  (无效)argc;
  返回0；
＃万一
}

确定 pthreads 中是否存在函数 pthread_create 失败，输出如下：
更改目录：/home/sudosocourus/work/media-server/build/CMakeFiles/CMakeTmp

运行构建命令："/usr/bin/make" "cmTC_464c2/fast"
/usr/bin/make -f CMakeFiles/cmTC_464c2.dir/build.make CMakeFiles/cmTC_464c2.dir/build
make[1]: 进入目录'/home/sudosocourus/work/media-server/build/CMakeFiles/CMakeTmp'
构建 C 对象 CMakeFiles/cmTC_464c2.dir/CheckFunctionExists.c.o
/usr/bin/cc -DCHECK_FUNCTION_EXISTS=pthread_create -o CMakeFiles/cmTC_464c2.dir/CheckFunctionExists.c.o -c /usr/share/cmake-3.10/Modules/CheckFunctionExists.c
链接 C 可执行文件 cmTC_464c2
/usr/bin/cmake -E cmake_link_script CMakeFiles/cmTC_464c2.dir/link.txt --verbose=1
/usr/bin/cc -DCHECK_FUNCTION_EXISTS=pthread_create -rdynamic CMakeFiles/cmTC_464c2.dir/CheckFunctionExists.c.o -o cmTC_464c2 -lpthreads
/usr/bin/ld: 找不到 -lpthreads
collect2：错误：ld 返回 1 个退出状态
CMakeFiles/cmTC_464c2.dir/build.make:97：目标“cmTC_464c2”的配方失败
make[1]: *** [cmTC_464c2] 错误 1
make[1]: 离开目录 '/home/sudosocourus/work/media-server/build/CMakeFiles/CMakeTmp'
Makefile:126: 目标“cmTC_464c2/fast”的配方失败
制作：*** [cmTC_464c2/fast] 错误 2

我尝试回答下：

问题 1：有没有 bug？
iter_impl 出现 error 的时候，会调用 set_error ，阻止后续状态机的执行：

    if (iter_impl.has_error()) {
        set_error(iter_impl.error());
        iter_impl.run_the_rest_closure_with_error();
    }

do_commit 的时候会判断 fsm_caller 当前是否处于 error 状态：

void FSMCaller::do_committed(int64_t committed_index) {
    if (!_error.status().ok()) {
        return;
    }

FSMCaller 的 set_error 还会通知到 state machine 的 on_error 方法，表示一个不可恢复的错误发生，需要人工介入处理。整个状态机将停止，因此不会有后续的数据安全问题。并且需要强调 _last_applied_index 是内存状态， do_commit 最终存储的还是上一次的 index:

    int64_t last_applied_index = _last_applied_index.load(
                                        butil::memory_order_relaxed);
     .....
    _log_manager->set_applied_id(last_applied_id);

因此并不存在数据安全问题。

什么情况下会导致 iter_impl 出现 error ？

用户在 apply task 到状态机的时候可能遇到不可控的异常（比如网络或者文件磁盘沾满等 IO 问题），这种时候用户可以主动终止状态机继续执行，调用 set_error_and_rollback 方法回滚，人工介入处理，待错误恢复后继续执行状态机。

Originally posted by @killme2008 in baidu/braft#173 (comment)

brpc with glog，编译 media-server失败

编译失败

按照README的方法编译

media-server/src/http_streaming_service.cpp: In member function ‘virtual void ProxyHttp::Run()’:
media-server/src/http_streaming_service.cpp:584:54: error: cannot convert ‘butil::intrusive_ptr<brpc::ProgressiveAttachment>’ to ‘brpc::ProgressiveAttachment*’ in initialization
  584 |             _server_cntl->CreateProgressiveAttachment(brpc::FORCE_STOP);
      |             ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~
      |                                                      |
      |                                                      butil::intrusive_ptr<brpc::ProgressiveAttachment>
media-server/src/http_streaming_service.cpp:866:46: error: cannot convert ‘butil::intrusive_ptr<brpc::ProgressiveAttachment>’ to ‘brpc::ProgressiveAttachment*’ in initialization
  866 |             cntl->CreateProgressiveAttachment(brpc::FORCE_STOP);
      |             ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~
      |                                              |
      |                                              butil::intrusive_ptr<brpc::ProgressiveAttachment>
make[2]: *** [src/CMakeFiles/media_server.dir/build.make:155: src/CMakeFiles/media_server.dir/http_streaming_service.cpp.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:140: src/CMakeFiles/media_server.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....