knplabs / knpbundles

THE unofficial listing of Symfony2 bundles.

KnpBundles

Open-source code of the knpbundles.com website, written in Symfony2.

Any ideas are welcome!

Please note that this service was previously called Symfony2Bundles but we had to change the name due to trademark issues.

Install

Get the code

git clone git://github.com/KnpLabs/KnpBundles.git

Configure

To configure your database in your development environment, copy /app/config/parameters.yml.dist to /app/config/parameters.yml and edit it according to your database settings.

If you want to use github connect locally, you'll need to create an app on github with the callback:

http://yourlocalurl/login/check-github

And update the parameters.yml with the Client ID and Secret.

If you also want to use sensio labs connect locally, you'll need to create a client on sensio labs connect with the callback:

http://yourlocalurl/login/check-sensio

And update the parameters.yml with the Client ID and Secret.

Install with docker

docker build
docker up -d

Create database and tables

docker-compose exec php php app/console doctrine:schema:create
docker-compose exec php php app/console --env=test doctrine:schema:create

Load data fixtures

docker-compose exec php php app/console doctrine:fixtures:load
docker-compose exec php php app/console --env=test doctrine:fixtures:load

Load assets and assetic

docker-compose exec php php app/console assets:install --symlink web/
docker-compose exec php php app/console assetic:dump --env=dev
docker-compose exec php php app/console assetic:dump --env=prod

Run the tests (requires PHPUnit >= 3.5)

docker-compose exec php phpunit -c app

Run the Behat tests (requires PHPUnit >= 3.5)

docker-compose exec php ./bin/behat @KnpBundlesBundle

To generate migrations from your current schema

docker-compose exec php php app/console doctrine:migrations:diff
docker-compose exec php php app/console doctrine:migrations:migrate
docker-compose exec php php app/console cache:warmup

Usage

Launch the consumer

We rely on RabbitMQ to update bundles:

• The main server produces messages saying "Hey, we should update this bundle"
• The consumers read these messages and update them

To launch a consumer, do:

docker-compose exec php php app/console rabbitmq:consumer update_bundle

Note that you will need a functional rabbitmq server − Follow the instructions in this page to install it.

Populate document collections from GitHub

docker-compose exec php php app/console kb:populate

This can take a long time. GitHub API is limited to 60 calls per minute, so the commands needs to wait.

Update all bundles in database

docker-compose exec php php app/console kb:update:bundles

This can take a long time but should be run to trigger update on all bundles when this is needed.

Search engine

We use Solr and its PHP client Solarium to search bundles.

To install Solr, follow this steps:

1. Download the version 3.6.2 (new versions are not compatibles) and extract it
2. Uses the command kb:solr:start --solr-path="/path/to/solar-3.6.2/example"
3. And run kb:solr:index --verbose

Use the default Jetty server included with SOLR. The default directory used for the installation is opt/solr/example. Copy the recommended configuration and schema found here to your solr/conf directory.

You can run SOLR using:

docker-compose exec php php app/console kb:solr:start

See bin/prepare-test-solr.sh script Bundles will be automatically indexed on next update, or you can force indexing by console command.

If you have Solr up and running, simply do:

docker-compose exec php php app/console kb:solr:index --verbose

This will index all bundles.

Generate sitemap

docker-compose exec php php app/console kb:sitemap:generate --spaceless=1

Will create sitemap.xml and sitemap.xml.gz in web directory. Sitemap includes bundles and user profiles

knpbundles's Issues

Adding the date of the latest update in the bundle list

This would make it easier to see if a bundle is still active by avoiding to go to the page of the bundle to see the list of commits (or to github as this list is currently broken)

Exception when using DateTime

Hi,

When I load the fixtures or run the tests, I get the following Exception : "DateTime::__construct(): It is not safe to rely on the system's timezone settings. You are required to use the date.timezone setting or the date_default_timezone_set() function. In case you used any of those methods and you are still getting this warning, you most likely misspelled the timezone identifier. We selected 'Europe/Berlin' for 'CET/1.0/no DST' instead"

I have checked my php.ini and everything seems to be fine. All the more, when I use the TimeHelper in a sample code, I don't have such problem. I should have missed something in the configuration or could it be a bug (don't think so) ?

Thanks for reading me (and sorry for my poor english :>).

PS : I am using the MAMP app : apache2 and php 5.3.3

github score calculation

This probably not an issue. On API v2, I searched something to do with ruby (this website http://develop.github.com/p/repo.html) and it has a score on the list. What is the score based on? Is there any formula or calculation on this "score"?

pull fail detection

handle the case when a pull fails (can happen if someone has push --force)

Problème avec git submodule

Bonjour,

Je viens de cloner le projet en local et en lancant la commande git submodule update --init --recursive tout ce passe bien jusqu'à :

Initialized empty Git repository in /Users/clement/Sites/symfony2bundles/src/vendor/Goutte/.git/
remote: Counting objects: 44, done.
remote: Compressing objects: 100% (41/41), done.
remote: Total 44 (delta 17), reused 0 (delta 0)
Receiving objects: 100% (44/44), 95.78 KiB, done.
Resolving deltas: 100% (17/17), done.
fatal: reference is not a tree: 4cf52c5d32028912042272679268be08314a3101
Unable to checkout '4cf52c5d32028912042272679268be08314a3101' in submodule path 'src/vendor/Goutte'

Une idée ?
Merci !!

Clem

clone bundles locally

Having the bundles code will be useful.

repo detection is deprecated

it's based on the existence of src/autoload.php while latest defaults are to put this file in the application dir.

GitHub search API sucks

Either it fails, return 500 status code, or returns empty or uncomplete results.

Consider using google as a replacement?

symfony2bundles does not find all repos

The s2b:populate command limits the results to 500. As the search will likely return the results in the same order, the same 500 results are found each times which means that others are not found.
Note that currently the limit is already reached when running the command.

Commit list is broken

All commits are displayed as being done by the repo owner and the time is replaced by diff.ago.day

Invalid repositories

Theses repositories aren't Symfony2 Bundles

http://symfony2bundles.org/EvolutionSDK/SQL-Bundle
http://symfony2bundles.org/EvolutionSDK/Spyc-Bundle

Use the number of contributors in the score only for bundles

We do not use the number of contributors in the score anymore:

Indeed more and more projects use symfony-standard as a base so they start with 149 contributors...

We should investigate to see if this is only a problem for projects and not bundles.

In this case we should add again the

    // 1 contributor = 3 points
    $score += 3 * $this->getNbContributors();

Also list open source websites

Like:
http://github.com/noelg/symfony-demo
http://github.com/knplabs/miam
http://github.com/knplabs/symfony2bundles
http://github.com/geoffrey/springbok
http://github.com/ornicar/lichess

They will be more difficult to find through GitHub api

Provide an API

Can't add project

When I try to add my Symfony2-based project http://github.com/phpYABS/phpYABS I'm redirected to a 404 not found page http://www.symfony2bundles.org/repo/add

Pagination

Use DoctrineExtensions\Paginate

http://github.com/beberlei/DoctrineExtensions

Improving the use of Gravatar

Currently we use the email of the user to get the gravatar image. But this works only when the user publicize its email address on github, which is not the case for many of them.
The github api gives the gravatar id to be able to retrieve the image without knowing the email address so it should be used.

disable user sort by score by default

Because it is meaningless and frustrating. Also some could imagine this has been done to put knplabs at the top of the list, which makes the whole website less credible.

Display docs

According to best practices (http://symfony-reloaded.org/guides/Bundles/Best-Practices) we should display the content of the Resources/doc dir

detect code conventions

using a codesniffer. Requires #2

Improve Repo::recalculateScore discusssion

Per TODO in Repo::recalculatescore(https://github.com/knplabs/symfony2bundles/blob/master/src/Knplabs/Bundle/Symfony2BundlesBundle/Entity/Repo.php#L333) I thought it would be good to start this discussion.

The logic as it currently is:

score = (followers * 1)
score = score + (forks * 3)
score = score + (contributors * 3)

if last commit < 30 days old
score = score + ((30 - days since commit) / 5);

if readme > 300 chars
score = score + 5;

Problem cloning this project and updating submodule

git submodule update --init --recursive
fatal: reference is not a tree: f2f1a2217fdea93d4935571a923c4d4ff0ce2bd9
Unable to checkout 'f2f1a2217fdea93d4935571a923c4d4ff0ce2bd9' in submodule path 'vendor/goutte'

See the Pro Git Book url: http://progit.org/book/ch6-6.html section: Cloning a Project with Submodules
on why that happens.

Anthony.

Could not find any configured connections

So I renamed the config file from config_dev_local.yml.dist to config_dev_local.yml and changed the relevant settings.

I run the command:

php s2b/console-dev doctrine:database:drop

"[InvalidArgumentException]
Could not find any configured connections "

Any idea what the problem is? Perhaps it's trivial and i'm just being stupid...

Thanks :-)

automate tweeting

We have the twitter.com/symfony2bundles account.

The system could tweet when a new Bundle is created. By the way, a new Bundle is often empty, and not very interresting.
We could also tweet when a new version (Git tag) of a Bundle is released.

Wrong link

On the project page the link on top allowing to choose the sorting target the bundle page instead of the project page.

Sf2 projects cannot be discovered through Twitter

The github search removes all repo with a name that don't match /Bundle$/ which means projects discovered previously through the Twitter search are removed.

Note that moving the Twitter search after the github one is a bad fix as it would not take the tweeted repos into account when the github search reaches the limit (which will occur when the number of github repos increases).

Bundles with uppercase before "Bundle" in repository name are not found (for ex. CMSBundle)

Real example: go to github search, type "hatimeria" - you've got two php repositories, type "hatimeria bundle" and there's only one left.
So symfony2bundles can't find HatimeriaExtJSBundle and other possible repos with upper case before Bundle word. I've reported search issue to github today...

JSONP API

What a good idea

Comments for Bundles

Nested comments would be damn cool

calculate deps code.

for vendors script.

The service "doctrine.dbal.default_connection" does not exist.

Encore moi^^

En suivant les instructions du readme et en voulant importer des éléments en base avec la commande populate j'obtiens cela :

symfony2bundles% php s2b/console s2b:populate
Search "Bundle" on Github...30...40... DONE
Search "Symfony2" on Github...51... DONE
Search on Google.....50/250.....100/250.....150/250.....!200/250.!....250/250 DONE
Found 53 repo candidates

[InvalidArgumentException]
The service "doctrine.dbal.default_connection" does not exist.

Une idée ? :)
Merci beaucoup
Clem

add a blog

with Bundle creation good practices, Bundle reviews...

Some propose to use gh-pages. I prefer developing it.

A console script to search/install bundles

A console command that is similar to apt-get to search through bundles and download them with all the dependent bundles.

Feature Request: Screenshots for bundles

Sometimes a picture is worth a thousand words :)

Suppport more doc formats

Hi,
i am quite unsure wich format i actually choose, but i knew it from sphinx and saw it in other bundles, and it doesnt render correctly on s2b.

probably will trick some people if docs are shown wrong.

If you tell me which format you support maybe i rewrite the readme or make a readme s2b compat with a link to the doc ...

cheers phil

detect tests

using a codesniffer. Requires #2

My AdmingeneratorGeneratorBundle was removed !

I don't know why but my bundle is not anymore your lists :(

Issue with dots in repo names

The routing is broken if a repo name ends with .html, .json or .js

Add version compatibility to bundles / version tags

Hi,

first of all, symfony2 and the new overall architecture looks very promising, it's really well designed and fun to work with. However, it's a little tedious at the moment when using third party bundles, as a lot of them are being developed on the master branch of symfony2 (i guess) - and when people use the Symfony2 Beta1 Standard Distribution, things very often don't work.

As symfony2 itself reached beta state, i think it would be a good idea to add compatibility information to each bundle on symfony2bundles.com. Especially, i would recommend to tag the commit which is working with the current beta version of the standard distribution.

Commit links are wrong

Commit links should target github but they currently target symfony2bundles which means they all target a 404.

Integrate with packagist.

This should be marked as an "idea".

Anyways, providing integration with packagist would create an automatic way to install the bundles.

Sorted results pagination issue

When i choose some kind of sorting (ex., http://symfony2bundles.org/bundle/lastCommitAt) and use paginator it returns me on a X page without sorting ( http://symfony2bundles.org/bundle?page=X, not http://symfony2bundles.org/bundle/lastCommitAt?page=X).

Add composer package name

If a bundle repo has a composer.json file at the root, it'd be great to json_decode it and read the name from it. From that you can at least display the package name to users, and possibly also link to http://packagist.org/packages/<package name>.

create a branch for hotfixes

create a branch who is synced with production.

The "github markdown" is not interpreted same

If i wrote a code block start like that :

````php

it will not be interpreted into http://symfony2bundles.org/cedriclombardot/AdmingeneratorGeneratorBundle but ok on https://github.com/cedriclombardot/AdmingeneratorGeneratorBundle

API bundle list returns internal server error

The curl request from the API documentation to list bundles returns an error:

curl http://symfony2bundles.org/bundle/score.json
{"error":{"code":500,"message":"Internal Server Error"}}

Am i missing something?

show collaborators

app:populate not working

Followed the readme, everything worked until the last step:

C:\usr\sites\sfprojects\symfony2bundles>php app/console-dev app:populate

[InvalidArgumentException]
There are no commands defined in the "app" namespace.

Project addition request: Silex

Since it was not auto-discovered, it would be great if it could be added to the list.

https://github.com/fabpot/Silex

repo score calculation fail

this application http://symfony2bundles.org/Chekote/Symfony-2-Test has a score it does not deserve