📝📊 CNCF Survey Data
Home Page: https://cncf.io
License: Apache License 2.0
One of CNCF's values are being open and transparent. We take a data driven approach to serving our communities. We have open sourced routine survey data from our various constituencies to ensure we are always meeting their needs and improving over time.
Leaving questions the same as H2 for consistency, adding in new sandbox projects from 3/30
https://github.com/cncf/surveys/blob/main/maintainer/README.md#average-data
@jeefy work with @amye to do this and see if you have inspo on how to make this better
Hi Team,
I was wondering if there is a 2023 CNCF Survey.
If so, what stage is it in and is the data available for folks to consume ?
Like it says on the tin
We should put these up here, and build out slides.
I am able to see data for 2018 and 2019 in the /cloudnative subdirectory, but I don't see data for 2020.
(ps: thanks for these surveys, they are very helpful)
Please upload and add a link titled "Survey Reference Model" to https://github.com/cncf/surveys/tree/main/cloudnative
e.g, overall satisfaction + NPS score + response time with satisfaction
https://github.com/cncf/surveys/tree/main/ambassador/
It would be great if we had a similar summary chart for ambassadors like we do with maintainers.
add question:
It would appear that some options were only added to last year's CNCF survey after about one-third of the results had been submitted. By my guess at the problem, recalculating percentages of adoption, those projects are under-reported by as much as 20%, and ranked incorrectly in the published graphs by up to 8 places.
Questions 30 and 31 of the recently published CNCF survey speak to the usage of various graduated and incubating projects.
Important notes for analysis of Q30 (CNCF graduated projects) and Q31 (CNCF incubating projects). The data
for these two matrix questions has been restated in this dataset so that it is easier for you to analyze. For each
of the projects listed, the data for each respondent is rendered in one of three ways:
• Null (empty cell) = The respondent is not using or evaluating the project
• 1 = The respondent is using the project in production
• 2 = The respondent is evaluating the project
There are long strings of empty results from survey version 1, sequence number 196 to 545. These relate to the following projects:
Given that
I conclude that the survey launched without these projects included as options for Q30 and Q31, and they were added when someone noticed (around 2023-09-30).
With '988 records used for analysis', that means these projects are missing over 1/3 of their possible results. This skews the data in favour of projects that do not have this error. These results are not just missing in the published spreadsheet: the marketing report is based on the incorrect data.
For example, simply removing results 196 to 545 for all projects and re-running the numbers, the cert-manager project moves from 25.61% production usage to 39.66%, or, if summing production and evaluation, from 39.17% to 60.66%.
Other discrepancies I noticed:
I received an email about a maintainers survey. The email contains a link to a non-CNCF site. The linked survey asks for my personally identifying information. There is no way for me to confirm if this email is phishing or not. Systems like this teach people (open source maintainers no less!) to click on random links and fill in their personal details.
Details:
Potential fix:
Let's open source the .csv for the 2018 results
It's impossible to say anything meaningful about these survey questions without understanding who the intended respondents are. Is this for
Dear CNCF-Team,
the current survey at https://www.surveymonkey.com/r/LZJ9DD7 has a bug. There are 2-3 questions where you have to rate per row from 1 to 5, but you can only choose each number once through-out all rows. Looks like the wrong question type (ranking) was chosen.
Please fix as soon as possible to avoid getting too many wrong results.
(I also sent this out to [email protected], hoping to get this fixed ASAP.)
See the legends on these two graphics. The issue is that SurveyMonkey never required a full set of labels for these 1-10 ratings questions.
https://github.com/cncf/surveys/blob/master/maintainer/2019/Experience-h2.png
https://github.com/cncf/surveys/blob/master/maintainer/2019/Recommend-h2.png
I don't know what data.world is, or why I have to sign up to it in order to download the 2023 CNCF survey results.
Could they be uploaded here for consistency?
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.
