Comments (11)
@mgoffin Can we close this out?
from threatexchange.
I don't believe all of the scripts have been moved over and removed from their current location.
I still see scripts in the malware
, members
, and threat_indicators
folder which don't use pytx and I'm not sure if there's feature parity with anything in the pytx/scripts
folder. There are also several scripts in the get_all_data
folder which do use pytx, but aren't in the pytx/scripts
folder.
from threatexchange.
When I wrote pytx originally I duplicated the scripts that existed and put them in pytx/scripts
. Then I rewrote them using pytx with a goal of replacing the originals. This would help do that but I think the ones in pytx/scripts
need some updating to have feature-parity before the others could go away.
from threatexchange.
I agree, I was also working on fixing the scripts so that they work out of the box, by removing the app-id/secret vars and defaulting to the new ENV vars
from threatexchange.
+1 @tpott, any opposition to us merging your scripts into pytx?
from threatexchange.
@tpott is offline for the next two weeks. But being the guy who is ultimately responsible for maintaining this, fewer copies of the same code is better. Let's make these scripts work out of the box using the environment variables.
from threatexchange.
Just saw this thread! I'm willing to refactor these a bit. My original thought for these were that (1) pytx didn't exist at the time, but also (2) serve as a vanilla python example (as in there were no required libs).
So I could either refactor these completely into pytx, at which point there won't be any standalone demo python, or just clean them up and create a scripts directory to move these to. Thoughts/preferences?
from threatexchange.
Fold them into pytx!
from threatexchange.
I apologize. I really need to find time to update pytx to use descriptors :(
from threatexchange.
pytx is all updated. moving the scripts into pytx (which might just mean updating the ones that are already there) will be a good test for the new code to iron out any bugs.
from threatexchange.
This issue has staled out, and we've just do a big cleanup of the existing files. malware, members, and a few others are now gone. Various python scripts still exist in api-reference-examples/python/ but hopefully they are not duplicated.
from threatexchange.
Related Issues (20)
- [hma] submitting content gets stuck between "hashed" and "matched" HOT 2
- /matches/for-hash/ gives AttributeError: 'IndexMatchUntyped' object has no attribute 'distance' HOT 1
- [pytx] No match results if creating a local_file with only 1 hash in it HOT 1
- [hma] Size of hashkey has exceeded the maximum size limit of 2048 bytes HOT 3
- [hma] ValueError in indexer
- [vpdq] Add support for Windows in vpdq pypy package HOT 5
- [OMM] Set up basic Continuous Integration git workflows for OMM HOT 2
- [omm] Figure out design for background tasks HOT 5
- [hma] Test production deployment - Nice-to-haves and Need-to-haves HOT 5
- [omm][onboarding] Initial setup issues HOT 2
- psycopg2.errors.UndefinedTable: relation "signal_type_override" does not exist HOT 8
- [vpdq] pypi publish failing HOT 2
- [omm][hma] Move Open Media Match into the Hasher Matcher Actioner Directory HOT 1
- Refactor UI to allow for multiple pages
- Flask background task scheduler doesn't run if werkzeug is not the WSGI server
- [hma][py-tx] Unclean CI status for HMA and pytx HOT 4
- [vpdq] Explore other packaging and build options
- [hma] Add optional distance parameter in match API
- [pytx] Add support for StopNCII PhotoDNA
- [hma] Bad redirects on dev page HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from threatexchange.