GithubHelp home page GithubHelp logo

novitae / sterraxcyl Goto Github PK

View Code? Open in Web Editor NEW
485.0 11.0 56.0 187 KB

Instagram OSINT tool to export and analyse followers | following with their details

License: GNU General Public License v3.0

Python 100.00%
osint instagram excel information-gathering socmint python csv sterra

sterraxcyl's Introduction

- S T E R R A -

A unique SOCMINT tool to get informations on an instagram account
from its following | followers

➑️ Sterra's main function is to export lists of followers | following | mutuals from Instagram to excel | csv | json with informations on accounts National Geographic following list under excel format

➑️ It can also analyse exported lists to search for personnal account (which means estimating which accounts are in the close circle of your target)

Personnal accounts analysis for Christiano Ronaldo following list. All the upper accounts are followed by Ronaldo himself. Data exportable.

➑️ Finaly, it can compare two lists in order to find commons or not commons users Common usernames between Kylie Jenner following list and Travis Scott following list. Data exportable.

πŸ“₯ Installation

pip install sterra
# or
git clone https://github.com/novitae/sterraxcyl/
cd sterraxcyl
python setup.py install

🌐 Wiki

Wiki The home page of the Wiki
Basic Usage Wiki The Wiki page to start using Sterra

πŸ“™ More

  • This tool have been made as an alternative of the Chrome extension export List of Followers from Instagram that has been killed for some ""reasons"". It was made to export data on the accounts as sterra's export module does. This is the main inspiration.
    I was using it to do manually the job of sterra's analyse module.
  • The export module uses the Instagram GraphQL API to get the lists of usernames. The architecture of it is based on the get_instagram_followers-following_list one.
  • My twitter messages are open -> meakaaet
  • Sterra and Sterraxcyl are the same program; Sterraxcyl is the old name, but it was weird afterall, so i changed it as i could to Sterra

sterraxcyl's People

Contributors

hpiedcoq avatar novitae avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

sterraxcyl's Issues

bunch of followers that i can't export

such a good tool!
I have problem with exporting the followers username. i tested with 2 or 3 diffrent account several times but each time it's stop under 10000 usernames and i can't resume the exporting. part for exporting is not work for me.
the error is:
PrivateAccError: --username is a private account that you're not following.
after this function didn't go forward and stop. i followed the account but it's not working.

Silent/Quiet mode

I can't find anywhere in the wiki about it, does it have this option?

RateLimitError & Part not being created

-d switch for delay does not work when using export command:
sterra export -ssid redactedssid -u usernameredacted -t followers -f csv -d 900

Assuming this delay also changes the fixed "sleeping 10 sec" attempt delay when exporting followers, it does not change this either.

When exporting, the "part" is never created in %appdata% module folder, even with admin permissions. A RateLimitError occurs, but a PART_ID is never assigned, if started again it doesn't continue where it left off on exporting followers, therefore starting the process over again.

|x| Target > userredacted (39240 followers, 802 following)
|Β§| Followers extraction:  24%|β–ˆβ–ˆβ–       | 9465/39240 [01:00<03:54, 126.90it/s]1/3 attempts, sleeping 10 sec
2/3 attempts, sleeping 10 sec
|Β§| Followers extraction:  24%|β–ˆβ–ˆβ–       | 9510/39240 [01:20<03:54, 126.90it/s]3/3 attempts, sleeping 10 sec
|Β§| Followers extraction:  24%|β–ˆβ–ˆβ–       | 9510/39240 [01:31<04:44, 104.49it/s]
|!| RateLimitError: Rate limit at Rate limit happenning during list of follows scraping. Wait a bit, or change of login account. blocks the program. Wait a bit, or change of login account.

Also small spelling error, happenning should be happening.

Delay information

What unit of time is delay in?
What delay would be sufficient to collect "Default informations"?

error

Dont work with new Instagram ssid

Best way to reach out ?

Hi,

I find this project very interesting, what's your preferred channel for a private chat @novitae ?
My org. is looking for specialists with your expertise.

Regards,

Export Does not work with Python 3.5 3.7 3.8 or 3.9 (did not test others)

Traceback (most recent call last):
File "/home/exspir3/.local/bin/sterra", line 8, in
sys.exit(main())
File "/home/exspir3/.local/lib/python3.8/site-packages/sterra/core.py", line 430, in main
ret = globals()module.upper()
File "/home/exspir3/.local/lib/python3.8/site-packages/sterra/core.py", line 87, in EXPORT
scrape(t,l)
File "/home/exspir3/.local/lib/python3.8/site-packages/sterra/core.py", line 38, in scrape
.p(f"""{username}'s {targlist} usernames file exported under id: {str(bold(exporter([{"username":usn} for usn in flist],,**kwargs)()))}""",logo=logo_to_choose)
TypeError: init() missing 2 required positional arguments: 'file_path' and 'Format'

FACEBOOK ID

The facebook ID does not coincide with the user. I don't find....

Read before making issues (it's short dw)

This version of Sterra won't be fixed if any bug occurs. In fact, I am working for many months on Sterra v3, which is about to revolutionize OSINT on instagram. This is why I am not coming back to resolves issues here.

Error

It gives me this error :

Traceback (most recent call last):
File "/data/data/com.termux/files/usr/bin/sterra", line 8, in
sys.exit(main())
^^^^^^
File "/data/data/com.termux/files/usr/lib/python3.11/site-packages/sterra/core.py", line 432, in main
ret = globals()module.upper()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/data/com.termux/files/usr/lib/python3.11/site-packages/sterra/core.py", line 77, in EXPORT
scraper = instagram(, original_target, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/data/com.termux/files/usr/lib/python3.11/site-packages/sterra/stegram.py", line 119, in init
self._checkvalidSessid({"sessionid":sessionid})
File "/data/data/com.termux/files/usr/lib/python3.11/site-packages/sterra/stegram.py", line 192, in _checkvalidSessid
r = _check_request_passed(
^^^^^^^^^^^^^^^^^^^^^^
File "/data/data/com.termux/files/usr/lib/python3.11/site-packages/sterra/stegram.py", line 24, in _check_request_passed
req = requests.get(**kwargs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/data/com.termux/files/usr/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/data/com.termux/files/usr/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/data/com.termux/files/usr/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/data/com.termux/files/usr/lib/python3.11/site-packages/requests/sessions.py", line 725, in send
history = [resp for resp in gen]
^^^^^^^^^^^^^^^^^^^^^^
File "/data/data/com.termux/files/usr/lib/python3.11/site-packages/requests/sessions.py", line 725, in
history = [resp for resp in gen]
^^^^^^^^^^^^^^^^^^^^^^
File "/data/data/com.termux/files/usr/lib/python3.11/site-packages/requests/sessions.py", line 191, in resolve_redirects
raise TooManyRedirects(
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.

Just calling $ sterra, i tryed to load export but doesn't work. Can you help me out?

Traceback (most recent call last):
File "/usr/local/bin/sterra", line 33, in
sys.exit(load_entry_point('sterra==2.2.7', 'console_scripts', 'sterra')())
File "/usr/local/bin/sterra", line 25, in importlib_load_entry_point
return next(matches).load()
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/importlib/metadata.py", line 77, in load
module = import_module(match.group('module'))
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/importlib/init.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1030, in _gcd_import
File "", line 1007, in _find_and_load
File "", line 972, in _find_and_load_unlocked
File "", line 228, in _call_with_frames_removed
File "", line 1030, in _gcd_import
File "", line 1007, in _find_and_load
File "", line 986, in _find_and_load_unlocked
File "", line 664, in _load_unlocked
File "", line 627, in _load_backward_compatible
File "", line 259, in load_module
File "/Library/Python/3.9/site-packages/sterra-2.2.7-py3.9.egg/sterra/init.py", line 1, in
File "", line 259, in load_module
File "/Library/Python/3.9/site-packages/sterra-2.2.7-py3.9.egg/sterra/sterools.py", line 2, in
File "", line 259, in load_module
File "/Library/Python/3.9/site-packages/sterra-2.2.7-py3.9.egg/sterra/sterrage.py", line 3, in
File "/Library/Python/3.9/site-packages/string_color-1.2.3-py3.9.egg/stringcolor/init.py", line 1, in
from stringcolor.ops import (
File "/Library/Python/3.9/site-packages/string_color-1.2.3-py3.9.egg/stringcolor/ops.py", line 4, in
import colorama
ModuleNotFoundError: No module named 'colorama'

Rate Limit Error although followers extraction is completed

Hey,

I'm having an issue with resuming a "part" content, I'm using the following command syntax:
sterra export -ssid xxx -u xxx -p xxx

When it hit 100% on the followers extraction, the "RateLimitError" showed, so I didn't use sterra for three days, (usually used it every 24h to finish the extraction phase) now when trying to resume the script with the syntax above - I'm still getting the "RateLimitError".

When using Instagram on mobile or web, I am able to use the search, like photos, follow etc...
To make sure, I ran sterra again but without the "-p" flag using the following:
sterra export -ssid xxx -u xxx -t followers and it started the process all over again, which meant it wasn't a rate-limit blockage.

Also, the "Getting users details" has been completed to 100% (then again rate limit).

TargetException

Hey!
When I scrape the followers of a specific account it starts but stops about 30-35% with that error message:

TargetException: Be sure that you are following the account you are aiming for if it is in private.

Is there anything I can do about it? Didn't you had a delay function in your script?

login issue

Excited to give the new update a spin!!

Trying to work through this login issue:
"Please check Instagram app for a security confirmation that it is you trying to login."

I keep acknowledging it was me but to no avail -- might be due to thinking it's a windows 10 phone (who has one of those, right?) -- if I figure it out will update....

Screen Shot 2021-11-15 at 1 30 45 PM

HTTP Error 400 (Bad Request) on GraphQL Query.

Howdy!
This looks really useful - getting this error though:

"HTTP Error 400 (Bad Request) on GraphQL Query. Retrying with shorter page length."

this is exact error:
"anaconda3/lib/python3.7/site-packages/instaloader-4.8.1-py3.7.egg/instaloader/instaloadercontext.py", line 345, in get_json
raise QueryReturnedBadRequestException("400 Bad Request")
instaloader.exceptions.QueryReturnedBadRequestException: 400 Bad Request"

Thanks!

Doesn't work when built

Sterra works fine when I am using it normally in python. When I built my python script, it is showing completely different outputs to before.

ERROR

When performing a search as sterra -u xxxxx -t followers, (xxxxx I replace it with a user) I get the following error

Unknown error, here is the response:
{"message": "checkpoint_required", "checkpoint_url": "/ challenge / AXFDryCPIRfCXMzgUoVyguEOsXuhmBvRItoY27ajqfad1f7U-MaDLvlGFXsjnMnwgYVcr8A / OwJmxTBVrender:" flow "0", "lockty" status "flow" falsety} "lockty", falsety "lockty"} "flowtyVcr8A / OwJmxTBVrender:"

Error

Hello! I have a error during the export of mutual followers. Attached the screenshot
The text:

Traceback (most recent call last):
File "/usr/local/lib/python3.9/dist-packages/sterra-2.1.4-py3.9.egg/sterra/core.py", line 84, in main
raise IndexError
IndexError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/bin/sterra", line 33, in
sys.exit(load_entry_point('sterra==2.1.4', 'console_scripts', 'sterra')())
File "/usr/local/lib/python3.9/dist-packages/sterra-2.1.4-py3.9.egg/sterra/core.py", line 131, in main
_ins.tagram(
File "/usr/local/lib/python3.9/dist-packages/sterra-2.1.4-py3.9.egg/sterra/_ins.py", line 340, in tagram
mutuals = traction(ul=mutualList, sd=sssid, ai=ex, xp=ex, dl=dl).strt()
TypeError: strt() missing 1 required positional argument: 'rtn'

2022-02-08_22-00-15
.

Got error for export

Hi,

I am getting the following error when I used the basic usage command:
sterra export -ssid mysessid -u tgtuser -t following

The error I'm getting:

|Β§| Path /home/ubuntu/.local/lib/python3.8/site-packages/sterra/export/ created.
|Β§| Path /home/ubuntu/.local/lib/python3.8/site-packages/sterra/parts/ created.
|Β§| Path /home/ubuntu/.local/lib/python3.8/site-packages/sterra/_history_.json created.
Traceback (most recent call last):
  File "/home/ubuntu/.local/bin/sterra", line 5, in <module>
    from sterra.core import main
  File "/home/ubuntu/.local/lib/python3.8/site-packages/sterra/core.py", line 10, in <module>
    from sterra.filerra import *
  File "/home/ubuntu/.local/lib/python3.8/site-packages/sterra/filerra.py", line 9, in <module>
    class exporter:
  File "/home/ubuntu/.local/lib/python3.8/site-packages/sterra/filerra.py", line 10, in exporter
    def __init__(self, _:object, List:list[dict], file_path:str, Format:str, **kwargs:dict) -> None:
TypeError: 'type' object is not subscriptable

Error when exporting to csv

When exporting to a csv file using this command:
sterra export -ssid {SSID} -u {Username} -t followers -f csv

I get an error saying
UnicodeEncodeError: 'charmap' codec can't encode characters in position 397-398: character maps to <undefined>

KeyError: 'The input list must contain (at least) the key "id"'

Following the example on on the wiki: sterra compare F_ID_1 F_ID_2 --common-usernames

I have tried the full path to each of the files for comparison , also tried with the file ID's found listed in history for the files im trying to compare but both return KeyError: 'The input list must contain (at least) the key "id"'

Is this an issue or am I using it incorrectly?

Invalid sessid

IΒ΄m still getting "invalid sessid"

I saw that you updated the script... I tried reinstalling Sterra, but no luck

Call sterra directly from python (#2)

Last issue was force closed, so here again. I tried the solution mentioned before.
I have added the running of main here: https://pastebin.com/T3xdg2GG
However, it just prints out the default print (not the export not with arguments).
It is not calling the new parser() functions, just the old one.

All I want to do is to get followers directly from python and get a path to the file.

Newbie with problem executing sterra

Installed Sterra using pip and manually (git clone).

After running sterra, I get this:

Any help will be very appreciated.

(base) mypc@192 ~ % sterra
Traceback (most recent call last):
  File "/Users/me/opt/anaconda3/bin/sterra", line 33, in <module>
    sys.exit(load_entry_point('sterra==2.2.1', 'console_scripts', 'sterra')())
  File "/Users/me/opt/anaconda3/bin/sterra", line 25, in importlib_load_entry_point
    return next(matches).load()
  File "/Users/me/opt/anaconda3/lib/python3.8/importlib/metadata.py", line 77, in load
    module = import_module(match.group('module'))
  File "/Users/me/opt/anaconda3/lib/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 843, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/Users/me/opt/anaconda3/lib/python3.8/site-packages/sterra-2.2.1-py3.8.egg/sterra/core.py", line 10, in <module>
    from sterra.filerra import *
  File "/Users/me/opt/anaconda3/lib/python3.8/site-packages/sterra-2.2.1-py3.8.egg/sterra/filerra.py", line 7, in <module>
    from sterra.exterra import exman
  File "/Users/me/opt/anaconda3/lib/python3.8/site-packages/sterra-2.2.1-py3.8.egg/sterra/exterra.py", line 1, in <module>
    from sterra.histerra import file_id, add_part, add, get_part, match
  File "/Users/me/opt/anaconda3/lib/python3.8/site-packages/sterra-2.2.1-py3.8.egg/sterra/histerra.py", line 79, in <module>
    def get_part(part_option:str=True) -> tuple[str,str]:
TypeError: 'type' object is not subscriptable

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.