Fixed -l flag for finding live links.#66
Merged
PSNAppz merged 24 commits intoDedSecInside:devfrom Feb 12, 2018
KingAkeem:dev
Merged
Fixed -l flag for finding live links.#66PSNAppz merged 24 commits intoDedSecInside:devfrom KingAkeem:dev
-l flag for finding live links.#66PSNAppz merged 24 commits intoDedSecInside:devfrom
KingAkeem:dev
Conversation
Merge pull request #53 from KingAkeem/dev
Merging changes
Takes list of URLs and asychrnously calls HEAD request on each link in the list and test status code for a 200 response. If the response is not 200 or takes longer than 8 seconds, the link is declared dead. Also switched from urllib.request to requests for not only simplicity but thread-safety also.
Takes list of URLs and asychrnously calls HEAD request on each link in the list and test status code for a 200 response. If the response is not 200 or takes longer than 8 seconds, the link is declared dead. Also switched from urllib.request to requests for not only simplicity but thread-safety also.
Member
|
@KingAkeem Fix ext flag |
Member
Author
|
What about issue #58 ? I was going to work on it but I didn't know if someone was already working on it. |
Was previously showing dead for any status code which isn't 200, so I use raise_for_status function from requests which only raises an error if the status code is an HTTP error status code such as 4xx and 5xx
To use dash -e flag, pass url name like www.url.com and it will try to establish an https connection than http if the secure conneciton fails. If both fail then an error message is printed. If the connection is successful than we search for the onion domain name and the others that were passed with the flag.
PSNAppz
reviewed
Feb 11, 2018
modules/getweblinks.py
Outdated
|
|
||
| Returns: | ||
| websites: List of websites that were found | ||
| wfebsites: List of websites that were found |
Fixed requirements.txt, I took out the stem module since it's not used anymore. Added requests module also
Member
|
@KingAkeem The test seems broken.
Any idea ? The requests library is added to requirements btw. |
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Takes list of URLs and asychrnously calls HEAD request on each
link in the list and test status code for a 200 response. If the
response is not 200 or takes longer than 8 seconds, the link is
declared dead. Also switched from urllib.request to requests for
not only simplicity but thread-safety also.
Fixes: #61