Skip to content

Major Upgrade v1.3#145

Merged
PSNAppz merged 248 commits intomasterfrom
dev
Oct 28, 2018
Merged

Major Upgrade v1.3#145
PSNAppz merged 248 commits intomasterfrom
dev

Conversation

@PSNAppz
Copy link
Member

@PSNAppz PSNAppz commented Oct 28, 2018 •
edited
Loading

Changed

  • Major code improvements
  • Updated README.md
  • Updated dependencies
  • Refactored TorBot

Added

  • Visualizer Module
  • Download option to save Tree into different formats.
  • DB module
  • Installation shell script to create torBot binary
  • Test for getting links that uses a Mock Object to reproduce tests without touching actual servers.
  • BFS algorithm for crawling
  • Documentation for functions

Removed

  • -l Live argument Removed (Enabled by default)

PSNAppz and others added 30 commits February 14, 2018 22:38
@PSNAppz
TO-DO list update
73ba9f4
@KingAkeem
Added Go version of getweblinks getLinks function
5ad194f 
Created a Go function that is a replica of getLinks in getweblinks,
except much faster. The go_modules folder is composed of a shared object
file, a header file, the go source code and a python file that is
dynamically linking the shared object.
To it out, just go to the go_modules folder and run `python3
getLinks.py`
@KingAkeem
Forgot to add folders :)
7696666
@KingAkeem
Put go_modules inside of modules to not break code
ad5f686 
getLinks.go can also ignore domains that aren't .onion now using the
same regular expression that is inside of getweblinks.py
@KingAkeem
Added modules folder
00d4744
title feature added
5584d9e
title feature tested, plus little refactor
deced4f
@PSNAppz
Merge pull request #68 from KingAkeem/goBot
3238e4d 
Added Go version of getweblinks getLinks function
@PSNAppz
Merge pull request #69 from Agostinelli/dev
84424c9 
Title feature added
@PSNAppz
Torbot is now OSNIT Tool .
0e3c7db
@PSNAppz
TorBot is now OSINT tool
7e390e3
Added new http requests mock for pagereader test
16782bb
Adding requests_mock version 1.4.0 to requirements
6ea473a
Adding BeautifulSoup import to test
e9b79de
@KingAkeem
Fixing typo
96301e4
@tiagoCMatias
Added Database Register
e76a578
@tiagoCMatias
Removed debug messages
42c66ef
description page function added
7b50af0
description page function added
0fb17c8
@shivankar-madaan
Handle exception
09df97d
@shivankar-madaan
changed the check for exception
2189948 
Added comments as well
@shivankar-madaan
reverted
fed695a
@shivankar-madaan
Changed exit code
8f4b9f3 
as per https://docs.python.org/3/library/sys.html#sys.exit
@shivankar-madaan
fixed indentation
cb01e68
@tiagoCMatias
Save to Database Refactoring
dfde4f5
@tiagoCMatias
changed verification of credentials to what was requested in the pull…
246ab96 
… request #75
@PSNAppz
Merge pull request #74 from KingAkeem/dev
2fb66a1 
Added new http requests mock for pagereader test
@KingAkeem
Made Schema optional for more robust choices url
30e9b62 
MissingSchema is now being caught as an exception for reading pages,
if a schema isn't found then https is attempted with http being the
last option. Changed test to reflect changes in pagereader module.
@PSNAppz
Merge pull request #80 from KingAkeem/dev
5a4252f 
Made Schema optional for more robust choices url
@PSNAppz
Merge branch 'dev' into patch-1
87cd399
KingAkeem and others added 23 commits October 19, 2018 03:28
@KingAkeem
Catch both ConnectionErrors
a707dd7
@PSNAppz
Merge branch 'refactoring' of https://github.com/KingAkeem/TorBot int…
56d227e 
…o refactoring
@KingAkeem
Removing ununsed flag
43fbe96
@KingAkeem
Catching ChunkEncodingError
146c623
@PSNAppz
Update torBot.py
ac22ab5
@PSNAppz
Merge pull request #139 from KingAkeem/refactoring
8664b2b 
Major Refactoring v1.3
@PSNAppz
Ignore .DS_Store
a7310c5
@PSNAppz
Updated CHANGELOG & Adding Hound Automation
88ce98b
@PSNAppz
Adding coveralls to .travis.yml
f78b6d9
@PSNAppz
Adding coveralls to .travis.yml
2fda2a8
@PSNAppz
Adding coveralls to .travis.yml
0ceb61b
@PSNAppz
Adding coveralls to .travis.yml
65bee14
@KingAkeem
Adding multithreading to tree generation
191e1f1
@KingAkeem
Removing debugging print statement
3a55f25
@KingAkeem
Fixing houndbot complaints
f847f83
@KingAkeem
Adding documentation and using properties for class
a1815a5
@KingAkeem
Fixing tests and properties
b36eb1c
@KingAkeem
Fixing houndbot complaints
dc36fa6
@KingAkeem
More documentation
a9f61af
@KingAkeem
Fixing houndbot complaints
3265e1b
@KingAkeem
Using correct property
5832d1a
@KingAkeem
Fixing properties and checking for existence of link before validation
a9d945d
@PSNAppz
Merge pull request #144 from KingAkeem/multi_thread_tree
1fd77b7 
Using multi-threading for tree generation with links and adding documentation
hound[bot]
hound bot reviewed Oct 28, 2018
View reviewed changes
Copy link

@hound hound bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some files could not be reviewed due to errors:

Traceback (most recent call last): 
Traceback (most recent call last):
  File "/home/linters/.local/bin/flake8", line 7, in 
    from flake8.main.cli import main
ModuleNotFoundError: No module named 'flake8'

@PSNAppz PSNAppz requested a review from KingAkeem October 28, 2018 15:35
hound[bot]
hound bot reviewed Oct 28, 2018
View reviewed changes
Copy link

@hound hound bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some files could not be reviewed due to errors:

Traceback (most recent call last): 
Traceback (most recent call last):
  File "/home/linters/.local/bin/flake8", line 7, in 
    from flake8.main.cli import main
ModuleNotFoundError: No module named 'flake8'

@PSNAppz PSNAppz removed the request for review from KingAkeem October 28, 2018 15:38
@PSNAppz PSNAppz merged commit 200861e into master Oct 28, 2018
PSNAppz added a commit that referenced this pull request Oct 28, 2018
@PSNAppz
Merge pull request #146 from DedSecInside/master
0dda4c5 
Merge pull request #145 from DedSecInside/dev
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer

@hound hound[bot] hound[bot] left review comments

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.